-- Logs begin at Tue 2022-06-21 05:13:25 UTC, end at Tue 2022-06-21 06:14:32 UTC. -- Jun 21 05:39:39.964009 dv-cinder-846901-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 21 05:39:39.973517 dv-cinder-846901-1-iscsi devstack@keystone.service[80105]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 21 05:39:39.975292 dv-cinder-846901-1-iscsi devstack@keystone.service[80105]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 21 05:39:39 2022] *** Jun 21 05:39:39.975292 dv-cinder-846901-1-iscsi devstack@keystone.service[80105]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 21 05:39:39.975292 dv-cinder-846901-1-iscsi devstack@keystone.service[80105]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 21 05:39:39.975292 dv-cinder-846901-1-iscsi devstack@keystone.service[80105]: nodename: dv-cinder-846901-1-iscsi Jun 21 05:39:39.975292 dv-cinder-846901-1-iscsi devstack@keystone.service[80105]: machine: x86_64 Jun 21 05:39:39.975292 dv-cinder-846901-1-iscsi devstack@keystone.service[80105]: clock source: unix Jun 21 05:39:39.975292 dv-cinder-846901-1-iscsi devstack@keystone.service[80105]: pcre jit disabled Jun 21 05:39:39.975292 dv-cinder-846901-1-iscsi devstack@keystone.service[80105]: detected number of CPU cores: 4 Jun 21 05:39:39.975292 dv-cinder-846901-1-iscsi devstack@keystone.service[80105]: current working directory: / Jun 21 05:39:39.975292 dv-cinder-846901-1-iscsi devstack@keystone.service[80105]: detected binary path: /usr/bin/uwsgi-core Jun 21 05:39:39.975292 dv-cinder-846901-1-iscsi devstack@keystone.service[80105]: your processes number limit is 47680 Jun 21 05:39:39.975908 dv-cinder-846901-1-iscsi devstack@keystone.service[80105]: your memory page size is 4096 bytes Jun 21 05:39:39.975908 dv-cinder-846901-1-iscsi devstack@keystone.service[80105]: detected max file descriptor number: 2048 Jun 21 05:39:39.975908 dv-cinder-846901-1-iscsi devstack@keystone.service[80105]: lock engine: pthread robust mutexes Jun 21 05:39:39.975908 dv-cinder-846901-1-iscsi devstack@keystone.service[80105]: thunder lock: enabled Jun 21 05:39:39.975908 dv-cinder-846901-1-iscsi devstack@keystone.service[80105]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 21 05:39:39.975908 dv-cinder-846901-1-iscsi devstack@keystone.service[80105]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 21 05:39:40.020009 dv-cinder-846901-1-iscsi devstack@keystone.service[80105]: Python main interpreter initialized at 0x563caf9f29c0 Jun 21 05:39:40.020009 dv-cinder-846901-1-iscsi devstack@keystone.service[80105]: python threads support enabled Jun 21 05:39:40.020009 dv-cinder-846901-1-iscsi devstack@keystone.service[80105]: your server socket listen backlog is limited to 100 connections Jun 21 05:39:40.020009 dv-cinder-846901-1-iscsi devstack@keystone.service[80105]: your mercy for graceful operations on workers is 90 seconds Jun 21 05:39:40.020378 dv-cinder-846901-1-iscsi devstack@keystone.service[80105]: mapped 403077 bytes (393 KB) for 2 cores Jun 21 05:39:40.020459 dv-cinder-846901-1-iscsi devstack@keystone.service[80105]: *** Operational MODE: preforking *** Jun 21 05:39:40.020719 dv-cinder-846901-1-iscsi devstack@keystone.service[80105]: *** uWSGI is running in multiple interpreter mode *** Jun 21 05:39:40.020719 dv-cinder-846901-1-iscsi devstack@keystone.service[80105]: spawned uWSGI master process (pid: 80105) Jun 21 05:39:40.020929 dv-cinder-846901-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 21 05:39:40.021964 dv-cinder-846901-1-iscsi devstack@keystone.service[80105]: spawned uWSGI worker 1 (pid: 80109, cores: 1) Jun 21 05:39:40.021964 dv-cinder-846901-1-iscsi devstack@keystone.service[80105]: spawned uWSGI worker 2 (pid: 80110, cores: 1) Jun 21 05:39:40.022128 dv-cinder-846901-1-iscsi devstack@keystone.service[80105]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 21 05:39:45.501022 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 05:39:45.501022 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: from cryptography.utils import int_from_bytes Jun 21 05:39:45.501778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 05:39:45.501778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: from cryptography.utils import int_from_bytes Jun 21 05:39:45.502485 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 05:39:45.502485 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: from cryptography.utils import int_from_bytes Jun 21 05:39:45.502945 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 05:39:45.502945 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: from cryptography.utils import int_from_bytes Jun 21 05:39:45.550007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 05:39:45.550198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 05:39:45.550382 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] command line args: [] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 05:39:45.550650 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 05:39:45.550828 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ================================================================================ {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 05:39:45.551081 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] admin_token = **** {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.551326 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] config_dir = [] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.551514 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.551597 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 05:39:45.551696 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] config_source = [] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.551779 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 05:39:45.551860 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] debug = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.551962 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] command line args: [] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 05:39:45.552061 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.552296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 05:39:45.552423 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ================================================================================ {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 05:39:45.552512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.552573 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.552678 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] admin_token = **** {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.552823 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.552933 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] config_dir = [] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.553070 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.553181 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.553283 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] config_source = [] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.553382 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] list_limit = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.553486 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] debug = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.553587 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] log_config_append = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.553692 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.553819 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.553819 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] log_dir = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.554105 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.554211 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] log_file = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.554324 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.554409 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.554527 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.554601 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.554721 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.554795 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.554920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] list_limit = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.554920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] log_config_append = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.555109 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.555186 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.555299 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.555373 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] log_dir = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.555493 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.555574 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] log_file = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.555644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.555712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.555830 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.555913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.555984 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.556111 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.556191 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.556325 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.556404 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.556510 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.556598 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.556676 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.556797 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.556902 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.557043 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.557150 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.557318 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.557443 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.557609 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.557808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.557894 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.558033 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] publish_errors = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.558108 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.558231 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.558306 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.558451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.558557 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.558681 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.558834 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.558952 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.559079 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.559315 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] standard_threads = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.559398 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.559495 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] publish_errors = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.559576 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.559732 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.559823 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.559934 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.560009 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.560133 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] use_journal = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.560207 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.560276 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] use_json = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.560350 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.560420 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] use_stderr = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.560586 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.560671 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] use_syslog = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.560813 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.560888 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] standard_threads = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.561044 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.561120 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.561289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.561378 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.561470 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.561546 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.561650 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] use_journal = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.561769 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.561846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] use_json = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.562014 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] use_stderr = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.562094 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.562193 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] use_syslog = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.562280 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.562428 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:39:45.562504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.562686 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.562764 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.562926 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.563001 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.563184 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.563262 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.563426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.563511 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.563658 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.563740 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.563903 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.563981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.564139 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.564223 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.564375 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.564450 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.564618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.564704 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.564854 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.564933 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.565102 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.565184 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.565339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.565416 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.565565 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.565638 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.565834 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.565912 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.566103 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.566188 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.566352 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.566431 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.566591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.566668 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.566839 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.566914 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.567071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.567149 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.567299 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.567375 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.567529 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.567605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.567763 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.567847 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.568010 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.568093 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.568256 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.568343 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.568485 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.568568 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.568713 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.568790 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.568958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.569042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.569190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.569267 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.569428 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.569502 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.569672 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.569756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.569902 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.570007 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.570163 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.570240 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.570395 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.570481 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.570621 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.570697 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.570850 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.570926 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.571079 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.571234 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.571307 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.571382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.571532 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.571610 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.571779 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.571866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.572010 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.572087 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.572240 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.572323 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.572469 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.572553 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.572699 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.572774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.572931 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.573009 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.573172 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.573262 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.573403 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.573484 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.573640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.573749 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.573876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.574014 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.574135 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.574237 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.574371 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.574474 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.574612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.574720 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.574838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.574920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.575035 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.575116 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.575275 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.575362 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.575510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.575589 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.575740 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.575830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.575975 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.576064 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.576214 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.576294 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.576442 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.576523 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.576680 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.576764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.576914 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.576996 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.577150 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.577267 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.577383 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.577470 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.577638 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.577723 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.577873 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.578026 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.578133 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.578210 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.578370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.578455 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.578602 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.578723 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.578851 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.578971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.579091 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.579168 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.579329 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.579406 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.579573 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.579649 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.579811 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.579896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.580048 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.580124 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.580284 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.580360 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.580519 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.580597 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.580756 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.580833 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.580994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.581070 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.581769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.581854 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.582039 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.582121 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.582279 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.582356 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.582523 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.582609 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.582760 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.582838 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.582996 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.583121 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.583282 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.583409 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.583487 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.583667 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.583743 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.583896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.583981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.584130 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.584221 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.584364 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.584477 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.584598 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.584755 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.584840 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.585061 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.585140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.585294 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.585390 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.585548 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.585805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.585889 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.586086 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.586167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.586322 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] auth.external = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.586401 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.586553 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.586637 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.586848 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.586933 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.587081 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.587159 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.587313 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] auth.password = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.587393 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.587544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] auth.token = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.587621 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.587783 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.587868 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.588018 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.588124 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.588264 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.588351 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.588495 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.588574 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.588736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] auth.external = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.588812 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.588970 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.589051 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.589199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.589276 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.589436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] credential.caching = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.589515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.589683 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.589763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] auth.password = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.589947 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.590029 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] auth.token = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.590193 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.590271 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.590430 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.590510 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.590673 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.590751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.590904 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.590980 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.591153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.591233 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.591402 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.591481 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.591637 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.591715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.591875 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] credential.caching = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.591954 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.592128 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.592210 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.592379 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.592462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.592630 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.592711 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.592869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.592947 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.593113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.593203 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.593351 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] federation.caching = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.593429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.593589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.593670 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.593841 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.593919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.594109 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.594189 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.594338 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.594415 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.594586 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.594670 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.594824 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.594904 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.595091 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.595176 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.595329 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.595408 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.595584 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.595682 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.595824 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] federation.caching = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.595902 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.596064 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.596149 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.596297 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity.caching = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.596375 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.596546 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.596625 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.596777 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.596855 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.597597 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.597694 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.597839 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.597919 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.598119 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.598274 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.598350 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.598421 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.598582 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.598661 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.598832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.598918 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.599082 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.599161 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.599313 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.599390 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] identity.caching = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.599545 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.599631 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.599776 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.599854 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.600020 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.600097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.600259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.600346 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.600506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.600583 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.600736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.600820 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.600976 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.601071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.601227 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.601305 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.601479 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.601557 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.601714 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.601800 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.601979 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.602061 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.602190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.602268 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.602419 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.602508 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.602656 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.602735 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.602897 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.602975 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.603134 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.603220 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.603382 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.603462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.603613 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.603691 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.603865 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.603951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.604105 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.604189 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.604339 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.604415 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.604579 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.604664 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.604815 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.604893 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.605042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.605118 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.605278 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.605365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.605508 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.605587 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.605744 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.605823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.605997 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.606089 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.606241 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.606320 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.606478 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.606557 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.606970 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.607066 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.607219 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.607298 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.607464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.607543 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.607695 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.607780 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.607924 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.608008 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.608153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.608230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.608392 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.608479 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.608631 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.608709 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.608865 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.608932 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.609101 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.609187 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.609331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.609411 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.609570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.609648 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.609818 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.609903 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.610072 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.610151 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.610304 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.610381 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.610553 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.610632 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.610798 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.610877 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.611033 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.611112 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.611262 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.611342 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.611498 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.611575 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.611730 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.611813 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.611965 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.612062 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.612194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.612273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.612450 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.612549 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.612720 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.612799 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.612966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.613043 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.613209 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.613286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.613446 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.613525 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.613673 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.613750 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.613909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.614044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.614169 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.614250 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.614403 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.614480 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.614634 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.614712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.614867 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.614946 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.615111 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.615190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.615357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.615434 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.615591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.615671 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.615840 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.615917 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.616068 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.616145 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.616311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.616390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.616551 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.616630 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.616786 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.616863 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.617021 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.617099 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.617257 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.617337 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.617496 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.617572 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.617726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.617806 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.617989 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.618109 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.618226 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] resource.caching = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.618302 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.618462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.618541 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.618709 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.618788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.618944 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.619020 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.619180 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.619258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.619417 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.619499 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.619664 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.619741 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.619908 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.619986 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.620142 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.620220 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.620376 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.620453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.620613 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] role.caching = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.620692 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] resource.caching = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.620859 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] role.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.620939 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.621091 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.621169 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.621341 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.621421 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.621588 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.621667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.621836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.621915 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.622100 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.622179 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.622343 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.622420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.622582 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.622660 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.622825 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.622905 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.623063 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] role.caching = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.623141 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.623292 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.623378 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] role.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.623533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.623610 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.623782 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.623860 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.624029 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.624117 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.624275 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.624353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.624523 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.624699 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.624777 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.624935 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.625015 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.625184 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.625264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.625434 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.625512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.625682 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.625763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.625975 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.626059 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.626186 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.626266 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.626438 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.626518 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.626687 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.626764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.626926 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.627109 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.627197 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.627348 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.627427 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.627592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.627669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.627840 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.627926 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.628595 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.628683 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.628856 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.628934 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.629090 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.629224 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.629328 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.629407 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.629557 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.629636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.629793 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] token.caching = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.629872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.630053 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.630133 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.630288 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.630365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.630521 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.630601 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.630775 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.630852 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.631022 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.631100 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.631260 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.631339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.631497 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.631574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.631736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.631814 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.631968 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.632048 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.632206 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.632282 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] token.caching = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.632445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.632529 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.632678 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.632757 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.632925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.633004 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.633173 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.633250 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.633409 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.633490 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.633647 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.633724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.633894 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.634019 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.634163 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.634243 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.connection = **** {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.634413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.634501 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.634651 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.634731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.634892 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.634970 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.635129 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.635209 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.635364 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.635441 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.635603 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.635681 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.635834 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.635912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.636067 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.636145 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.636310 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.636389 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.636546 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.636625 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] database.connection = **** {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.636788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.636876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.637024 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.637103 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.637272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.637358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.637509 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.637587 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.637753 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.637832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.638006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.638100 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.638253 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.638330 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.638488 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.638565 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.638660 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 05:39:45.638747 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.638955 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.639200 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.639439 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.639690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.639928 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.640173 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.640406 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.640663 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.640903 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:39:45.641075 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 05:39:45.669695 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.669921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.670181 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.671485 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.671723 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.671956 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.678823 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.680529 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.707824 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.708046 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.709672 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.709909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.762186 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.849435 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.885680 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.885909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.904363 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.904605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.951456 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.951685 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.951910 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.952129 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.952351 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.952566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.952781 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.953014 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.953240 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.953462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.953681 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.953900 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.977802 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.977982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.978138 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.978221 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.978294 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.978401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.978483 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.978626 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.978708 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.978845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.978925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.979061 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.979190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.979281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.990719 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:45.990819 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:46.003973 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:46.004200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:46.004422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:46.004642 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:46.004857 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:46.005090 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:46.005283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:46.005969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:46.006203 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:46.006432 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:46.006659 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:46.006877 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:46.007091 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:46.007303 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 05:39:46.023233 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.023396 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 05:39:46.023736 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.023817 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.023939 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 05:39:46.024020 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 05:39:46.024210 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.024291 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.024471 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.024554 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 05:39:46.024728 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.024811 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.024981 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.025060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.025237 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.025493 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.035725 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.035999 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.036270 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.036391 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.036549 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.036669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.036940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.037222 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.044766 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.045516 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.048041 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.048322 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.048602 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.048821 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.048901 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.049103 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.049185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.049390 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.049471 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.049654 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.049796 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.049926 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.050532 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.050745 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.050824 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.051013 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.051110 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.051279 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.051398 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.051548 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.051821 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.052090 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.077833 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.078834 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.079480 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.079760 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.080445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.080726 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.084992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.085388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.085670 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.086154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.086434 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.086712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.092867 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.093149 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.093940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.094232 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.097645 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.097956 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.098237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.098516 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.098742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.098851 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.099066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.099186 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.099307 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.099411 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.099572 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.099680 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.099848 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.100125 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.100396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.100663 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.118858 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.119147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.120380 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.120511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.123803 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.125058 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.127396 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.127801 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.129364 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.129666 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.133330 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.134732 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.136903 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.138457 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.140553 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.140851 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.141131 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.141410 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.141681 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.141978 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.142137 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.142395 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.142681 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.142963 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.143251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.143532 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.160816 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.161106 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.161370 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.161641 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.162431 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.162716 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.162994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.163256 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.169411 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.171090 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.171211 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.171364 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.172912 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.173187 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.174529 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.174807 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.175626 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.175900 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.176190 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.176811 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.177090 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.177367 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.177655 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.177963 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.189314 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.189592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.189885 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.190188 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.192071 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.192354 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.192436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.192645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.192727 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.192928 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.193017 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.193207 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.193483 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.193766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.210650 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.214909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.216295 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.218197 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.220027 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.221641 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.221850 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.222187 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.222672 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.225336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.227041 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.228652 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.228930 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.229227 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.230451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.232316 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.235503 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.235790 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.236177 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.236453 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.236745 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.238892 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.242232 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.242531 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.242812 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.243094 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.246058 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.246344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.246622 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.253186 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.253992 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.254274 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.255026 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.255309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.255589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.255862 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.256132 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.256504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.256785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.257053 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.257331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.257605 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.257875 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.258161 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.258426 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.258700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.263310 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 05:39:46.263593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.263872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.264149 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.264431 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.264704 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.264986 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.265269 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.265536 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.265802 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.266102 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.266373 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.266645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.266920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 05:39:46.295959 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563caf9f29c0 pid: 80110 (default app) Jun 21 05:39:46.299350 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05306a35-fede-48a1-9c5c-582d300736e7 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:39:46.299646 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05306a35-fede-48a1-9c5c-582d300736e7 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:39:46.299926 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05306a35-fede-48a1-9c5c-582d300736e7 None None] PATH_INFO: `/v3` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:39:46.304621 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Tue Jun 21 05:39:46 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:39:46.304843 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563caf9f29c0 pid: 80109 (default app) Jun 21 05:39:54.074790 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bf7fb-721e-409b-bb9e-995b27b337df None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:39:54.075372 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bf7fb-721e-409b-bb9e-995b27b337df None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:39:54.075372 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bf7fb-721e-409b-bb9e-995b27b337df None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:39:54.076691 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 05:39:54.084470 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb3ebd-f7b0-4121-ac1d-c997774461ae None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:39:54.084857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb3ebd-f7b0-4121-ac1d-c997774461ae None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:39:54.085035 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb3ebd-f7b0-4121-ac1d-c997774461ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:39:54.154782 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: INFO dbcounter [None req-79cb3ebd-f7b0-4121-ac1d-c997774461ae None None] Registered counter for database keystone Jun 21 05:39:54.177112 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG oslo_db.sqlalchemy.engines [None req-79cb3ebd-f7b0-4121-ac1d-c997774461ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 05:39:54.183377 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writer thread running {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 05:39:54.360782 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG passlib.handlers.bcrypt [None req-79cb3ebd-f7b0-4121-ac1d-c997774461ae None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80109) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 21 05:39:54.361211 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG passlib.handlers.bcrypt [None req-79cb3ebd-f7b0-4121-ac1d-c997774461ae None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80109) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 21 05:39:54.416466 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-79cb3ebd-f7b0-4121-ac1d-c997774461ae None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:39:54.418103 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-79cb3ebd-f7b0-4121-ac1d-c997774461ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:39:54.544637 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1/3] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:39:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 21 05:39:54.703433 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bf7fb-721e-409b-bb9e-995b27b337df None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:39:54.785141 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: INFO dbcounter [None req-e29bf7fb-721e-409b-bb9e-995b27b337df None None] Registered counter for database keystone Jun 21 05:39:54.805826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG oslo_db.sqlalchemy.engines [None req-e29bf7fb-721e-409b-bb9e-995b27b337df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 05:39:54.812138 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writer thread running {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 05:39:54.930190 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bf7fb-721e-409b-bb9e-995b27b337df None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:39:54.934374 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623af8f-a73d-44e1-a2b2-f7cc7f0949aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:39:54.935036 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623af8f-a73d-44e1-a2b2-f7cc7f0949aa admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:39:54.935321 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623af8f-a73d-44e1-a2b2-f7cc7f0949aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:39:54.935598 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623af8f-a73d-44e1-a2b2-f7cc7f0949aa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:39:54.945136 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623af8f-a73d-44e1-a2b2-f7cc7f0949aa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:39:55.001847 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e623af8f-a73d-44e1-a2b2-f7cc7f0949aa admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 21 05:39:55.002123 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623af8f-a73d-44e1-a2b2-f7cc7f0949aa admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:39:55.013042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 3/4] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Jun 21 05:39:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 21 05:39:55.019585 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb3ebd-f7b0-4121-ac1d-c997774461ae None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:39:55.033797 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb3ebd-f7b0-4121-ac1d-c997774461ae None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:39:55.038945 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbcbad-33f0-4761-9ab2-ee7031c9dc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:39:55.040064 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbcbad-33f0-4761-9ab2-ee7031c9dc10 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:39:55.040351 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbcbad-33f0-4761-9ab2-ee7031c9dc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:39:55.040627 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbcbad-33f0-4761-9ab2-ee7031c9dc10 admin admin] PATH_INFO: `/v3/projects/fcf1eaa475624717b45bb4aefba5ae51` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:39:55.042280 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbcbad-33f0-4761-9ab2-ee7031c9dc10 admin admin] RBAC: Authorizing `identity:get_project(project_id=fcf1eaa475624717b45bb4aefba5ae51)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:39:55.094888 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f5bbcbad-33f0-4761-9ab2-ee7031c9dc10 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 21 05:39:55.095505 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbcbad-33f0-4761-9ab2-ee7031c9dc10 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:39:55.100727 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 2/5] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Jun 21 05:39:55 2022] GET /identity/v3/projects/fcf1eaa475624717b45bb4aefba5ae51 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:39:57.115048 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee8e35-aead-401c-a883-4bebffb9ee41 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:39:57.115444 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee8e35-aead-401c-a883-4bebffb9ee41 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:39:57.115622 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee8e35-aead-401c-a883-4bebffb9ee41 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:39:57.119770 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 4/6] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:39:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:39:57.125139 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e4cb0-b2cf-41a3-8a35-b3f2386a4d49 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:39:57.125500 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e4cb0-b2cf-41a3-8a35-b3f2386a4d49 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:39:57.125701 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e4cb0-b2cf-41a3-8a35-b3f2386a4d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:39:57.146252 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-fe8e4cb0-b2cf-41a3-8a35-b3f2386a4d49 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:39:57.147829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-fe8e4cb0-b2cf-41a3-8a35-b3f2386a4d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:39:57.155977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 3/7] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:39:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 21 05:39:57.178646 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee8e35-aead-401c-a883-4bebffb9ee41 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:39:57.191269 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee8e35-aead-401c-a883-4bebffb9ee41 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:39:57.195525 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80fa58-6a65-4237-83d4-8bbf979538f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:39:57.196165 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80fa58-6a65-4237-83d4-8bbf979538f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:39:57.196453 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80fa58-6a65-4237-83d4-8bbf979538f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:39:57.196733 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80fa58-6a65-4237-83d4-8bbf979538f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:39:57.204417 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80fa58-6a65-4237-83d4-8bbf979538f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:39:57.207322 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80fa58-6a65-4237-83d4-8bbf979538f7 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:39:57.216290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 5/8] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Jun 21 05:39:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 05:39:57.221969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e4cb0-b2cf-41a3-8a35-b3f2386a4d49 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:39:57.231186 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e4cb0-b2cf-41a3-8a35-b3f2386a4d49 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:39:57.235999 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d260d8d-019f-44cc-a3e9-c35496e46502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:39:57.236862 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d260d8d-019f-44cc-a3e9-c35496e46502 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:39:57.237151 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d260d8d-019f-44cc-a3e9-c35496e46502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:39:57.237569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d260d8d-019f-44cc-a3e9-c35496e46502 admin admin] PATH_INFO: `/v3/users/79f991743edf4c82841603b9b9845e95` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:39:57.239017 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d260d8d-019f-44cc-a3e9-c35496e46502 admin admin] RBAC: Authorizing `identity:get_user(user_id=79f991743edf4c82841603b9b9845e95)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:39:57.240846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d260d8d-019f-44cc-a3e9-c35496e46502 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:39:57.242466 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 4/9] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Jun 21 05:39:57 2022] GET /identity/v3/users/79f991743edf4c82841603b9b9845e95 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:39:59.382207 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a19ac8-9f77-462d-ba21-68d2056ee2e2 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:39:59.382695 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a19ac8-9f77-462d-ba21-68d2056ee2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:39:59.382695 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a19ac8-9f77-462d-ba21-68d2056ee2e2 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:39:59.384038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:39:59.389353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220ef1a-83ca-42c2-80dc-0d258237eb4d None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:39:59.389746 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220ef1a-83ca-42c2-80dc-0d258237eb4d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:39:59.389913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220ef1a-83ca-42c2-80dc-0d258237eb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:39:59.390141 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736a0cb-2bc8-4bb6-a05c-4efa867d777f None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:39:59.390439 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736a0cb-2bc8-4bb6-a05c-4efa867d777f None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:39:59.390727 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736a0cb-2bc8-4bb6-a05c-4efa867d777f None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:39:59.391955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 7/11] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:39:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 05:39:59.397718 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a924f27-fe63-4718-bbfe-9e11bc901a06 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:39:59.398033 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a924f27-fe63-4718-bbfe-9e11bc901a06 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:39:59.398314 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a924f27-fe63-4718-bbfe-9e11bc901a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:39:59.407688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-6220ef1a-83ca-42c2-80dc-0d258237eb4d None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:39:59.408900 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-6220ef1a-83ca-42c2-80dc-0d258237eb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:39:59.447310 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG passlib.handlers.bcrypt [None req-6a924f27-fe63-4718-bbfe-9e11bc901a06 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80110) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 21 05:39:59.447749 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG passlib.handlers.bcrypt [None req-6a924f27-fe63-4718-bbfe-9e11bc901a06 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80110) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 21 05:39:59.493474 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-6a924f27-fe63-4718-bbfe-9e11bc901a06 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:39:59.493998 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 5/12] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 05:39:59.495190 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6a924f27-fe63-4718-bbfe-9e11bc901a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:39:59.517744 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220ef1a-83ca-42c2-80dc-0d258237eb4d None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:39:59.541439 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:39:59.599022 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 8/13] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 05:39:59.622485 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a924f27-fe63-4718-bbfe-9e11bc901a06 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:39:59.626934 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220ef1a-83ca-42c2-80dc-0d258237eb4d None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:39:59.662423 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6dd2b6-5608-4a30-8f54-c4d4c6266325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:39:59.663145 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6dd2b6-5608-4a30-8f54-c4d4c6266325 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:39:59.663433 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6dd2b6-5608-4a30-8f54-c4d4c6266325 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:39:59.663720 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6dd2b6-5608-4a30-8f54-c4d4c6266325 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:39:59.675602 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6dd2b6-5608-4a30-8f54-c4d4c6266325 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:39:59.687042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-8e6dd2b6-5608-4a30-8f54-c4d4c6266325 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:39:59.687042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:39:59.687042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:39:59.687042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:39:59.687042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:39:59.687042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:39:59.687042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:39:59.687042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:39:59.687042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:39:59.687042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:39:59.687042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:39:59.687042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:39:59.687042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:39:59.687042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:39:59.687042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:39:59.687042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:39:59.688153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:39:59.688153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:39:59.688153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:39:59.688153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:39:59.688153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:39:59.688153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:39:59.688153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:39:59.688153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:39:59.688153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:39:59.688153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:39:59.688153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:39:59.688153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:39:59.688153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:39:59.688153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:39:59.688153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:39:59.688153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:39:59.689012 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:39:59.689012 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:39:59.689012 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:39:59.689012 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:39:59.689012 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:39:59.689012 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:39:59.689012 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:39:59.689012 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:39:59.689012 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:39:59.689012 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:39:59.689012 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:39:59.689012 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:39:59.689012 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 6/14] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:39:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:39:59.694705 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6dd2b6-5608-4a30-8f54-c4d4c6266325 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:39:59.726227 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a924f27-fe63-4718-bbfe-9e11bc901a06 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:39:59.728555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:39:59.767210 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cca7f-a965-4655-8eb7-03f8095042b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:39:59.768120 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cca7f-a965-4655-8eb7-03f8095042b1 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:39:59.768454 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cca7f-a965-4655-8eb7-03f8095042b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:39:59.768733 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cca7f-a965-4655-8eb7-03f8095042b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:39:59.783325 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:39:59.804367 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6dd2b6-5608-4a30-8f54-c4d4c6266325 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:39:59.838670 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6fa72-9886-44fb-820a-8ca0d8594bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:39:59.839340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6fa72-9886-44fb-820a-8ca0d8594bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:39:59.839624 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6fa72-9886-44fb-820a-8ca0d8594bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:39:59.839902 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6fa72-9886-44fb-820a-8ca0d8594bb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:39:59.840659 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6fa72-9886-44fb-820a-8ca0d8594bb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:39:59.841334 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6fa72-9886-44fb-820a-8ca0d8594bb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:39:59.841980 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753cca7f-a965-4655-8eb7-03f8095042b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:39:59.842414 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6fa72-9886-44fb-820a-8ca0d8594bb8 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:39:59.843506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753cca7f-a965-4655-8eb7-03f8095042b1 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:39:59.856648 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 7/15] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:39:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:39:59.862946 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6fa72-9886-44fb-820a-8ca0d8594bb8 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:39:59.958363 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 9/16] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:39:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 05:39:59.962990 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6fa72-9886-44fb-820a-8ca0d8594bb8 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:39:59.963967 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cca7f-a965-4655-8eb7-03f8095042b1 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:39:59.967315 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:39:59.999271 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237178e0-0816-4041-852f-f2450dc20be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:00.000140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237178e0-0816-4041-852f-f2450dc20be3 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:00.000445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237178e0-0816-4041-852f-f2450dc20be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:00.000694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237178e0-0816-4041-852f-f2450dc20be3 None admin] PATH_INFO: `/v3/users/79f991743edf4c82841603b9b9845e95` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:00.001918 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237178e0-0816-4041-852f-f2450dc20be3 None admin] RBAC: Authorizing `identity:get_user(user_id=79f991743edf4c82841603b9b9845e95)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:00.003413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237178e0-0816-4041-852f-f2450dc20be3 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:00.005063 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 8/17] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:39:59 2022] GET /identity/v3/users/79f991743edf4c82841603b9b9845e95 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:40:00.010568 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237178e0-0816-4041-852f-f2450dc20be3 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:00.024961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:00.065149 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cca7f-a965-4655-8eb7-03f8095042b1 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:00.099379 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc56989-7d25-41fd-ba22-9e0c8ee56231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:00.100185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc56989-7d25-41fd-ba22-9e0c8ee56231 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:00.100469 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc56989-7d25-41fd-ba22-9e0c8ee56231 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:00.100746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc56989-7d25-41fd-ba22-9e0c8ee56231 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:00.114948 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237178e0-0816-4041-852f-f2450dc20be3 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:00.121973 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc56989-7d25-41fd-ba22-9e0c8ee56231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:00.123462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc56989-7d25-41fd-ba22-9e0c8ee56231 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:00.148464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-ccc56989-7d25-41fd-ba22-9e0c8ee56231 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:40:00.148464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:00.148464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:00.148464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:00.148464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:00.148464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:00.148464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:00.148464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:00.148464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:00.148464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:00.148464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:00.148464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:00.148464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:40:00.148464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:40:00.148464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:40:00.150731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:40:00.150731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:00.150731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:00.150731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:00.150731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:00.150731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:00.150731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:00.150731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:00.150731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:00.150731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:00.150731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:00.150731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:00.150731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:00.150731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:00.150731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:00.150731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:00.150731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:00.151525 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:40:00.151525 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:40:00.151525 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:40:00.151525 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:40:00.151525 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 10/18] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:40:00.152462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effcc341-0c6f-46e6-8f7c-3efabeaf40a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:00.153265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcc341-0c6f-46e6-8f7c-3efabeaf40a5 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:00.153553 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcc341-0c6f-46e6-8f7c-3efabeaf40a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:00.153835 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcc341-0c6f-46e6-8f7c-3efabeaf40a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:00.155074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcc341-0c6f-46e6-8f7c-3efabeaf40a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:00.155440 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc56989-7d25-41fd-ba22-9e0c8ee56231 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:00.156541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcc341-0c6f-46e6-8f7c-3efabeaf40a5 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:00.158184 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 9/19] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:40:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:40:00.164516 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effcc341-0c6f-46e6-8f7c-3efabeaf40a5 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:00.224641 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:00.257083 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:00.274782 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc56989-7d25-41fd-ba22-9e0c8ee56231 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:00.277530 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effcc341-0c6f-46e6-8f7c-3efabeaf40a5 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:00.310150 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb8eb2-e6e8-494d-b482-467c01d11e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:00.310825 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb8eb2-e6e8-494d-b482-467c01d11e9c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:00.311116 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb8eb2-e6e8-494d-b482-467c01d11e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:00.311400 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb8eb2-e6e8-494d-b482-467c01d11e9c None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:00.311898 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965c231-c913-4344-b11c-7457339723b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:00.312140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb8eb2-e6e8-494d-b482-467c01d11e9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:00.312473 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb8eb2-e6e8-494d-b482-467c01d11e9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:00.312562 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965c231-c913-4344-b11c-7457339723b6 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:00.312829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965c231-c913-4344-b11c-7457339723b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:00.313109 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965c231-c913-4344-b11c-7457339723b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:00.313850 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb8eb2-e6e8-494d-b482-467c01d11e9c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:00.313965 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965c231-c913-4344-b11c-7457339723b6 None admin] RBAC: Adding query filter params (role.id=24aa6040c86049f996560e477e83886f, scope.domain.id=default, user.id=79f991743edf4c82841603b9b9845e95) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:00.314269 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965c231-c913-4344-b11c-7457339723b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:00.315758 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965c231-c913-4344-b11c-7457339723b6 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:00.322592 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 10/20] 10.222.0.18 () {56 vars in 1322 bytes} [Tue Jun 21 05:40:00 2022] GET /identity/v3/role_assignments?user.id=79f991743edf4c82841603b9b9845e95&scope.domain.id=default&role.id=24aa6040c86049f996560e477e83886f => generated 233 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:40:00.333733 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 11/21] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:40:02.984251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99700b3-d467-44be-a048-82c7d84e2f2f None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:02.984808 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99700b3-d467-44be-a048-82c7d84e2f2f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:02.985237 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99700b3-d467-44be-a048-82c7d84e2f2f None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:02.987824 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 11/22] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:03.019491 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e1ec1-10cb-4b1a-bbb1-d81578d8290e None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:03.020136 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e1ec1-10cb-4b1a-bbb1-d81578d8290e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:03.020500 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e1ec1-10cb-4b1a-bbb1-d81578d8290e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:03.055117 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-ed7e1ec1-10cb-4b1a-bbb1-d81578d8290e None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:03.057146 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ed7e1ec1-10cb-4b1a-bbb1-d81578d8290e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:03.177907 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 12/23] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:03.250474 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99700b3-d467-44be-a048-82c7d84e2f2f None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:03.415577 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99700b3-d467-44be-a048-82c7d84e2f2f None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:03.458687 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88669817-2dc8-4f75-93ff-943b3bdcebf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:03.459368 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88669817-2dc8-4f75-93ff-943b3bdcebf7 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:03.459658 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88669817-2dc8-4f75-93ff-943b3bdcebf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:03.459940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88669817-2dc8-4f75-93ff-943b3bdcebf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:03.460756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88669817-2dc8-4f75-93ff-943b3bdcebf7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:03.462198 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88669817-2dc8-4f75-93ff-943b3bdcebf7 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:03.629651 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 12/24] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Jun 21 05:40:03 2022] POST /identity/v3/roles => generated 219 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:40:03.930665 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023e692-d3ff-49d6-b5a7-df1aa0408b48 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:03.931655 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023e692-d3ff-49d6-b5a7-df1aa0408b48 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:03.932458 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023e692-d3ff-49d6-b5a7-df1aa0408b48 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:03.935231 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 13/25] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:03.941674 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcc7aa-2e55-4b7e-beee-4af613df7fdf None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:03.941987 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcc7aa-2e55-4b7e-beee-4af613df7fdf None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:03.942280 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcc7aa-2e55-4b7e-beee-4af613df7fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:03.961776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:03.983902 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-b2fcc7aa-2e55-4b7e-beee-4af613df7fdf None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:03.985455 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b2fcc7aa-2e55-4b7e-beee-4af613df7fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:04.068556 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868d962-aad3-45b3-88d4-25582ee251b3 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:04.070036 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868d962-aad3-45b3-88d4-25582ee251b3 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:04.070768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868d962-aad3-45b3-88d4-25582ee251b3 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:04.073572 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 14/26] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:04.079859 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12276ce5-4d6e-488b-98f5-6318ce1e3780 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:04.080651 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12276ce5-4d6e-488b-98f5-6318ce1e3780 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:04.081462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12276ce5-4d6e-488b-98f5-6318ce1e3780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:04.082139 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 13/27] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 05:40:04.084988 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045842d-76f2-40ac-a304-5344d64e67b9 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:04.084988 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045842d-76f2-40ac-a304-5344d64e67b9 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:04.084988 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045842d-76f2-40ac-a304-5344d64e67b9 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:04.085604 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 14/28] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:04.092407 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f6c39-5ab5-4a63-ab95-367ee13bb286 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:04.092710 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f6c39-5ab5-4a63-ab95-367ee13bb286 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:04.092981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f6c39-5ab5-4a63-ab95-367ee13bb286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:04.119517 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-df6f6c39-5ab5-4a63-ab95-367ee13bb286 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:04.120737 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-df6f6c39-5ab5-4a63-ab95-367ee13bb286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:04.124257 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-12276ce5-4d6e-488b-98f5-6318ce1e3780 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:04.125442 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-12276ce5-4d6e-488b-98f5-6318ce1e3780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:04.173471 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:04.203947 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 15/29] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 05:40:04.204685 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12276ce5-4d6e-488b-98f5-6318ce1e3780 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:04.211184 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 15/30] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:04.234474 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f6c39-5ab5-4a63-ab95-367ee13bb286 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:04.318782 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:04.338739 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12276ce5-4d6e-488b-98f5-6318ce1e3780 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:04.372640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f6c39-5ab5-4a63-ab95-367ee13bb286 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:04.377286 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14c1d9-9907-4e19-a6d4-7f9911d678c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:04.378624 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14c1d9-9907-4e19-a6d4-7f9911d678c5 None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:04.378909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14c1d9-9907-4e19-a6d4-7f9911d678c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:04.379221 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14c1d9-9907-4e19-a6d4-7f9911d678c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:04.380017 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14c1d9-9907-4e19-a6d4-7f9911d678c5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:04.381532 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14c1d9-9907-4e19-a6d4-7f9911d678c5 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:04.412194 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ef095-c6e0-4efc-ab30-4843bbd71fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:04.412998 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ef095-c6e0-4efc-ab30-4843bbd71fde None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:04.413288 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ef095-c6e0-4efc-ab30-4843bbd71fde None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:04.413571 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ef095-c6e0-4efc-ab30-4843bbd71fde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:04.424628 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ef095-c6e0-4efc-ab30-4843bbd71fde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:04.426829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ef095-c6e0-4efc-ab30-4843bbd71fde None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:04.447388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-098ef095-c6e0-4efc-ab30-4843bbd71fde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:40:04.447388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:04.447388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:04.447388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:04.447388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:04.447388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:04.447388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:04.447388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:04.447388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:04.447388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:04.447388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:04.447388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:04.447388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:40:04.447388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:40:04.447388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:40:04.448221 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:40:04.448221 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:04.448221 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:04.448221 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:04.448221 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:04.448221 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:04.448221 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:04.448221 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:04.448221 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:04.448221 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:04.448221 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:04.448221 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:04.448221 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:04.448221 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:04.448221 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:04.448221 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:04.448221 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:04.450424 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:40:04.450424 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:40:04.450424 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:40:04.450424 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:40:04.450424 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 16/31] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:40:04.450424 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ef095-c6e0-4efc-ab30-4843bbd71fde None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:04.522145 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 16/32] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Jun 21 05:40:04 2022] POST /identity/v3/roles => generated 225 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:40:04.523351 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14c1d9-9907-4e19-a6d4-7f9911d678c5 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:04.562931 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ef095-c6e0-4efc-ab30-4843bbd71fde None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:04.582770 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:04.597855 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:04.617672 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8a76b-a460-481a-bd74-748bcd461b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:04.618570 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8a76b-a460-481a-bd74-748bcd461b2e None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:04.618866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8a76b-a460-481a-bd74-748bcd461b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:04.619186 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8a76b-a460-481a-bd74-748bcd461b2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:04.643200 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8a76b-a460-481a-bd74-748bcd461b2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:04.650981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-b9c8a76b-a460-481a-bd74-748bcd461b2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:40:04.650981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:04.650981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:04.650981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:04.650981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:04.650981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:04.650981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:04.650981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:04.650981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:04.650981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:04.650981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:04.650981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:04.650981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:04.650981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:04.650981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:04.650981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:04.653034 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:04.653034 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:04.653034 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:04.653034 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:04.653034 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:04.653034 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:04.653034 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:04.653034 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:04.653034 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:04.653034 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:04.653034 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:04.653034 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:04.653034 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:04.653034 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:04.653034 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:04.653034 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:04.655041 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:04.655041 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:04.655041 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:04.655041 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:04.655041 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:04.655041 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:04.655041 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:04.655041 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:04.655041 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:04.655041 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:04.655041 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:40:04.655041 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:40:04.655041 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 17/33] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:40:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:04.668238 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8a76b-a460-481a-bd74-748bcd461b2e None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:04.682056 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14c1d9-9907-4e19-a6d4-7f9911d678c5 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:04.729065 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5c607-2711-4942-9dcf-b7a287e8ebd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:04.729768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5c607-2711-4942-9dcf-b7a287e8ebd0 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:04.730095 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5c607-2711-4942-9dcf-b7a287e8ebd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:04.730383 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5c607-2711-4942-9dcf-b7a287e8ebd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:04.732488 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb5c607-2711-4942-9dcf-b7a287e8ebd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:04.734277 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb5c607-2711-4942-9dcf-b7a287e8ebd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:04.735868 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb5c607-2711-4942-9dcf-b7a287e8ebd0 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:04.764385 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 17/34] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:04.766006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7585b-4197-499d-8059-14d3e186b6b0 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:04.766300 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7585b-4197-499d-8059-14d3e186b6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:04.766595 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7585b-4197-499d-8059-14d3e186b6b0 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:04.767868 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 18/35] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:04.769782 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7585b-4197-499d-8059-14d3e186b6b0 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:04.841793 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8a76b-a460-481a-bd74-748bcd461b2e None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:04.882183 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861b1d7-ff2d-4d8c-9dcd-e0737e1fc2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:04.882862 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861b1d7-ff2d-4d8c-9dcd-e0737e1fc2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:04.883151 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861b1d7-ff2d-4d8c-9dcd-e0737e1fc2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:04.883433 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861b1d7-ff2d-4d8c-9dcd-e0737e1fc2a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:04.884220 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861b1d7-ff2d-4d8c-9dcd-e0737e1fc2a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:04.884534 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861b1d7-ff2d-4d8c-9dcd-e0737e1fc2a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:04.885949 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861b1d7-ff2d-4d8c-9dcd-e0737e1fc2a3 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:04.894881 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:04.895408 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 18/36] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:04.898756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74daabd2-9a2f-4fb1-bb46-1568c905a3a7 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:04.899052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74daabd2-9a2f-4fb1-bb46-1568c905a3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:04.899339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74daabd2-9a2f-4fb1-bb46-1568c905a3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:04.905631 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7585b-4197-499d-8059-14d3e186b6b0 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:04.917384 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-74daabd2-9a2f-4fb1-bb46-1568c905a3a7 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:04.918607 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-74daabd2-9a2f-4fb1-bb46-1568c905a3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:04.944493 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebc608-d8d9-4de7-857b-74443684c7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:04.945175 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebc608-d8d9-4de7-857b-74443684c7aa None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:04.945458 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebc608-d8d9-4de7-857b-74443684c7aa None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:04.945737 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebc608-d8d9-4de7-857b-74443684c7aa None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:04.946739 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afebc608-d8d9-4de7-857b-74443684c7aa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:04.948207 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afebc608-d8d9-4de7-857b-74443684c7aa None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:04.948823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:04.978831 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 19/37] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jun 21 05:40:04 2022] POST /identity/v3/projects => generated 301 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:40:04.979934 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebc608-d8d9-4de7-857b-74443684c7aa None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:04.990560 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 19/38] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:04.992530 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af1bd3-0035-4115-9196-f3f5c2a0c73d None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:04.993089 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af1bd3-0035-4115-9196-f3f5c2a0c73d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:04.993512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af1bd3-0035-4115-9196-f3f5c2a0c73d None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:04.995134 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 20/39] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:05.002931 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a4c53-3142-47c2-8ad9-d6ae36a3624d None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:05.003522 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a4c53-3142-47c2-8ad9-d6ae36a3624d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:05.003988 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a4c53-3142-47c2-8ad9-d6ae36a3624d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:05.023404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-f91a4c53-3142-47c2-8ad9-d6ae36a3624d None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:05.024729 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f91a4c53-3142-47c2-8ad9-d6ae36a3624d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:05.107923 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 21/40] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:05.111122 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a4c53-3142-47c2-8ad9-d6ae36a3624d None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:05.123594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebc608-d8d9-4de7-857b-74443684c7aa None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:05.164460 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bc438-fc00-435c-8792-d21a97cc3c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:05.165450 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bc438-fc00-435c-8792-d21a97cc3c82 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:05.165867 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bc438-fc00-435c-8792-d21a97cc3c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:05.166974 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bc438-fc00-435c-8792-d21a97cc3c82 None admin] PATH_INFO: `/v3/users/79f991743edf4c82841603b9b9845e95` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:05.168460 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150bc438-fc00-435c-8792-d21a97cc3c82 None admin] RBAC: Authorizing `identity:get_user(user_id=79f991743edf4c82841603b9b9845e95)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:05.169956 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150bc438-fc00-435c-8792-d21a97cc3c82 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:05.171609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 20/41] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:04 2022] GET /identity/v3/users/79f991743edf4c82841603b9b9845e95 => generated 247 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:05.172457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bc438-fc00-435c-8792-d21a97cc3c82 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:05.192788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:05.222064 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:05.226341 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a4c53-3142-47c2-8ad9-d6ae36a3624d None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:05.264401 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a05de5-c65e-4db9-8700-64b3ebac0a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:05.265195 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a05de5-c65e-4db9-8700-64b3ebac0a1c None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:05.265480 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a05de5-c65e-4db9-8700-64b3ebac0a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:05.265764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a05de5-c65e-4db9-8700-64b3ebac0a1c None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:05.266550 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a05de5-c65e-4db9-8700-64b3ebac0a1c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:05.267958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a05de5-c65e-4db9-8700-64b3ebac0a1c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:05.285027 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bc438-fc00-435c-8792-d21a97cc3c82 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:05.285184 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 22/42] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Jun 21 05:40:05 2022] POST /identity/v3/roles => generated 223 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:40:05.285967 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a05de5-c65e-4db9-8700-64b3ebac0a1c None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:05.346963 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fff5b9-fc44-48e3-9c12-1851f49ff338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:05.348363 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fff5b9-fc44-48e3-9c12-1851f49ff338 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:05.349350 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fff5b9-fc44-48e3-9c12-1851f49ff338 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:05.349807 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fff5b9-fc44-48e3-9c12-1851f49ff338 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:05.351331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fff5b9-fc44-48e3-9c12-1851f49ff338 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:05.353244 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fff5b9-fc44-48e3-9c12-1851f49ff338 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:05.361004 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 21/43] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:40:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:05.361964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fff5b9-fc44-48e3-9c12-1851f49ff338 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:05.402321 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a05de5-c65e-4db9-8700-64b3ebac0a1c None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:05.439883 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4fffa-f6de-4633-841d-f44bc8ac9f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:05.441212 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4fffa-f6de-4633-841d-f44bc8ac9f3d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:05.441503 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4fffa-f6de-4633-841d-f44bc8ac9f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:05.441788 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4fffa-f6de-4633-841d-f44bc8ac9f3d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:05.443069 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4fffa-f6de-4633-841d-f44bc8ac9f3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:05.444607 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4fffa-f6de-4633-841d-f44bc8ac9f3d None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:05.446303 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 23/44] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:40:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:05.451855 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4fffa-f6de-4633-841d-f44bc8ac9f3d None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:05.468480 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:05.492330 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fff5b9-fc44-48e3-9c12-1851f49ff338 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:05.531628 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf724a2-8c8c-4a0e-b48f-d95dd9cf9d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:05.532315 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf724a2-8c8c-4a0e-b48f-d95dd9cf9d3f None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:05.532604 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf724a2-8c8c-4a0e-b48f-d95dd9cf9d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:05.532888 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf724a2-8c8c-4a0e-b48f-d95dd9cf9d3f None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:05.533627 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf724a2-8c8c-4a0e-b48f-d95dd9cf9d3f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:05.538010 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf724a2-8c8c-4a0e-b48f-d95dd9cf9d3f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:05.568532 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 22/45] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jun 21 05:40:05 2022] POST /identity/v3/projects => generated 312 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:40:05.596860 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:05.684442 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4fffa-f6de-4633-841d-f44bc8ac9f3d None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:05.722918 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0a34a-b4a3-42b9-bf9e-39cf2e0b1a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:05.723800 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0a34a-b4a3-42b9-bf9e-39cf2e0b1a06 None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:05.724091 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0a34a-b4a3-42b9-bf9e-39cf2e0b1a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:05.724373 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0a34a-b4a3-42b9-bf9e-39cf2e0b1a06 None admin] PATH_INFO: `/v3/domains/default/users/79f991743edf4c82841603b9b9845e95/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:05.726440 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0a34a-b4a3-42b9-bf9e-39cf2e0b1a06 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=79f991743edf4c82841603b9b9845e95, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:05.727894 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0a34a-b4a3-42b9-bf9e-39cf2e0b1a06 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:05.743351 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 24/46] 10.222.0.18 () {58 vars in 1361 bytes} [Tue Jun 21 05:40:05 2022] PUT /identity/v3/domains/default/users/79f991743edf4c82841603b9b9845e95/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 05:40:07.624361 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe40388-8831-40f9-842f-6731abd1f562 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:07.624884 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe40388-8831-40f9-842f-6731abd1f562 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:07.624984 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe40388-8831-40f9-842f-6731abd1f562 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:07.626337 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 23/47] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:07.631654 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa2d3f-4372-44c6-baa8-31c3d58d769a None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:07.632077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa2d3f-4372-44c6-baa8-31c3d58d769a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:07.632343 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa2d3f-4372-44c6-baa8-31c3d58d769a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:07.648913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-ccfa2d3f-4372-44c6-baa8-31c3d58d769a None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:07.650151 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ccfa2d3f-4372-44c6-baa8-31c3d58d769a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:07.715407 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 25/48] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:07.739489 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe40388-8831-40f9-842f-6731abd1f562 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:07.751672 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d39a88-c645-486c-8630-9c1b55e1a623 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:07.751986 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d39a88-c645-486c-8630-9c1b55e1a623 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:07.752416 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d39a88-c645-486c-8630-9c1b55e1a623 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:07.753665 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 26/49] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 05:40:07.759176 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ff0bd-30b3-4bf3-a190-513b14fb8aec None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:07.759466 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ff0bd-30b3-4bf3-a190-513b14fb8aec None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:07.759747 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ff0bd-30b3-4bf3-a190-513b14fb8aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:07.777905 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-189ff0bd-30b3-4bf3-a190-513b14fb8aec None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:07.779143 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-189ff0bd-30b3-4bf3-a190-513b14fb8aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:07.791209 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:07.857180 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 27/50] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 05:40:07.864467 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe40388-8831-40f9-842f-6731abd1f562 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:07.880698 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ff0bd-30b3-4bf3-a190-513b14fb8aec None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:07.900161 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e95fa-99f1-4848-a126-69d4afe3d62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:07.900959 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e95fa-99f1-4848-a126-69d4afe3d62f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:07.901248 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e95fa-99f1-4848-a126-69d4afe3d62f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:07.901530 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e95fa-99f1-4848-a126-69d4afe3d62f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:07.902767 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e95fa-99f1-4848-a126-69d4afe3d62f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:07.904199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e95fa-99f1-4848-a126-69d4afe3d62f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:07.905809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 24/51] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:40:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:07.911912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e95fa-99f1-4848-a126-69d4afe3d62f None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:07.915506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:07.998836 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ff0bd-30b3-4bf3-a190-513b14fb8aec None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:08.019730 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e95fa-99f1-4848-a126-69d4afe3d62f None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:08.037391 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7ff27-2354-4b92-ad2c-67b84ab94a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:08.038221 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7ff27-2354-4b92-ad2c-67b84ab94a50 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:08.038514 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7ff27-2354-4b92-ad2c-67b84ab94a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:08.038797 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7ff27-2354-4b92-ad2c-67b84ab94a50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:08.050290 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7ff27-2354-4b92-ad2c-67b84ab94a50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:08.054780 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44faca50-595a-4c62-ac0b-8ea193a2ff53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:08.055446 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faca50-595a-4c62-ac0b-8ea193a2ff53 None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:08.055737 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faca50-595a-4c62-ac0b-8ea193a2ff53 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:08.056022 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faca50-595a-4c62-ac0b-8ea193a2ff53 None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:08.056741 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44faca50-595a-4c62-ac0b-8ea193a2ff53 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:08.058067 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-cac7ff27-2354-4b92-ad2c-67b84ab94a50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:40:08.058067 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:08.058067 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:08.058067 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:08.058067 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:08.058067 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:08.058067 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:08.058067 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:08.058067 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:08.058067 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:08.058067 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:08.058067 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:08.058067 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:08.058067 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:08.058067 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:08.058067 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:08.058969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:08.058969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:08.058969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:08.058969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:08.058969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:08.058969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:08.058969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:08.058969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:08.058969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:08.058969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:08.058969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:08.058969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:08.058969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:08.058969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:08.058969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:08.058969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:08.059712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:08.059712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:08.059712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:08.059712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:08.059712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:08.059712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:08.059712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:08.059712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:08.059712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:08.059712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:08.059712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:40:08.059712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:40:08.060277 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44faca50-595a-4c62-ac0b-8ea193a2ff53 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:08.060341 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 28/52] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:40:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:40:08.065006 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7ff27-2354-4b92-ad2c-67b84ab94a50 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:08.074133 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:08.090814 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 25/53] 10.222.0.18 () {60 vars in 1140 bytes} [Tue Jun 21 05:40:07 2022] POST /identity/v3/projects => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 05:40:08.189012 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7ff27-2354-4b92-ad2c-67b84ab94a50 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:08.230296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11d9c8-02b0-40ee-8858-5f43ca1d2174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:08.230992 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11d9c8-02b0-40ee-8858-5f43ca1d2174 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:08.231282 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11d9c8-02b0-40ee-8858-5f43ca1d2174 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:08.231568 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11d9c8-02b0-40ee-8858-5f43ca1d2174 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:08.232618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11d9c8-02b0-40ee-8858-5f43ca1d2174 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:08.232933 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11d9c8-02b0-40ee-8858-5f43ca1d2174 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:08.234397 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11d9c8-02b0-40ee-8858-5f43ca1d2174 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:08.243599 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 29/54] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:40:08.250344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44faca50-595a-4c62-ac0b-8ea193a2ff53 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:08.317998 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:08.366267 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44faca50-595a-4c62-ac0b-8ea193a2ff53 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:08.401759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3e718-4735-47fd-a67c-96b588371efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:08.402670 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3e718-4735-47fd-a67c-96b588371efc None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:08.402959 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3e718-4735-47fd-a67c-96b588371efc None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:08.403240 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3e718-4735-47fd-a67c-96b588371efc None admin] PATH_INFO: `/v3/users/79f991743edf4c82841603b9b9845e95` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:08.404473 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3e718-4735-47fd-a67c-96b588371efc None admin] RBAC: Authorizing `identity:get_user(user_id=79f991743edf4c82841603b9b9845e95)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:08.405942 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3e718-4735-47fd-a67c-96b588371efc None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:08.407612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 26/55] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:08 2022] GET /identity/v3/users/79f991743edf4c82841603b9b9845e95 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:08.413064 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11d9c8-02b0-40ee-8858-5f43ca1d2174 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:08.487999 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:08.527552 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11d9c8-02b0-40ee-8858-5f43ca1d2174 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:08.566046 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae93c7-4a3c-415d-92c7-762c8d89a528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:08.566857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae93c7-4a3c-415d-92c7-762c8d89a528 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:08.567150 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae93c7-4a3c-415d-92c7-762c8d89a528 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:08.567433 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae93c7-4a3c-415d-92c7-762c8d89a528 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:08.568630 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae93c7-4a3c-415d-92c7-762c8d89a528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:08.570130 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae93c7-4a3c-415d-92c7-762c8d89a528 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:08.572686 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 30/56] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:40:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:40:08.578268 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3e718-4735-47fd-a67c-96b588371efc None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:08.704655 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3e718-4735-47fd-a67c-96b588371efc None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:08.728098 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:08.740002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b688b-d92e-4d1b-9550-473a3c1eae7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:08.740590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b688b-d92e-4d1b-9550-473a3c1eae7e None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:08.740876 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b688b-d92e-4d1b-9550-473a3c1eae7e None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:08.741158 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b688b-d92e-4d1b-9550-473a3c1eae7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:08.742028 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b688b-d92e-4d1b-9550-473a3c1eae7e None admin] RBAC: Adding query filter params (role.id=24aa6040c86049f996560e477e83886f, scope.domain.id=default, user.id=79f991743edf4c82841603b9b9845e95) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:08.742346 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b688b-d92e-4d1b-9550-473a3c1eae7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:08.743798 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b688b-d92e-4d1b-9550-473a3c1eae7e None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:08.753964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 27/57] 10.222.0.18 () {56 vars in 1322 bytes} [Tue Jun 21 05:40:08 2022] GET /identity/v3/role_assignments?user.id=79f991743edf4c82841603b9b9845e95&scope.domain.id=default&role.id=24aa6040c86049f996560e477e83886f => generated 530 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:10.190488 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6966dc-b7f8-4557-88df-6acebdd37f6e None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:10.191164 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6966dc-b7f8-4557-88df-6acebdd37f6e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:10.191464 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6966dc-b7f8-4557-88df-6acebdd37f6e None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:10.193056 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 31/58] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:10.198961 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae648e2a-f1e2-4ab4-9d9a-43cbca8f0834 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:10.199374 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae648e2a-f1e2-4ab4-9d9a-43cbca8f0834 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:10.199521 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae648e2a-f1e2-4ab4-9d9a-43cbca8f0834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:10.217109 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-ae648e2a-f1e2-4ab4-9d9a-43cbca8f0834 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:10.218628 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ae648e2a-f1e2-4ab4-9d9a-43cbca8f0834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:10.399817 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 28/59] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:10.427241 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6966dc-b7f8-4557-88df-6acebdd37f6e None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:10.526203 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6966dc-b7f8-4557-88df-6acebdd37f6e None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:10.561800 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bf194-e69d-480a-9380-6f3d15f0c0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:10.562617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bf194-e69d-480a-9380-6f3d15f0c0bd None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:10.562902 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bf194-e69d-480a-9380-6f3d15f0c0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:10.563180 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bf194-e69d-480a-9380-6f3d15f0c0bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:10.564347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bf194-e69d-480a-9380-6f3d15f0c0bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:10.565802 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bf194-e69d-480a-9380-6f3d15f0c0bd None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:10.567449 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 32/60] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:40:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:10.573091 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae648e2a-f1e2-4ab4-9d9a-43cbca8f0834 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:10.672383 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae648e2a-f1e2-4ab4-9d9a-43cbca8f0834 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:10.689679 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:10.707266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df950d0-111d-4b95-80cc-3fece4f39215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:10.707944 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df950d0-111d-4b95-80cc-3fece4f39215 None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:10.708232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df950d0-111d-4b95-80cc-3fece4f39215 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:10.708514 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df950d0-111d-4b95-80cc-3fece4f39215 None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:10.709224 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df950d0-111d-4b95-80cc-3fece4f39215 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:10.710709 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df950d0-111d-4b95-80cc-3fece4f39215 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:10.735525 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 29/61] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 21 05:40:10 2022] POST /identity/v3/users => generated 275 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:40:13.959269 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417921b9-7866-4e1c-8fe1-0c2efdbab81a None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:13.959994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417921b9-7866-4e1c-8fe1-0c2efdbab81a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:13.959994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417921b9-7866-4e1c-8fe1-0c2efdbab81a None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:13.961206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 33/62] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:13.966779 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0593f-5764-4425-a1b8-530215ab69fb None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:13.967381 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0593f-5764-4425-a1b8-530215ab69fb None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:13.967381 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0593f-5764-4425-a1b8-530215ab69fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:14.001362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-ebc0593f-5764-4425-a1b8-530215ab69fb None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:14.002828 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ebc0593f-5764-4425-a1b8-530215ab69fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:14.063584 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d4fbd-25f5-47be-9129-d7bb77c4af93 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:14.063850 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d4fbd-25f5-47be-9129-d7bb77c4af93 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:14.064157 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d4fbd-25f5-47be-9129-d7bb77c4af93 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:14.065776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 34/63] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 05:40:14.070924 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976d8f0-4abb-4ed2-b98f-61878d7aab8d None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:14.071211 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976d8f0-4abb-4ed2-b98f-61878d7aab8d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:14.071497 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976d8f0-4abb-4ed2-b98f-61878d7aab8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:14.078850 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:14.099049 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-8976d8f0-4abb-4ed2-b98f-61878d7aab8d None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:14.100271 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8976d8f0-4abb-4ed2-b98f-61878d7aab8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:14.125679 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 30/64] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:14.149503 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0593f-5764-4425-a1b8-530215ab69fb None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:14.249342 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 35/65] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 05:40:14.317398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0593f-5764-4425-a1b8-530215ab69fb None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:14.320061 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:14.332495 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976d8f0-4abb-4ed2-b98f-61878d7aab8d None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:14.388784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4aa3a1-06db-4530-b6ca-022b1ec5b7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:14.390454 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4aa3a1-06db-4530-b6ca-022b1ec5b7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:14.391134 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4aa3a1-06db-4530-b6ca-022b1ec5b7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:14.393601 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4aa3a1-06db-4530-b6ca-022b1ec5b7c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:14.416218 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4aa3a1-06db-4530-b6ca-022b1ec5b7c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:14.427828 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-1e4aa3a1-06db-4530-b6ca-022b1ec5b7c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 05:40:14.427828 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:14.427828 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:14.427828 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:14.427828 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:14.427828 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:14.427828 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:14.427828 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:14.427828 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:14.427828 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:14.427828 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:14.427828 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:14.427828 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:14.427828 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:14.427828 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:14.427828 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:14.428896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:14.428896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:14.428896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:14.428896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:14.428896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:14.428896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:14.428896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:14.428896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:14.428896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:14.428896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:14.428896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:14.428896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:14.428896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:14.428896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:14.428896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:14.428896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:14.429836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:14.429836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:14.429836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:14.429836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:14.429836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:14.429836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:14.429836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:14.429836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:14.429836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:14.429836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:14.429836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 05:40:14.429836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:40:14.440851 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 31/66] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 21 05:40:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:40:14.447531 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3a6e4-a5e7-49b6-bda1-ca7796bee6e3 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:14.447825 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3a6e4-a5e7-49b6-bda1-ca7796bee6e3 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:14.448110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3a6e4-a5e7-49b6-bda1-ca7796bee6e3 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:14.449637 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 32/67] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:14.450242 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3a6e4-a5e7-49b6-bda1-ca7796bee6e3 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:14.494669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976d8f0-4abb-4ed2-b98f-61878d7aab8d None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:14.530137 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd6bef-0fa8-4c25-af43-b636a78fb00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:14.530853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd6bef-0fa8-4c25-af43-b636a78fb00a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:14.531141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd6bef-0fa8-4c25-af43-b636a78fb00a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:14.531423 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd6bef-0fa8-4c25-af43-b636a78fb00a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:14.533753 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:14.545059 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd6bef-0fa8-4c25-af43-b636a78fb00a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:14.552832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-44cd6bef-0fa8-4c25-af43-b636a78fb00a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:40:14.552832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:14.552832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:14.552832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:14.552832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:14.552832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:14.552832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:14.552832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:14.552832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:14.552832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:14.552832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:14.552832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:14.552832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:14.552832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:14.552832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:14.552832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:14.553872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:14.553872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:14.553872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:14.553872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:14.553872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:14.553872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:14.553872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:14.553872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:14.553872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:14.553872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:14.553872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:14.553872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:14.553872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:14.553872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:14.553872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:14.553872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:14.559537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:14.559537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:14.559537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:14.559537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:14.559537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:14.559537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:14.559537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:14.559537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:14.559537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:14.559537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:14.559537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:40:14.559537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:40:14.559537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 36/68] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:40:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:14.559537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5598d-4680-41f5-a78a-93d596afea04 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:14.560216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5598d-4680-41f5-a78a-93d596afea04 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:14.560216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5598d-4680-41f5-a78a-93d596afea04 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:14.560216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 37/69] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:14.560216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076f149-1b0e-4e58-beb6-f9d6223f364e None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:14.560216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076f149-1b0e-4e58-beb6-f9d6223f364e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:14.560216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076f149-1b0e-4e58-beb6-f9d6223f364e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:14.568743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3a6e4-a5e7-49b6-bda1-ca7796bee6e3 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:14.583704 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-7076f149-1b0e-4e58-beb6-f9d6223f364e None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:14.584902 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-7076f149-1b0e-4e58-beb6-f9d6223f364e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:14.604666 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd038759-cc6d-4ce8-b1f2-0024b0226f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:14.605337 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd038759-cc6d-4ce8-b1f2-0024b0226f64 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:14.605629 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd038759-cc6d-4ce8-b1f2-0024b0226f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:14.605910 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd038759-cc6d-4ce8-b1f2-0024b0226f64 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:14.607121 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd038759-cc6d-4ce8-b1f2-0024b0226f64 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:14.607522 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd038759-cc6d-4ce8-b1f2-0024b0226f64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:14.608948 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd038759-cc6d-4ce8-b1f2-0024b0226f64 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:14.621825 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 33/70] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:40:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:14.622697 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd038759-cc6d-4ce8-b1f2-0024b0226f64 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:14.650723 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:14.657336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 38/71] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:14.658676 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14315e57-4c0f-45e2-8ae6-6ced7cb40899 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:14.659508 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14315e57-4c0f-45e2-8ae6-6ced7cb40899 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:14.659791 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14315e57-4c0f-45e2-8ae6-6ced7cb40899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:14.676119 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-14315e57-4c0f-45e2-8ae6-6ced7cb40899 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:14.677324 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-14315e57-4c0f-45e2-8ae6-6ced7cb40899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:14.729442 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd038759-cc6d-4ce8-b1f2-0024b0226f64 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:14.751454 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 39/72] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:14.752885 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef7c5a-db4d-4134-92c5-04ef739110e4 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:14.753179 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef7c5a-db4d-4134-92c5-04ef739110e4 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:14.753634 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef7c5a-db4d-4134-92c5-04ef739110e4 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:14.759006 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 40/73] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:14.759006 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef7c5a-db4d-4134-92c5-04ef739110e4 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:14.769530 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f22ebb-f4ee-44c2-b7c2-09e76b4e64a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:14.770252 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f22ebb-f4ee-44c2-b7c2-09e76b4e64a5 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:14.770545 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f22ebb-f4ee-44c2-b7c2-09e76b4e64a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:14.770832 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f22ebb-f4ee-44c2-b7c2-09e76b4e64a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:14.771973 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f22ebb-f4ee-44c2-b7c2-09e76b4e64a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:14.772301 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f22ebb-f4ee-44c2-b7c2-09e76b4e64a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:14.774146 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f22ebb-f4ee-44c2-b7c2-09e76b4e64a5 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:14.782810 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 34/74] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:14.783663 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f22ebb-f4ee-44c2-b7c2-09e76b4e64a5 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:14.819813 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:14.879800 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:14.886767 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef7c5a-db4d-4134-92c5-04ef739110e4 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:14.893861 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f22ebb-f4ee-44c2-b7c2-09e76b4e64a5 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:14.926523 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9269de0-95d5-403e-b259-10ac2bc32440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:14.927401 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9269de0-95d5-403e-b259-10ac2bc32440 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:14.927688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9269de0-95d5-403e-b259-10ac2bc32440 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:14.927967 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9269de0-95d5-403e-b259-10ac2bc32440 None admin] PATH_INFO: `/v3/users/ff7d725fbdd346cbad2f26c6701d1cc5` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:14.928782 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b97eba-395a-4b3d-8c8d-69e1b453a0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:14.929608 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b97eba-395a-4b3d-8c8d-69e1b453a0db None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:14.930032 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b97eba-395a-4b3d-8c8d-69e1b453a0db None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:14.930318 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b97eba-395a-4b3d-8c8d-69e1b453a0db None admin] PATH_INFO: `/v3/roles/member` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:14.941193 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b97eba-395a-4b3d-8c8d-69e1b453a0db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:14.941467 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9269de0-95d5-403e-b259-10ac2bc32440 None admin] RBAC: Authorizing `identity:get_user(user_id=ff7d725fbdd346cbad2f26c6701d1cc5)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:14.943003 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9269de0-95d5-403e-b259-10ac2bc32440 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:14.944691 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 41/75] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:14 2022] GET /identity/v3/users/ff7d725fbdd346cbad2f26c6701d1cc5 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:14.946088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82655e3b-7cfa-48fe-9f23-418ec319a256 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:14.946385 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82655e3b-7cfa-48fe-9f23-418ec319a256 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:14.946665 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82655e3b-7cfa-48fe-9f23-418ec319a256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:14.953405 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-67b97eba-395a-4b3d-8c8d-69e1b453a0db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:14.953405 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:14.953405 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:14.953405 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:14.953405 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:14.953405 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:14.953405 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:14.953405 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:14.953405 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:14.953405 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:14.953405 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:14.953405 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:14.953405 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:14.953405 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:14.953405 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:14.953405 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:14.954398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:14.954398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:14.954398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:14.954398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:14.954398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:14.954398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:14.954398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:14.954398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:14.954398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:14.954398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:14.954398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:14.954398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:14.954398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:14.954398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:14.954398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:14.954398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:14.955147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:14.955147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:14.955147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:14.955147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:14.955147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:14.955147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:14.955147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:14.955147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:14.955147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:14.955147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:14.955147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:14.955147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:40:14.955147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 35/76] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:14.956372 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b97eba-395a-4b3d-8c8d-69e1b453a0db None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:14.963258 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-82655e3b-7cfa-48fe-9f23-418ec319a256 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:14.964469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-82655e3b-7cfa-48fe-9f23-418ec319a256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:15.042145 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 42/77] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:15.042145 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82655e3b-7cfa-48fe-9f23-418ec319a256 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:15.063888 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b97eba-395a-4b3d-8c8d-69e1b453a0db None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:15.084141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:15.101228 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdc9f1-8b56-4547-a0d6-179135573b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:15.102058 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdc9f1-8b56-4547-a0d6-179135573b0f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:15.102347 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdc9f1-8b56-4547-a0d6-179135573b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:15.102630 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdc9f1-8b56-4547-a0d6-179135573b0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:15.113527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdc9f1-8b56-4547-a0d6-179135573b0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:15.121290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-b3cdc9f1-8b56-4547-a0d6-179135573b0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:15.121290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:15.121290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:15.121290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:15.121290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:15.121290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:15.121290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:15.121290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:15.121290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:15.121290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:15.121290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:15.121290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:15.121290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:15.121290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:15.121290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:15.121290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:15.122245 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:15.122245 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:15.122245 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:15.122245 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:15.122245 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:15.122245 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:15.122245 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:15.122245 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:15.122245 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:15.122245 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:15.122245 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:15.122245 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:15.122245 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:15.122245 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:15.122245 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:15.122245 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:15.123002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:15.123002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:15.123002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:15.123002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:15.123002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:15.123002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:15.123002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:15.123002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:15.123002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:15.123002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:15.123002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:15.123002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:40:15.123002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 36/78] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:15.123635 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdc9f1-8b56-4547-a0d6-179135573b0f None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:15.138536 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:15.149505 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82655e3b-7cfa-48fe-9f23-418ec319a256 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:15.188545 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b5e6a-3389-4c9a-88f7-bd6dc1513ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:15.189418 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b5e6a-3389-4c9a-88f7-bd6dc1513ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:15.189709 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b5e6a-3389-4c9a-88f7-bd6dc1513ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:15.190532 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b5e6a-3389-4c9a-88f7-bd6dc1513ac1 None admin] PATH_INFO: `/v3/users/79f991743edf4c82841603b9b9845e95` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:15.191738 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b5e6a-3389-4c9a-88f7-bd6dc1513ac1 None admin] RBAC: Authorizing `identity:get_user(user_id=79f991743edf4c82841603b9b9845e95)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:15.193212 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b5e6a-3389-4c9a-88f7-bd6dc1513ac1 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:15.194882 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 43/79] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:15 2022] GET /identity/v3/users/79f991743edf4c82841603b9b9845e95 => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:15.199389 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b5e6a-3389-4c9a-88f7-bd6dc1513ac1 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:15.235284 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdc9f1-8b56-4547-a0d6-179135573b0f None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:15.272345 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86c53b-30c1-4507-b885-c90b98ee5ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:15.273007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86c53b-30c1-4507-b885-c90b98ee5ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:15.273307 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86c53b-30c1-4507-b885-c90b98ee5ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:15.273590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86c53b-30c1-4507-b885-c90b98ee5ac2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:15.313511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b5e6a-3389-4c9a-88f7-bd6dc1513ac1 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:15.324562 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:15.342846 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86c53b-30c1-4507-b885-c90b98ee5ac2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:15.344320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86c53b-30c1-4507-b885-c90b98ee5ac2 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:15.348533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4b491-bb7c-4d1b-a62b-90a0709706f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:15.349203 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4b491-bb7c-4d1b-a62b-90a0709706f9 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:15.349491 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4b491-bb7c-4d1b-a62b-90a0709706f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:15.349770 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4b491-bb7c-4d1b-a62b-90a0709706f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:15.350547 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4b491-bb7c-4d1b-a62b-90a0709706f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:15.350861 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4b491-bb7c-4d1b-a62b-90a0709706f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:15.352228 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4b491-bb7c-4d1b-a62b-90a0709706f9 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:15.353942 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:15.360772 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 44/80] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 21 05:40:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:15.361564 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4b491-bb7c-4d1b-a62b-90a0709706f9 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:15.454791 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 37/81] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:40:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:40:15.455896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86c53b-30c1-4507-b885-c90b98ee5ac2 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:15.464332 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4b491-bb7c-4d1b-a62b-90a0709706f9 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:15.498662 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bdede-62bd-42d8-845a-bb30ee0af39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:15.499472 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bdede-62bd-42d8-845a-bb30ee0af39c None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:15.499759 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bdede-62bd-42d8-845a-bb30ee0af39c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:15.500043 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bdede-62bd-42d8-845a-bb30ee0af39c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:15.501223 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8bdede-62bd-42d8-845a-bb30ee0af39c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:15.503320 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8bdede-62bd-42d8-845a-bb30ee0af39c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:15.504949 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 45/82] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:40:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:15.505716 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bdede-62bd-42d8-845a-bb30ee0af39c None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:15.551421 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:15.565525 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86c53b-30c1-4507-b885-c90b98ee5ac2 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:15.576901 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:15.612352 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e134e8-00d2-41bd-a0a7-3b7a3178f659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:15.613034 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e134e8-00d2-41bd-a0a7-3b7a3178f659 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:15.613326 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e134e8-00d2-41bd-a0a7-3b7a3178f659 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:15.613609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e134e8-00d2-41bd-a0a7-3b7a3178f659 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:15.613757 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bdede-62bd-42d8-845a-bb30ee0af39c None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:15.614395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e134e8-00d2-41bd-a0a7-3b7a3178f659 None admin] RBAC: Adding query filter params (name=member) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:15.614710 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e134e8-00d2-41bd-a0a7-3b7a3178f659 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:15.616108 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e134e8-00d2-41bd-a0a7-3b7a3178f659 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:15.624622 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 38/83] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 21 05:40:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:15.625443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e134e8-00d2-41bd-a0a7-3b7a3178f659 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:15.649544 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af385b-32ea-4ce8-95f0-0326467ee86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:15.650236 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af385b-32ea-4ce8-95f0-0326467ee86a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:15.650518 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af385b-32ea-4ce8-95f0-0326467ee86a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:15.650797 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af385b-32ea-4ce8-95f0-0326467ee86a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:15.718940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af385b-32ea-4ce8-95f0-0326467ee86a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:15.720419 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af385b-32ea-4ce8-95f0-0326467ee86a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:15.724699 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e134e8-00d2-41bd-a0a7-3b7a3178f659 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:15.757698 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a64a4-cf36-42ab-ae0a-7bfff050463f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:15.758599 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a64a4-cf36-42ab-ae0a-7bfff050463f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:15.758888 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a64a4-cf36-42ab-ae0a-7bfff050463f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:15.759171 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a64a4-cf36-42ab-ae0a-7bfff050463f None admin] PATH_INFO: `/v3/users/ff7d725fbdd346cbad2f26c6701d1cc5` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:15.760387 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a64a4-cf36-42ab-ae0a-7bfff050463f None admin] RBAC: Authorizing `identity:get_user(user_id=ff7d725fbdd346cbad2f26c6701d1cc5)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:15.761677 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:15.761845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a64a4-cf36-42ab-ae0a-7bfff050463f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:15.763512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 39/84] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:15 2022] GET /identity/v3/users/ff7d725fbdd346cbad2f26c6701d1cc5 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:15.764262 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a64a4-cf36-42ab-ae0a-7bfff050463f None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:15.810593 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:15.826256 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 46/85] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:40:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:40:15.827009 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af385b-32ea-4ce8-95f0-0326467ee86a None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:15.877718 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a64a4-cf36-42ab-ae0a-7bfff050463f None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:15.911326 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ddfcc-deac-4274-a08d-8af76c5576f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:15.912199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ddfcc-deac-4274-a08d-8af76c5576f7 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:15.912501 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ddfcc-deac-4274-a08d-8af76c5576f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:15.912790 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ddfcc-deac-4274-a08d-8af76c5576f7 None admin] PATH_INFO: `/v3/projects/f8f1415161a745f387f7c6563159c122` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:15.914057 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ddfcc-deac-4274-a08d-8af76c5576f7 None admin] RBAC: Authorizing `identity:get_project(project_id=f8f1415161a745f387f7c6563159c122)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:15.915524 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ddfcc-deac-4274-a08d-8af76c5576f7 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:15.917247 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 40/86] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:15 2022] GET /identity/v3/projects/f8f1415161a745f387f7c6563159c122 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:15.918074 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ddfcc-deac-4274-a08d-8af76c5576f7 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:15.932568 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af385b-32ea-4ce8-95f0-0326467ee86a None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:15.967842 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9eb09-42e9-4292-a9a1-c7454f65688a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:15.968556 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9eb09-42e9-4292-a9a1-c7454f65688a None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:15.968841 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9eb09-42e9-4292-a9a1-c7454f65688a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:15.969117 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9eb09-42e9-4292-a9a1-c7454f65688a None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:15.969842 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9eb09-42e9-4292-a9a1-c7454f65688a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:15.971911 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9eb09-42e9-4292-a9a1-c7454f65688a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:15.988960 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:16.005222 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 47/87] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 21 05:40:15 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:40:16.006748 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9eb09-42e9-4292-a9a1-c7454f65688a None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:16.051960 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ddfcc-deac-4274-a08d-8af76c5576f7 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:16.064024 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:16.099672 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2dbc8-9658-41b2-affb-35624a038ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:16.100507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2dbc8-9658-41b2-affb-35624a038ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:16.100794 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2dbc8-9658-41b2-affb-35624a038ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:16.101077 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2dbc8-9658-41b2-affb-35624a038ca7 None admin] PATH_INFO: `/v3/users/ff7d725fbdd346cbad2f26c6701d1cc5` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:16.102429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2dbc8-9658-41b2-affb-35624a038ca7 None admin] RBAC: Authorizing `identity:get_user(user_id=ff7d725fbdd346cbad2f26c6701d1cc5)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:16.103933 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2dbc8-9658-41b2-affb-35624a038ca7 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:16.105673 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 41/88] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:15 2022] GET /identity/v3/users/ff7d725fbdd346cbad2f26c6701d1cc5 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:16.106506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2dbc8-9658-41b2-affb-35624a038ca7 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:16.161733 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9eb09-42e9-4292-a9a1-c7454f65688a None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:16.206303 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e5474-aea8-4ccf-918a-f332368002fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:16.206970 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e5474-aea8-4ccf-918a-f332368002fc None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:16.207259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e5474-aea8-4ccf-918a-f332368002fc None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:16.207538 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e5474-aea8-4ccf-918a-f332368002fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:16.241877 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2dbc8-9658-41b2-affb-35624a038ca7 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:16.296204 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768dc2c-6673-4417-8d78-739645cfd16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:16.297140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768dc2c-6673-4417-8d78-739645cfd16f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:16.297454 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768dc2c-6673-4417-8d78-739645cfd16f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:16.297860 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768dc2c-6673-4417-8d78-739645cfd16f None admin] PATH_INFO: `/v3/projects/f8f1415161a745f387f7c6563159c122` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:16.299203 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768dc2c-6673-4417-8d78-739645cfd16f None admin] RBAC: Authorizing `identity:get_project(project_id=f8f1415161a745f387f7c6563159c122)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:16.300865 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768dc2c-6673-4417-8d78-739645cfd16f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:16.302728 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 42/89] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:16 2022] GET /identity/v3/projects/f8f1415161a745f387f7c6563159c122 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:16.303650 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768dc2c-6673-4417-8d78-739645cfd16f None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:16.305757 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:16.315485 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e5474-aea8-4ccf-918a-f332368002fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:16.317000 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e5474-aea8-4ccf-918a-f332368002fc None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:16.366005 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:16.433640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768dc2c-6673-4417-8d78-739645cfd16f None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:16.436860 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 48/90] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:40:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:40:16.437730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e5474-aea8-4ccf-918a-f332368002fc None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:16.473352 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8032e19-ff9f-4780-bbe2-0481065ba16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:16.474902 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8032e19-ff9f-4780-bbe2-0481065ba16b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:16.475639 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8032e19-ff9f-4780-bbe2-0481065ba16b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:16.476304 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8032e19-ff9f-4780-bbe2-0481065ba16b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:16.477797 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8032e19-ff9f-4780-bbe2-0481065ba16b None admin] RBAC: Adding query filter params (role.id=ad23f352111e42de99e9d92fbfe2e1f4, scope.project.id=f8f1415161a745f387f7c6563159c122, user.id=ff7d725fbdd346cbad2f26c6701d1cc5) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:16.478552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8032e19-ff9f-4780-bbe2-0481065ba16b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:16.480337 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8032e19-ff9f-4780-bbe2-0481065ba16b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:16.488785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 43/91] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:40:16 2022] GET /identity/v3/role_assignments?user.id=ff7d725fbdd346cbad2f26c6701d1cc5&scope.project.id=f8f1415161a745f387f7c6563159c122&role.id=ad23f352111e42de99e9d92fbfe2e1f4 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:16.489923 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8032e19-ff9f-4780-bbe2-0481065ba16b None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:16.567715 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:16.577774 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e5474-aea8-4ccf-918a-f332368002fc None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:16.630419 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8032e19-ff9f-4780-bbe2-0481065ba16b None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:16.632153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66071d-aa41-48cf-8b5c-62de3cdaf730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:16.633996 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66071d-aa41-48cf-8b5c-62de3cdaf730 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:16.634464 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66071d-aa41-48cf-8b5c-62de3cdaf730 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:16.634889 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66071d-aa41-48cf-8b5c-62de3cdaf730 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:16.638789 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:16.671810 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0676f9-d4f2-4869-b661-82001956c60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:16.672492 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0676f9-d4f2-4869-b661-82001956c60c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:16.672784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0676f9-d4f2-4869-b661-82001956c60c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:16.673069 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0676f9-d4f2-4869-b661-82001956c60c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:16.674069 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0676f9-d4f2-4869-b661-82001956c60c None admin] RBAC: Adding query filter params (role.id=24aa6040c86049f996560e477e83886f, scope.project.id=f8f1415161a745f387f7c6563159c122, user.id=79f991743edf4c82841603b9b9845e95) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:16.674981 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0676f9-d4f2-4869-b661-82001956c60c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:16.676586 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0676f9-d4f2-4869-b661-82001956c60c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:16.683487 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 44/92] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:40:16 2022] GET /identity/v3/role_assignments?user.id=79f991743edf4c82841603b9b9845e95&scope.project.id=f8f1415161a745f387f7c6563159c122&role.id=24aa6040c86049f996560e477e83886f => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:16.684308 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0676f9-d4f2-4869-b661-82001956c60c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:16.755532 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66071d-aa41-48cf-8b5c-62de3cdaf730 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:16.758861 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66071d-aa41-48cf-8b5c-62de3cdaf730 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:16.820939 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0676f9-d4f2-4869-b661-82001956c60c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:16.871904 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11915c-d2a2-48d9-b0d3-493aeba86f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:16.873015 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11915c-d2a2-48d9-b0d3-493aeba86f00 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:16.874048 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11915c-d2a2-48d9-b0d3-493aeba86f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:16.874558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11915c-d2a2-48d9-b0d3-493aeba86f00 None admin] PATH_INFO: `/v3/projects/f8f1415161a745f387f7c6563159c122` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:16.876282 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11915c-d2a2-48d9-b0d3-493aeba86f00 None admin] RBAC: Authorizing `identity:get_project(project_id=f8f1415161a745f387f7c6563159c122)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:16.878925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11915c-d2a2-48d9-b0d3-493aeba86f00 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:16.881156 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:16.882751 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 45/93] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:16 2022] GET /identity/v3/projects/f8f1415161a745f387f7c6563159c122 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:16.888817 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11915c-d2a2-48d9-b0d3-493aeba86f00 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:16.890844 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 49/94] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:40:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:40:16.897607 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66071d-aa41-48cf-8b5c-62de3cdaf730 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:16.958343 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:17.008979 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66071d-aa41-48cf-8b5c-62de3cdaf730 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:17.031473 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11915c-d2a2-48d9-b0d3-493aeba86f00 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:17.047329 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cad812-fac5-431f-a257-dee73e3b5955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:17.048206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cad812-fac5-431f-a257-dee73e3b5955 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:17.048495 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cad812-fac5-431f-a257-dee73e3b5955 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:17.048777 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cad812-fac5-431f-a257-dee73e3b5955 None admin] PATH_INFO: `/v3/projects/dcbbb8ba61db478b9e73e0c6d021ddfe` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:17.050134 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cad812-fac5-431f-a257-dee73e3b5955 None admin] RBAC: Authorizing `identity:get_project(project_id=dcbbb8ba61db478b9e73e0c6d021ddfe)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:17.052334 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cad812-fac5-431f-a257-dee73e3b5955 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:17.053576 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 50/95] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:16 2022] GET /identity/v3/projects/dcbbb8ba61db478b9e73e0c6d021ddfe => generated 312 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:17.059618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cad812-fac5-431f-a257-dee73e3b5955 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:17.073836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f88c5c-8345-4f13-8885-2b5410f1cf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:17.075208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f88c5c-8345-4f13-8885-2b5410f1cf56 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:17.075635 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f88c5c-8345-4f13-8885-2b5410f1cf56 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:17.076078 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f88c5c-8345-4f13-8885-2b5410f1cf56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:17.077069 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f88c5c-8345-4f13-8885-2b5410f1cf56 None admin] RBAC: Adding query filter params (role.id=a9602a7e01694084a0f9713d9d6394b1, scope.project.id=f8f1415161a745f387f7c6563159c122, user.id=ff7d725fbdd346cbad2f26c6701d1cc5) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:17.077526 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f88c5c-8345-4f13-8885-2b5410f1cf56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:17.079383 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f88c5c-8345-4f13-8885-2b5410f1cf56 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:17.086365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 46/96] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:40:16 2022] GET /identity/v3/role_assignments?user.id=ff7d725fbdd346cbad2f26c6701d1cc5&scope.project.id=f8f1415161a745f387f7c6563159c122&role.id=a9602a7e01694084a0f9713d9d6394b1 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:40:17.140080 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:17.186014 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cad812-fac5-431f-a257-dee73e3b5955 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:17.225610 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a558975-d9ac-43ee-87fa-3dd918d7237d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:17.226325 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a558975-d9ac-43ee-87fa-3dd918d7237d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:17.226612 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a558975-d9ac-43ee-87fa-3dd918d7237d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:17.226893 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a558975-d9ac-43ee-87fa-3dd918d7237d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:17.227758 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a558975-d9ac-43ee-87fa-3dd918d7237d None admin] RBAC: Adding query filter params (role.id=a9602a7e01694084a0f9713d9d6394b1, scope.project.id=dcbbb8ba61db478b9e73e0c6d021ddfe, user.id=ff7d725fbdd346cbad2f26c6701d1cc5) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:17.228077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a558975-d9ac-43ee-87fa-3dd918d7237d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:17.229590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a558975-d9ac-43ee-87fa-3dd918d7237d None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:17.236420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 51/97] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:40:17 2022] GET /identity/v3/role_assignments?user.id=ff7d725fbdd346cbad2f26c6701d1cc5&scope.project.id=dcbbb8ba61db478b9e73e0c6d021ddfe&role.id=a9602a7e01694084a0f9713d9d6394b1 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:40:19.006053 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fdaaa-8f5d-46b3-8601-b539cc085b3a None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:19.007184 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fdaaa-8f5d-46b3-8601-b539cc085b3a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:19.007700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fdaaa-8f5d-46b3-8601-b539cc085b3a None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:19.009423 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 47/98] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:19.014948 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ad58c-ce4c-4578-9946-406aa71f60aa None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:19.015831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ad58c-ce4c-4578-9946-406aa71f60aa None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:19.016299 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ad58c-ce4c-4578-9946-406aa71f60aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:19.038279 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-f09ad58c-ce4c-4578-9946-406aa71f60aa None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:19.039506 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f09ad58c-ce4c-4578-9946-406aa71f60aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:19.156496 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 52/99] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:19.172051 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b73756-06c9-444d-b38d-5210636ed3b9 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:19.172673 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b73756-06c9-444d-b38d-5210636ed3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:19.173169 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b73756-06c9-444d-b38d-5210636ed3b9 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:19.175129 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 48/100] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:19.181608 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b435e3d-884c-4047-bdc1-cfdc9498b10c None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:19.181903 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b435e3d-884c-4047-bdc1-cfdc9498b10c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:19.182216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b435e3d-884c-4047-bdc1-cfdc9498b10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:19.198324 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b73756-06c9-444d-b38d-5210636ed3b9 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:19.206337 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-3b435e3d-884c-4047-bdc1-cfdc9498b10c None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:19.207533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3b435e3d-884c-4047-bdc1-cfdc9498b10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:19.291087 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:19.321635 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 53/101] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:19.362446 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b435e3d-884c-4047-bdc1-cfdc9498b10c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:19.424227 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b73756-06c9-444d-b38d-5210636ed3b9 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:19.430310 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:19.509743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3183a2-b0b6-4303-b071-123df75bcdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:19.510613 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3183a2-b0b6-4303-b071-123df75bcdb6 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:19.510905 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3183a2-b0b6-4303-b071-123df75bcdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:19.511192 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3183a2-b0b6-4303-b071-123df75bcdb6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:19.512537 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3183a2-b0b6-4303-b071-123df75bcdb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:19.514121 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3183a2-b0b6-4303-b071-123df75bcdb6 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:19.516104 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 49/102] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:40:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:40:19.524194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3183a2-b0b6-4303-b071-123df75bcdb6 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:19.558421 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b435e3d-884c-4047-bdc1-cfdc9498b10c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:19.634640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b537aac-598e-45aa-80b9-52d3c5d6b7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:19.635448 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b537aac-598e-45aa-80b9-52d3c5d6b7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:19.635736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b537aac-598e-45aa-80b9-52d3c5d6b7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:19.636014 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b537aac-598e-45aa-80b9-52d3c5d6b7c5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:19.650876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b537aac-598e-45aa-80b9-52d3c5d6b7c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:19.666340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-4b537aac-598e-45aa-80b9-52d3c5d6b7c5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 05:40:19.666340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:19.666340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:19.666340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:19.666340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:19.666340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:19.666340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:19.666340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:19.666340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:19.666340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:19.666340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:19.666340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:19.666340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:19.666340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:19.666340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:19.666340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:19.667323 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:19.667323 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:19.667323 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:19.667323 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:19.667323 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:19.667323 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:19.667323 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:19.667323 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:19.667323 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:19.667323 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:19.667323 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:19.667323 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:19.667323 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:19.667323 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:19.667323 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:19.667323 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:19.668533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:19.668533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:19.668533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:19.668533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:19.668533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:19.668533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:19.668533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:19.668533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:19.668533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:19.668533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:19.668533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 05:40:19.668533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:40:19.668533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 54/103] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:40:19.675125 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b537aac-598e-45aa-80b9-52d3c5d6b7c5 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:19.731503 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3183a2-b0b6-4303-b071-123df75bcdb6 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:19.768952 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:19.814824 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987359c2-659d-47c1-bac7-40dfc1beff97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:19.815938 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987359c2-659d-47c1-bac7-40dfc1beff97 None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:19.816231 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987359c2-659d-47c1-bac7-40dfc1beff97 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:19.816517 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987359c2-659d-47c1-bac7-40dfc1beff97 None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:19.817250 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987359c2-659d-47c1-bac7-40dfc1beff97 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:19.818748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987359c2-659d-47c1-bac7-40dfc1beff97 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:19.850185 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b537aac-598e-45aa-80b9-52d3c5d6b7c5 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:19.894224 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 50/104] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jun 21 05:40:19 2022] POST /identity/v3/projects => generated 302 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:40:19.895725 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca95608-4a5d-489c-9751-409195c84d40 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:19.896030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca95608-4a5d-489c-9751-409195c84d40 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:19.896316 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca95608-4a5d-489c-9751-409195c84d40 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:19.897817 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 51/105] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:19.905626 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f77f6-4509-412f-a0f8-a07a70c4e202 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:19.905921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f77f6-4509-412f-a0f8-a07a70c4e202 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:19.906257 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f77f6-4509-412f-a0f8-a07a70c4e202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:19.907418 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee4802-6e50-402b-bb10-66e6a5f6c1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:19.908265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee4802-6e50-402b-bb10-66e6a5f6c1cf None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:19.908778 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee4802-6e50-402b-bb10-66e6a5f6c1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:19.909208 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee4802-6e50-402b-bb10-66e6a5f6c1cf None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:19.910183 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee4802-6e50-402b-bb10-66e6a5f6c1cf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:19.910652 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee4802-6e50-402b-bb10-66e6a5f6c1cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:19.912264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee4802-6e50-402b-bb10-66e6a5f6c1cf None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:19.922402 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 55/106] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 21 05:40:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:19.936861 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee4802-6e50-402b-bb10-66e6a5f6c1cf None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:19.945351 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-9b2f77f6-4509-412f-a0f8-a07a70c4e202 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:19.946612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9b2f77f6-4509-412f-a0f8-a07a70c4e202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:20.007012 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:20.139817 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 52/107] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:20.153910 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78af28-2c43-4f6d-b37e-592c20583646 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:20.154263 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78af28-2c43-4f6d-b37e-592c20583646 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:20.154767 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78af28-2c43-4f6d-b37e-592c20583646 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:20.156150 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 53/108] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:20.157408 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b18f2d-ad81-4348-9ba7-17e4e68d6e0b None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:20.157702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b18f2d-ad81-4348-9ba7-17e4e68d6e0b None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:20.158052 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b18f2d-ad81-4348-9ba7-17e4e68d6e0b None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:20.160109 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 54/109] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:20.165975 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a3293-cf72-43ac-a87f-5c1469b21e95 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:20.166331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a3293-cf72-43ac-a87f-5c1469b21e95 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:20.166578 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a3293-cf72-43ac-a87f-5c1469b21e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:20.196864 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-c13a3293-cf72-43ac-a87f-5c1469b21e95 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:20.198824 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c13a3293-cf72-43ac-a87f-5c1469b21e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:20.211420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee4802-6e50-402b-bb10-66e6a5f6c1cf None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:20.225460 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:20.271621 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15416e0-bdc7-431d-91ed-872e0c5f5c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:20.272821 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15416e0-bdc7-431d-91ed-872e0c5f5c02 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:20.273125 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15416e0-bdc7-431d-91ed-872e0c5f5c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:20.273417 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15416e0-bdc7-431d-91ed-872e0c5f5c02 None admin] PATH_INFO: `/v3/users/bc6a628b683a42008a8465f366eff414` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:20.305674 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15416e0-bdc7-431d-91ed-872e0c5f5c02 None admin] RBAC: Authorizing `identity:get_user(user_id=bc6a628b683a42008a8465f366eff414)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:20.308139 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15416e0-bdc7-431d-91ed-872e0c5f5c02 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:20.308275 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 55/110] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 05:40:20.309666 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efa668-2383-4eec-b496-54840c72374d None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:20.310065 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 56/111] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:19 2022] GET /identity/v3/users/bc6a628b683a42008a8465f366eff414 => generated 289 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:20.310247 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efa668-2383-4eec-b496-54840c72374d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:20.310548 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efa668-2383-4eec-b496-54840c72374d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:20.311389 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15416e0-bdc7-431d-91ed-872e0c5f5c02 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:20.330973 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-81efa668-2383-4eec-b496-54840c72374d None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:20.332201 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-81efa668-2383-4eec-b496-54840c72374d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:20.432378 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 56/112] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:20.433233 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efa668-2383-4eec-b496-54840c72374d None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:20.450400 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:20.483057 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15416e0-bdc7-431d-91ed-872e0c5f5c02 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:20.534430 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70fee4-a924-4879-9e53-3e6e260de805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:20.535842 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70fee4-a924-4879-9e53-3e6e260de805 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:20.536445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70fee4-a924-4879-9e53-3e6e260de805 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:20.536831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70fee4-a924-4879-9e53-3e6e260de805 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:20.551646 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70fee4-a924-4879-9e53-3e6e260de805 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:20.560359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-eb70fee4-a924-4879-9e53-3e6e260de805 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:40:20.560359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:20.560359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:20.560359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:20.560359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:20.560359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:20.560359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:20.560359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:20.560359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:20.560359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:20.560359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:20.560359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:20.560359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:20.560359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:20.560359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:20.560359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:20.561246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:20.561246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:20.561246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:20.561246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:20.561246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:20.561246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:20.561246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:20.561246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:20.561246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:20.561246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:20.561246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:20.561246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:20.561246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:20.561246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:20.561246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:20.561246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:20.562647 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:20.562647 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:20.562647 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:20.562647 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:20.562647 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:20.562647 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:20.562647 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:20.562647 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:20.562647 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:20.562647 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:20.562647 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:40:20.562647 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:40:20.562647 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 57/113] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:40:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:20.562647 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70fee4-a924-4879-9e53-3e6e260de805 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:20.567245 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efa668-2383-4eec-b496-54840c72374d None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:20.607521 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2e853-9da9-4504-aaef-07ce755a0573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:20.608349 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:20.608466 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2e853-9da9-4504-aaef-07ce755a0573 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:20.608796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2e853-9da9-4504-aaef-07ce755a0573 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:20.609144 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2e853-9da9-4504-aaef-07ce755a0573 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:20.692775 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2e853-9da9-4504-aaef-07ce755a0573 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:20.694207 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2e853-9da9-4504-aaef-07ce755a0573 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:20.698324 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70fee4-a924-4879-9e53-3e6e260de805 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:20.710613 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:20.743935 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa185c-f4b1-4359-8e94-685656468001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:20.744976 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa185c-f4b1-4359-8e94-685656468001 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:20.745274 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa185c-f4b1-4359-8e94-685656468001 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:20.745560 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa185c-f4b1-4359-8e94-685656468001 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:20.761874 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa185c-f4b1-4359-8e94-685656468001 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:20.773853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-8baa185c-f4b1-4359-8e94-685656468001 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 05:40:20.773853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:20.773853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:20.773853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:20.773853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:20.773853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:20.773853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:20.773853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:20.773853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:20.773853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:20.773853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:20.773853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:20.773853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:20.773853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:20.773853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:20.773853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:20.775105 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:20.775105 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:20.775105 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:20.775105 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:20.775105 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:20.775105 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:20.775105 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:20.775105 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:20.775105 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:20.775105 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:20.775105 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:20.775105 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:20.775105 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:20.775105 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:20.775105 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:20.775105 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:20.775876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:20.775876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:20.775876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:20.775876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:20.775876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:20.775876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:20.775876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:20.775876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:20.775876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:20.775876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:20.775876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 05:40:20.775876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:40:20.775876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 58/114] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 21 05:40:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:20.776508 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa185c-f4b1-4359-8e94-685656468001 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:20.829434 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 57/115] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:40:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:40:20.830170 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2e853-9da9-4504-aaef-07ce755a0573 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:20.890190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:20.909095 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa185c-f4b1-4359-8e94-685656468001 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:20.951955 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c62f23-2a0b-4027-92f8-1c9d0e399592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:20.952666 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c62f23-2a0b-4027-92f8-1c9d0e399592 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:20.952957 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c62f23-2a0b-4027-92f8-1c9d0e399592 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:20.953238 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c62f23-2a0b-4027-92f8-1c9d0e399592 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:20.958944 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2e853-9da9-4504-aaef-07ce755a0573 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:20.964839 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c62f23-2a0b-4027-92f8-1c9d0e399592 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:20.972784 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-48c62f23-2a0b-4027-92f8-1c9d0e399592 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:20.972784 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:20.972784 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:20.972784 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:20.972784 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:20.972784 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:20.972784 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:20.972784 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:20.972784 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:20.972784 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:20.972784 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:20.972784 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:20.972784 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:20.972784 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:20.972784 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:20.972784 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:20.974445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:20.974445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:20.974445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:20.974445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:20.974445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:20.974445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:20.974445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:20.974445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:20.974445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:20.974445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:20.974445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:20.974445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:20.974445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:20.974445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:20.974445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:20.974445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:20.975554 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:20.975554 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:20.975554 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:20.975554 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:20.975554 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:20.975554 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:20.975554 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:20.975554 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:20.975554 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:20.975554 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:20.975554 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:20.975554 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:40:20.975554 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 59/116] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:20.979643 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1541c7-2a2b-4a0b-9290-e911c6f74090 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:20.979822 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:20.980126 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1541c7-2a2b-4a0b-9290-e911c6f74090 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:20.980592 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1541c7-2a2b-4a0b-9290-e911c6f74090 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:20.987211 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 60/117] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:20 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:20.988283 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1541c7-2a2b-4a0b-9290-e911c6f74090 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:21.009795 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d5f3f-5823-4c02-a49d-969c793317f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:21.010395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d5f3f-5823-4c02-a49d-969c793317f0 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:21.010683 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d5f3f-5823-4c02-a49d-969c793317f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:21.010967 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d5f3f-5823-4c02-a49d-969c793317f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:21.011801 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d5f3f-5823-4c02-a49d-969c793317f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:21.012114 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d5f3f-5823-4c02-a49d-969c793317f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:21.013544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d5f3f-5823-4c02-a49d-969c793317f0 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:21.023082 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 58/118] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:21.024232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d5f3f-5823-4c02-a49d-969c793317f0 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:21.121658 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1541c7-2a2b-4a0b-9290-e911c6f74090 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:21.148108 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d5f3f-5823-4c02-a49d-969c793317f0 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:21.163288 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c62bb-00a2-4d8c-b2d7-1d210d18df19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:21.163969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c62bb-00a2-4d8c-b2d7-1d210d18df19 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:21.165299 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c62bb-00a2-4d8c-b2d7-1d210d18df19 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:21.165299 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c62bb-00a2-4d8c-b2d7-1d210d18df19 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:21.165299 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c62bb-00a2-4d8c-b2d7-1d210d18df19 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:21.165728 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c62bb-00a2-4d8c-b2d7-1d210d18df19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:21.167022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c62bb-00a2-4d8c-b2d7-1d210d18df19 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:21.175898 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 61/119] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:40:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:21.179326 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c62bb-00a2-4d8c-b2d7-1d210d18df19 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:21.190863 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41517ee9-451b-471f-9922-ee78fceda88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:21.191801 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41517ee9-451b-471f-9922-ee78fceda88a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:21.192829 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41517ee9-451b-471f-9922-ee78fceda88a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:21.192829 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41517ee9-451b-471f-9922-ee78fceda88a None admin] PATH_INFO: `/v3/projects/f8f1415161a745f387f7c6563159c122` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:21.193424 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41517ee9-451b-471f-9922-ee78fceda88a None admin] RBAC: Authorizing `identity:get_project(project_id=f8f1415161a745f387f7c6563159c122)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:21.195952 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41517ee9-451b-471f-9922-ee78fceda88a None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:21.196972 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:21.201707 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 59/120] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:21 2022] GET /identity/v3/projects/f8f1415161a745f387f7c6563159c122 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:21.203574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d532469-d826-4ff2-8f56-b415e8814517 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:21.203814 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d532469-d826-4ff2-8f56-b415e8814517 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:21.204093 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d532469-d826-4ff2-8f56-b415e8814517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:21.224522 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-7d532469-d826-4ff2-8f56-b415e8814517 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:21.225742 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-7d532469-d826-4ff2-8f56-b415e8814517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:21.267015 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:21.309539 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 60/121] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:21.310716 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d532469-d826-4ff2-8f56-b415e8814517 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:21.339764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c62bb-00a2-4d8c-b2d7-1d210d18df19 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:21.377887 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506d5e0-7b26-4405-931c-9dd8a8c8039a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:21.378190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506d5e0-7b26-4405-931c-9dd8a8c8039a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:21.378457 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506d5e0-7b26-4405-931c-9dd8a8c8039a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:21.378699 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506d5e0-7b26-4405-931c-9dd8a8c8039a None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:21.379487 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506d5e0-7b26-4405-931c-9dd8a8c8039a None admin] RBAC: Adding query filter params (name=member) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:21.379792 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506d5e0-7b26-4405-931c-9dd8a8c8039a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:21.381192 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506d5e0-7b26-4405-931c-9dd8a8c8039a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:21.390239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 62/122] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 21 05:40:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:21.396067 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506d5e0-7b26-4405-931c-9dd8a8c8039a None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:21.435686 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d532469-d826-4ff2-8f56-b415e8814517 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:21.469265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:21.476604 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9ca61-2106-4422-90d5-29cb9b9614a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:21.477456 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9ca61-2106-4422-90d5-29cb9b9614a8 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:21.477744 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9ca61-2106-4422-90d5-29cb9b9614a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:21.478122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9ca61-2106-4422-90d5-29cb9b9614a8 None admin] PATH_INFO: `/v3/users/79f991743edf4c82841603b9b9845e95` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:21.479716 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9ca61-2106-4422-90d5-29cb9b9614a8 None admin] RBAC: Authorizing `identity:get_user(user_id=79f991743edf4c82841603b9b9845e95)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:21.481816 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9ca61-2106-4422-90d5-29cb9b9614a8 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:21.485057 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 61/123] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:21 2022] GET /identity/v3/users/79f991743edf4c82841603b9b9845e95 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:21.485288 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9ca61-2106-4422-90d5-29cb9b9614a8 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:21.511742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506d5e0-7b26-4405-931c-9dd8a8c8039a None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:21.531463 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:21.553235 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907fed0b-edd7-4491-8268-ba460e406a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:21.554137 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fed0b-edd7-4491-8268-ba460e406a6e None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:21.554426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fed0b-edd7-4491-8268-ba460e406a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:21.554703 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fed0b-edd7-4491-8268-ba460e406a6e None admin] PATH_INFO: `/v3/users/ff7d725fbdd346cbad2f26c6701d1cc5` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:21.555923 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907fed0b-edd7-4491-8268-ba460e406a6e None admin] RBAC: Authorizing `identity:get_user(user_id=ff7d725fbdd346cbad2f26c6701d1cc5)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:21.557382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907fed0b-edd7-4491-8268-ba460e406a6e None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:21.559047 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 63/124] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:21 2022] GET /identity/v3/users/ff7d725fbdd346cbad2f26c6701d1cc5 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:21.559814 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907fed0b-edd7-4491-8268-ba460e406a6e None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:21.609813 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9ca61-2106-4422-90d5-29cb9b9614a8 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:21.659047 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e71f69-9f9e-4c63-8502-235c76e047b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:21.660189 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e71f69-9f9e-4c63-8502-235c76e047b9 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:21.660489 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e71f69-9f9e-4c63-8502-235c76e047b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:21.661684 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e71f69-9f9e-4c63-8502-235c76e047b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:21.662027 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e71f69-9f9e-4c63-8502-235c76e047b9 None admin] RBAC: Adding query filter params (role.id=3e721e6a74074d32bb3d80dad6e9974e, scope.project.id=f8f1415161a745f387f7c6563159c122, user.id=bc6a628b683a42008a8465f366eff414) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:21.662361 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e71f69-9f9e-4c63-8502-235c76e047b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:21.664150 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e71f69-9f9e-4c63-8502-235c76e047b9 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:21.670496 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 62/125] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:40:21 2022] GET /identity/v3/role_assignments?user.id=bc6a628b683a42008a8465f366eff414&scope.project.id=f8f1415161a745f387f7c6563159c122&role.id=3e721e6a74074d32bb3d80dad6e9974e => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:21.671208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e71f69-9f9e-4c63-8502-235c76e047b9 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:21.700146 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907fed0b-edd7-4491-8268-ba460e406a6e None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:21.761024 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3b0d9-8cf6-48fc-bea1-7c2e928d303d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:21.762574 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3b0d9-8cf6-48fc-bea1-7c2e928d303d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:21.763780 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3b0d9-8cf6-48fc-bea1-7c2e928d303d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:21.764267 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3b0d9-8cf6-48fc-bea1-7c2e928d303d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:21.778003 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:21.783939 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3b0d9-8cf6-48fc-bea1-7c2e928d303d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:21.796220 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-35e3b0d9-8cf6-48fc-bea1-7c2e928d303d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:21.796220 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:21.796220 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:21.796220 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:21.796220 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:21.796220 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:21.796220 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:21.796220 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:21.796220 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:21.796220 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:21.796220 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:21.796220 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:21.796220 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:21.796220 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:21.796220 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:21.796220 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:21.797157 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:21.797157 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:21.797157 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:21.797157 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:21.797157 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:21.797157 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:21.797157 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:21.797157 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:21.797157 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:21.797157 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:21.797157 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:21.797157 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:21.797157 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:21.797157 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:21.797157 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:21.797157 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:21.797959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:21.797959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:21.797959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:21.797959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:21.797959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:21.797959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:21.797959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:21.797959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:21.797959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:21.797959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:21.797959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:21.797959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:40:21.801983 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 64/126] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:21.801983 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3b0d9-8cf6-48fc-bea1-7c2e928d303d None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:21.828723 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e71f69-9f9e-4c63-8502-235c76e047b9 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:21.833208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:21.881355 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297db374-8350-4c0c-8545-720117a5af55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:21.882564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297db374-8350-4c0c-8545-720117a5af55 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:21.883045 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297db374-8350-4c0c-8545-720117a5af55 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:21.883491 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297db374-8350-4c0c-8545-720117a5af55 None admin] PATH_INFO: `/v3/users/ff7d725fbdd346cbad2f26c6701d1cc5` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:21.884953 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297db374-8350-4c0c-8545-720117a5af55 None admin] RBAC: Authorizing `identity:get_user(user_id=ff7d725fbdd346cbad2f26c6701d1cc5)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:21.886631 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297db374-8350-4c0c-8545-720117a5af55 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:21.888825 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 63/127] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:21 2022] GET /identity/v3/users/ff7d725fbdd346cbad2f26c6701d1cc5 => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:21.890016 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297db374-8350-4c0c-8545-720117a5af55 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:21.942520 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3b0d9-8cf6-48fc-bea1-7c2e928d303d None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:21.982158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da74f54-5a0a-47f7-b521-8533dda53ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:21.983394 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da74f54-5a0a-47f7-b521-8533dda53ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:21.983885 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da74f54-5a0a-47f7-b521-8533dda53ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:21.984376 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da74f54-5a0a-47f7-b521-8533dda53ba6 None admin] PATH_INFO: `/v3/projects/f8f1415161a745f387f7c6563159c122` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:21.985863 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da74f54-5a0a-47f7-b521-8533dda53ba6 None admin] RBAC: Authorizing `identity:get_project(project_id=f8f1415161a745f387f7c6563159c122)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:21.987672 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da74f54-5a0a-47f7-b521-8533dda53ba6 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:21.989712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 65/128] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:21 2022] GET /identity/v3/projects/f8f1415161a745f387f7c6563159c122 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:21.995605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da74f54-5a0a-47f7-b521-8533dda53ba6 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:22.031169 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297db374-8350-4c0c-8545-720117a5af55 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:22.078478 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:22.083738 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600ad8c-8cc4-495c-9c81-43167626ae67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:22.086236 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600ad8c-8cc4-495c-9c81-43167626ae67 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:22.086769 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600ad8c-8cc4-495c-9c81-43167626ae67 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:22.087255 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600ad8c-8cc4-495c-9c81-43167626ae67 None admin] PATH_INFO: `/v3/projects/f8f1415161a745f387f7c6563159c122` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:22.088786 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600ad8c-8cc4-495c-9c81-43167626ae67 None admin] RBAC: Authorizing `identity:get_project(project_id=f8f1415161a745f387f7c6563159c122)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:22.090614 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600ad8c-8cc4-495c-9c81-43167626ae67 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:22.093702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 64/129] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:21 2022] GET /identity/v3/projects/f8f1415161a745f387f7c6563159c122 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:22.094782 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600ad8c-8cc4-495c-9c81-43167626ae67 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:22.138634 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da74f54-5a0a-47f7-b521-8533dda53ba6 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:22.148700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:22.187973 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed6c09-1a88-4be5-96db-07a4140369f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:22.189018 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed6c09-1a88-4be5-96db-07a4140369f7 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:22.189539 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed6c09-1a88-4be5-96db-07a4140369f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:22.190653 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed6c09-1a88-4be5-96db-07a4140369f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:22.191699 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed6c09-1a88-4be5-96db-07a4140369f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:22.192512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed6c09-1a88-4be5-96db-07a4140369f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:22.194683 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed6c09-1a88-4be5-96db-07a4140369f7 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:22.206605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 66/130] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 21 05:40:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:22.211951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed6c09-1a88-4be5-96db-07a4140369f7 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:22.230793 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600ad8c-8cc4-495c-9c81-43167626ae67 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:22.273834 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06304686-865a-4b3d-a246-f975dc0db24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:22.274749 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06304686-865a-4b3d-a246-f975dc0db24a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:22.275038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06304686-865a-4b3d-a246-f975dc0db24a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:22.275319 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06304686-865a-4b3d-a246-f975dc0db24a None admin] PATH_INFO: `/v3/projects/dcbbb8ba61db478b9e73e0c6d021ddfe` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:22.276563 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06304686-865a-4b3d-a246-f975dc0db24a None admin] RBAC: Authorizing `identity:get_project(project_id=dcbbb8ba61db478b9e73e0c6d021ddfe)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:22.278041 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06304686-865a-4b3d-a246-f975dc0db24a None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:22.280005 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 65/131] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:22 2022] GET /identity/v3/projects/dcbbb8ba61db478b9e73e0c6d021ddfe => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:22.280556 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06304686-865a-4b3d-a246-f975dc0db24a None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:22.344440 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed6c09-1a88-4be5-96db-07a4140369f7 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:22.381677 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:22.389906 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007478d-7758-4883-9e30-062c0eb71133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:22.390754 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007478d-7758-4883-9e30-062c0eb71133 None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:22.391046 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007478d-7758-4883-9e30-062c0eb71133 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:22.391401 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007478d-7758-4883-9e30-062c0eb71133 None admin] PATH_INFO: `/v3/projects/f8f1415161a745f387f7c6563159c122/users/79f991743edf4c82841603b9b9845e95/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:22.393433 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6007478d-7758-4883-9e30-062c0eb71133 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8f1415161a745f387f7c6563159c122, user_id=79f991743edf4c82841603b9b9845e95, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:22.394206 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06304686-865a-4b3d-a246-f975dc0db24a None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:22.394914 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6007478d-7758-4883-9e30-062c0eb71133 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:22.405051 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:22.409996 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 67/132] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 21 05:40:22 2022] PUT /identity/v3/projects/f8f1415161a745f387f7c6563159c122/users/79f991743edf4c82841603b9b9845e95/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:40:22.419545 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007478d-7758-4883-9e30-062c0eb71133 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:22.443089 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03768d6-02e7-4355-a196-20f321289ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:22.444188 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03768d6-02e7-4355-a196-20f321289ed1 None admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:22.444716 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03768d6-02e7-4355-a196-20f321289ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:22.444955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03768d6-02e7-4355-a196-20f321289ed1 None admin] PATH_INFO: `/v3/projects/f8f1415161a745f387f7c6563159c122/users/ff7d725fbdd346cbad2f26c6701d1cc5/roles/ad23f352111e42de99e9d92fbfe2e1f4` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:22.447641 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03768d6-02e7-4355-a196-20f321289ed1 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8f1415161a745f387f7c6563159c122, user_id=ff7d725fbdd346cbad2f26c6701d1cc5, role_id=ad23f352111e42de99e9d92fbfe2e1f4)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:22.449272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03768d6-02e7-4355-a196-20f321289ed1 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:22.471657 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 66/133] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 21 05:40:22 2022] PUT /identity/v3/projects/f8f1415161a745f387f7c6563159c122/users/ff7d725fbdd346cbad2f26c6701d1cc5/roles/ad23f352111e42de99e9d92fbfe2e1f4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:40:22.473479 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b11ab-27d1-40dd-8669-780779bceac1 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:22.473799 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b11ab-27d1-40dd-8669-780779bceac1 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:22.474205 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b11ab-27d1-40dd-8669-780779bceac1 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:22.480002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 67/134] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:22.480002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b11ab-27d1-40dd-8669-780779bceac1 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:22.585566 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007478d-7758-4883-9e30-062c0eb71133 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:22.634715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b11ab-27d1-40dd-8669-780779bceac1 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:22.634959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f269c-278d-4c71-bb1a-476f2a167cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:22.635661 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f269c-278d-4c71-bb1a-476f2a167cbc None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:22.635944 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f269c-278d-4c71-bb1a-476f2a167cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:22.636219 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f269c-278d-4c71-bb1a-476f2a167cbc None admin] PATH_INFO: `/v3/users/ff7d725fbdd346cbad2f26c6701d1cc5` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:22.638422 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40f269c-278d-4c71-bb1a-476f2a167cbc None admin] RBAC: Authorizing `identity:get_user(user_id=ff7d725fbdd346cbad2f26c6701d1cc5)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:22.640776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40f269c-278d-4c71-bb1a-476f2a167cbc None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:22.645068 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 68/135] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:22 2022] GET /identity/v3/users/ff7d725fbdd346cbad2f26c6701d1cc5 => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:22.656503 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d82c8b-54f7-4d8e-bfcc-23d2e487aa36 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:22.656809 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d82c8b-54f7-4d8e-bfcc-23d2e487aa36 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:22.657076 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d82c8b-54f7-4d8e-bfcc-23d2e487aa36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:22.677467 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-f2d82c8b-54f7-4d8e-bfcc-23d2e487aa36 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:22.678718 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f2d82c8b-54f7-4d8e-bfcc-23d2e487aa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:22.697354 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add59ac-ddbc-444f-9a11-47adbf7c27ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:22.698308 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add59ac-ddbc-444f-9a11-47adbf7c27ef None admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:22.698604 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add59ac-ddbc-444f-9a11-47adbf7c27ef None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:22.699008 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add59ac-ddbc-444f-9a11-47adbf7c27ef None admin] PATH_INFO: `/v3/projects/dcbbb8ba61db478b9e73e0c6d021ddfe/users/ff7d725fbdd346cbad2f26c6701d1cc5/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:22.701664 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add59ac-ddbc-444f-9a11-47adbf7c27ef None admin] RBAC: Authorizing `identity:create_grant(project_id=dcbbb8ba61db478b9e73e0c6d021ddfe, user_id=ff7d725fbdd346cbad2f26c6701d1cc5, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:22.703204 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add59ac-ddbc-444f-9a11-47adbf7c27ef None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:22.723095 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 68/136] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 21 05:40:22 2022] PUT /identity/v3/projects/dcbbb8ba61db478b9e73e0c6d021ddfe/users/ff7d725fbdd346cbad2f26c6701d1cc5/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:40:22.724302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add59ac-ddbc-444f-9a11-47adbf7c27ef None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:22.766424 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:22.770872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:22.802072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 69/137] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:22.838382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d82c8b-54f7-4d8e-bfcc-23d2e487aa36 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:22.921247 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add59ac-ddbc-444f-9a11-47adbf7c27ef None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:23.004160 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d82c8b-54f7-4d8e-bfcc-23d2e487aa36 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:23.042049 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13772602-b482-4f02-8ec8-8229efc845d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:23.044097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13772602-b482-4f02-8ec8-8229efc845d1 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:23.045018 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13772602-b482-4f02-8ec8-8229efc845d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:23.045842 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13772602-b482-4f02-8ec8-8229efc845d1 None admin] PATH_INFO: `/v3/projects/f8f1415161a745f387f7c6563159c122` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:23.047849 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae6fb2-920b-4eab-8a0e-4ab99d55eeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:23.048888 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae6fb2-920b-4eab-8a0e-4ab99d55eeba None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:23.050269 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae6fb2-920b-4eab-8a0e-4ab99d55eeba None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:23.050846 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13772602-b482-4f02-8ec8-8229efc845d1 None admin] RBAC: Authorizing `identity:get_project(project_id=f8f1415161a745f387f7c6563159c122)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:23.051368 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae6fb2-920b-4eab-8a0e-4ab99d55eeba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:23.053036 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13772602-b482-4f02-8ec8-8229efc845d1 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:23.055629 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 69/138] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:22 2022] GET /identity/v3/projects/f8f1415161a745f387f7c6563159c122 => generated 298 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:23.056663 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae6fb2-920b-4eab-8a0e-4ab99d55eeba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:23.058392 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae6fb2-920b-4eab-8a0e-4ab99d55eeba None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:23.060292 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 70/139] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:40:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:40:23.061362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13772602-b482-4f02-8ec8-8229efc845d1 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:23.066942 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae6fb2-920b-4eab-8a0e-4ab99d55eeba None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:23.170355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:23.216238 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae6fb2-920b-4eab-8a0e-4ab99d55eeba None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:23.310228 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24cdaad-e4e6-42cc-87f5-758203ea45e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:23.311117 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24cdaad-e4e6-42cc-87f5-758203ea45e2 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:23.311409 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24cdaad-e4e6-42cc-87f5-758203ea45e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:23.311693 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24cdaad-e4e6-42cc-87f5-758203ea45e2 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:23.312433 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24cdaad-e4e6-42cc-87f5-758203ea45e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:23.313948 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24cdaad-e4e6-42cc-87f5-758203ea45e2 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:23.345149 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:23.354295 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 71/140] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 21 05:40:23 2022] POST /identity/v3/users => generated 283 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:40:23.365379 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13772602-b482-4f02-8ec8-8229efc845d1 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:23.417435 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f7fdd-4522-4ae3-9b24-e725c6a79246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:23.418384 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f7fdd-4522-4ae3-9b24-e725c6a79246 None admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:23.418676 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f7fdd-4522-4ae3-9b24-e725c6a79246 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:23.418963 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f7fdd-4522-4ae3-9b24-e725c6a79246 None admin] PATH_INFO: `/v3/projects/f8f1415161a745f387f7c6563159c122/users/ff7d725fbdd346cbad2f26c6701d1cc5/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:23.421625 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f7fdd-4522-4ae3-9b24-e725c6a79246 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8f1415161a745f387f7c6563159c122, user_id=ff7d725fbdd346cbad2f26c6701d1cc5, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:23.423186 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f7fdd-4522-4ae3-9b24-e725c6a79246 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:23.443058 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 70/141] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 21 05:40:23 2022] PUT /identity/v3/projects/f8f1415161a745f387f7c6563159c122/users/ff7d725fbdd346cbad2f26c6701d1cc5/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:40:24.298242 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac20b40-c586-41cc-8a83-38803d461480 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:24.298602 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac20b40-c586-41cc-8a83-38803d461480 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:24.298816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac20b40-c586-41cc-8a83-38803d461480 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:24.300927 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 72/142] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 05:40:24.306531 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5d34b-b8dc-46b2-bc07-c0fe7590eb43 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:24.306998 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5d34b-b8dc-46b2-bc07-c0fe7590eb43 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:24.307182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5d34b-b8dc-46b2-bc07-c0fe7590eb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:24.326419 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-e4b5d34b-b8dc-46b2-bc07-c0fe7590eb43 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:24.327641 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e4b5d34b-b8dc-46b2-bc07-c0fe7590eb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:24.412065 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 71/143] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:24.449201 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac20b40-c586-41cc-8a83-38803d461480 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:24.575183 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac20b40-c586-41cc-8a83-38803d461480 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:24.592011 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:24.618679 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d24116-bdbd-4347-acb5-b8e605e33054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:24.619487 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d24116-bdbd-4347-acb5-b8e605e33054 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:24.619773 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d24116-bdbd-4347-acb5-b8e605e33054 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:24.620049 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d24116-bdbd-4347-acb5-b8e605e33054 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:24.636243 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d24116-bdbd-4347-acb5-b8e605e33054 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:24.644357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-07d24116-bdbd-4347-acb5-b8e605e33054 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 05:40:24.644357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:24.644357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:24.644357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:24.644357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:24.644357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:24.644357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:24.644357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:24.644357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:24.644357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:24.644357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:24.644357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:24.644357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:24.644357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:24.644357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:24.644357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:24.645216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:24.645216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:24.645216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:24.645216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:24.645216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:24.645216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:24.645216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:24.645216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:24.645216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:24.645216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:24.645216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:24.645216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:24.645216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:24.645216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:24.645216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:24.645216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:24.645992 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:24.645992 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:24.645992 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:24.645992 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:24.645992 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:24.645992 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:24.645992 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:24.645992 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:24.645992 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:24.645992 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:24.645992 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 05:40:24.645992 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:40:24.645992 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 73/144] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:24.653371 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5d34b-b8dc-46b2-bc07-c0fe7590eb43 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:24.776815 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:24.792774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5d34b-b8dc-46b2-bc07-c0fe7590eb43 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:24.837459 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af00894-7ce5-4dee-ab17-87936a1738a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:24.838633 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af00894-7ce5-4dee-ab17-87936a1738a1 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:24.839127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af00894-7ce5-4dee-ab17-87936a1738a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:24.839594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af00894-7ce5-4dee-ab17-87936a1738a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:24.840545 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af00894-7ce5-4dee-ab17-87936a1738a1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:24.841047 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af00894-7ce5-4dee-ab17-87936a1738a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:24.842669 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af00894-7ce5-4dee-ab17-87936a1738a1 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:24.852183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 72/145] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 21 05:40:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:24.858230 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d24116-bdbd-4347-acb5-b8e605e33054 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:25.005963 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d24116-bdbd-4347-acb5-b8e605e33054 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:25.047986 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6405895-56a2-4568-8680-25ecdb8c9a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:25.048799 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6405895-56a2-4568-8680-25ecdb8c9a18 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:25.049629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6405895-56a2-4568-8680-25ecdb8c9a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:25.049909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6405895-56a2-4568-8680-25ecdb8c9a18 None admin] PATH_INFO: `/v3/users/bc6a628b683a42008a8465f366eff414` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:25.051270 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6405895-56a2-4568-8680-25ecdb8c9a18 None admin] RBAC: Authorizing `identity:get_user(user_id=bc6a628b683a42008a8465f366eff414)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:25.052787 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6405895-56a2-4568-8680-25ecdb8c9a18 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:25.055002 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 74/146] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:24 2022] GET /identity/v3/users/bc6a628b683a42008a8465f366eff414 => generated 289 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:25.060418 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af00894-7ce5-4dee-ab17-87936a1738a1 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:25.195733 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af00894-7ce5-4dee-ab17-87936a1738a1 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:25.234460 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e835932-0eac-49c2-96cf-fe4fea062e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:25.235356 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e835932-0eac-49c2-96cf-fe4fea062e88 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:25.235642 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e835932-0eac-49c2-96cf-fe4fea062e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:25.235922 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e835932-0eac-49c2-96cf-fe4fea062e88 None admin] PATH_INFO: `/v3/projects/f8f1415161a745f387f7c6563159c122` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:25.242915 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e835932-0eac-49c2-96cf-fe4fea062e88 None admin] RBAC: Authorizing `identity:get_project(project_id=f8f1415161a745f387f7c6563159c122)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:25.246509 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e835932-0eac-49c2-96cf-fe4fea062e88 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:25.248386 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 73/147] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:25 2022] GET /identity/v3/projects/f8f1415161a745f387f7c6563159c122 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:25.254463 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6405895-56a2-4568-8680-25ecdb8c9a18 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:25.321716 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:25.398475 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6405895-56a2-4568-8680-25ecdb8c9a18 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:25.441658 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7583bd-39a4-4a78-a44a-92b4bb17a09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:25.442654 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7583bd-39a4-4a78-a44a-92b4bb17a09c None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:25.442882 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7583bd-39a4-4a78-a44a-92b4bb17a09c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:25.443357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7583bd-39a4-4a78-a44a-92b4bb17a09c None admin] PATH_INFO: `/v3/projects/f8f1415161a745f387f7c6563159c122/users/bc6a628b683a42008a8465f366eff414/roles/3e721e6a74074d32bb3d80dad6e9974e` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:25.447041 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7583bd-39a4-4a78-a44a-92b4bb17a09c None admin] RBAC: Authorizing `identity:create_grant(project_id=f8f1415161a745f387f7c6563159c122, user_id=bc6a628b683a42008a8465f366eff414, role_id=3e721e6a74074d32bb3d80dad6e9974e)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:25.449336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7583bd-39a4-4a78-a44a-92b4bb17a09c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:25.469617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 75/148] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 21 05:40:25 2022] PUT /identity/v3/projects/f8f1415161a745f387f7c6563159c122/users/bc6a628b683a42008a8465f366eff414/roles/3e721e6a74074d32bb3d80dad6e9974e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:40:25.619458 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc090985-5329-4956-bf9c-d2d08d62f553 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:25.619971 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc090985-5329-4956-bf9c-d2d08d62f553 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:25.620044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc090985-5329-4956-bf9c-d2d08d62f553 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:25.621402 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 74/149] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:25.639815 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557d234-70a7-4c6f-a67b-c208edf86474 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:25.640188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557d234-70a7-4c6f-a67b-c208edf86474 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:25.640516 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557d234-70a7-4c6f-a67b-c208edf86474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:25.662286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-6557d234-70a7-4c6f-a67b-c208edf86474 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:25.663593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-6557d234-70a7-4c6f-a67b-c208edf86474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:25.752888 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 76/150] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:25.792500 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc090985-5329-4956-bf9c-d2d08d62f553 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:25.816762 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:25.923695 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc090985-5329-4956-bf9c-d2d08d62f553 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:25.970699 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd6e66-efbd-4b1f-af88-c205189dc768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:25.971558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd6e66-efbd-4b1f-af88-c205189dc768 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:25.971846 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd6e66-efbd-4b1f-af88-c205189dc768 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:25.972127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd6e66-efbd-4b1f-af88-c205189dc768 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:25.985177 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd6e66-efbd-4b1f-af88-c205189dc768 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:25.993612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-b2cd6e66-efbd-4b1f-af88-c205189dc768 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:40:25.993612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:25.993612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:25.993612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:25.993612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:25.993612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:25.993612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:25.993612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:25.993612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:25.993612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:25.993612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:25.993612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:25.993612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:25.993612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:25.993612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:25.993612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:25.994530 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:25.994530 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:25.994530 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:25.994530 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:25.994530 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:25.994530 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:25.994530 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:25.994530 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:25.994530 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:25.994530 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:25.994530 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:25.994530 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:25.994530 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:25.994530 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:25.994530 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:25.994530 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:25.995287 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:25.995287 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:25.995287 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:25.995287 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:25.995287 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:25.995287 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:25.995287 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:25.995287 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:25.995287 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:25.995287 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:25.995287 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:40:25.995287 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:40:25.995861 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 75/151] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:40:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:26.002931 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557d234-70a7-4c6f-a67b-c208edf86474 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:26.055868 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:26.119616 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adcb1d-6506-4fac-8dd8-3ef79dc76b04 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:26.119904 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adcb1d-6506-4fac-8dd8-3ef79dc76b04 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:26.120192 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adcb1d-6506-4fac-8dd8-3ef79dc76b04 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:26.121570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 76/152] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 05:40:26.127148 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfec3f8-177c-4bf1-8a7a-4d0100c73bab None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:26.127944 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfec3f8-177c-4bf1-8a7a-4d0100c73bab None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:26.128225 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfec3f8-177c-4bf1-8a7a-4d0100c73bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:26.150785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-edfec3f8-177c-4bf1-8a7a-4d0100c73bab None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:26.152302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-edfec3f8-177c-4bf1-8a7a-4d0100c73bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:26.183760 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557d234-70a7-4c6f-a67b-c208edf86474 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:26.258776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7dd1a-8069-461e-871f-3a85c42935a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:26.259423 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7dd1a-8069-461e-871f-3a85c42935a4 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:26.259707 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7dd1a-8069-461e-871f-3a85c42935a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:26.259988 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7dd1a-8069-461e-871f-3a85c42935a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:26.260755 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7dd1a-8069-461e-871f-3a85c42935a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:26.261062 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7dd1a-8069-461e-871f-3a85c42935a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:26.263024 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7dd1a-8069-461e-871f-3a85c42935a4 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:26.282507 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 77/153] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:26.293704 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7dd1a-8069-461e-871f-3a85c42935a4 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:26.302226 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 77/154] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 05:40:26.339485 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfec3f8-177c-4bf1-8a7a-4d0100c73bab None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:26.352850 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:26.450699 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:26.467655 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7dd1a-8069-461e-871f-3a85c42935a4 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:26.535763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7648f-7264-4df1-9ad9-5cbd77318646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:26.536671 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7648f-7264-4df1-9ad9-5cbd77318646 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:26.536958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7648f-7264-4df1-9ad9-5cbd77318646 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:26.537237 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7648f-7264-4df1-9ad9-5cbd77318646 None admin] PATH_INFO: `/v3/users/79f991743edf4c82841603b9b9845e95` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:26.541624 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7648f-7264-4df1-9ad9-5cbd77318646 None admin] RBAC: Authorizing `identity:get_user(user_id=79f991743edf4c82841603b9b9845e95)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:26.541624 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7648f-7264-4df1-9ad9-5cbd77318646 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:26.541827 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 78/155] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:26 2022] GET /identity/v3/users/79f991743edf4c82841603b9b9845e95 => generated 247 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:26.542970 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc718a03-956c-40c5-9dbc-5ddcbe8fc240 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:26.543254 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc718a03-956c-40c5-9dbc-5ddcbe8fc240 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:26.543536 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc718a03-956c-40c5-9dbc-5ddcbe8fc240 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:26.544840 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 79/156] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:26.550299 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a125c2-fc21-4e49-b5b1-f1a83fd70aae None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:26.550867 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a125c2-fc21-4e49-b5b1-f1a83fd70aae None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:26.551341 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a125c2-fc21-4e49-b5b1-f1a83fd70aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:26.583019 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-09a125c2-fc21-4e49-b5b1-f1a83fd70aae None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:26.583771 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfec3f8-177c-4bf1-8a7a-4d0100c73bab None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:26.584249 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-09a125c2-fc21-4e49-b5b1-f1a83fd70aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:26.647386 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5cebd-dd1e-4074-b6cd-e1324f91ede0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:26.648919 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5cebd-dd1e-4074-b6cd-e1324f91ede0 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:26.649426 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5cebd-dd1e-4074-b6cd-e1324f91ede0 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:26.649901 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5cebd-dd1e-4074-b6cd-e1324f91ede0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:26.673308 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5cebd-dd1e-4074-b6cd-e1324f91ede0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:26.683134 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-f6e5cebd-dd1e-4074-b6cd-e1324f91ede0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 05:40:26.683134 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:26.683134 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:26.683134 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:26.683134 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:26.683134 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:26.683134 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:26.683134 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:26.683134 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:26.683134 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:26.683134 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:26.683134 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:26.683134 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:26.683134 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:26.683134 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:26.683134 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:26.684226 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:26.684226 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:26.684226 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:26.684226 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:26.684226 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:26.684226 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:26.684226 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:26.684226 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:26.684226 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:26.684226 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:26.684226 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:26.684226 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:26.684226 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:26.684226 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:26.684226 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:26.684226 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:26.685072 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:26.685072 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:26.685072 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:26.685072 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:26.685072 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:26.685072 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:26.685072 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:26.685072 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:26.685072 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:26.685072 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:26.685072 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 05:40:26.685072 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:40:26.693955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 78/157] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 21 05:40:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:26.695980 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5cebd-dd1e-4074-b6cd-e1324f91ede0 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:26.784338 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 80/158] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 05:40:26.785532 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a125c2-fc21-4e49-b5b1-f1a83fd70aae None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:26.821959 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:26.916585 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5cebd-dd1e-4074-b6cd-e1324f91ede0 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:26.938008 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:26.955283 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a125c2-fc21-4e49-b5b1-f1a83fd70aae None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:27.003288 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93eda2-4b92-4680-a9f4-d9cfa91dbd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:27.004138 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93eda2-4b92-4680-a9f4-d9cfa91dbd32 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:27.004427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93eda2-4b92-4680-a9f4-d9cfa91dbd32 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:27.004706 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93eda2-4b92-4680-a9f4-d9cfa91dbd32 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:27.005468 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93eda2-4b92-4680-a9f4-d9cfa91dbd32 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:27.005981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93eda2-4b92-4680-a9f4-d9cfa91dbd32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:27.007850 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93eda2-4b92-4680-a9f4-d9cfa91dbd32 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:27.023092 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 81/159] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:40:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:27.023932 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93eda2-4b92-4680-a9f4-d9cfa91dbd32 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:27.031561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f1aef-93f5-4670-9b6c-51de4751c716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:27.032499 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f1aef-93f5-4670-9b6c-51de4751c716 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:27.032956 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f1aef-93f5-4670-9b6c-51de4751c716 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:27.033420 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f1aef-93f5-4670-9b6c-51de4751c716 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:27.203058 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f1aef-93f5-4670-9b6c-51de4751c716 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:27.204691 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93eda2-4b92-4680-a9f4-d9cfa91dbd32 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:27.206946 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f1aef-93f5-4670-9b6c-51de4751c716 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:27.302763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b533457-9dc8-4a20-94e5-29c4e9d552b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:27.303596 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b533457-9dc8-4a20-94e5-29c4e9d552b7 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:27.303891 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b533457-9dc8-4a20-94e5-29c4e9d552b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:27.304175 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b533457-9dc8-4a20-94e5-29c4e9d552b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:27.334926 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b533457-9dc8-4a20-94e5-29c4e9d552b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:27.342884 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-7b533457-9dc8-4a20-94e5-29c4e9d552b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:27.342884 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:27.342884 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:27.342884 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:27.342884 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:27.342884 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:27.342884 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:27.342884 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:27.342884 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:27.342884 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:27.342884 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:27.342884 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:27.342884 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:27.342884 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:27.342884 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:27.342884 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:27.343962 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:27.343962 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:27.343962 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:27.343962 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:27.343962 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:27.343962 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:27.343962 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:27.343962 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:27.343962 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:27.343962 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:27.343962 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:27.343962 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:27.343962 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:27.343962 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:27.343962 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:27.343962 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:27.344913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:27.344913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:27.344913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:27.344913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:27.344913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:27.344913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:27.344913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:27.344913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:27.344913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:27.344913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:27.344913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:27.344913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:40:27.344913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 82/160] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:27.344913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b533457-9dc8-4a20-94e5-29c4e9d552b7 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:27.346573 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:27.378416 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:27.424981 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 79/161] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:40:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 729 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:40:27.425881 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f1aef-93f5-4670-9b6c-51de4751c716 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:27.565414 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b533457-9dc8-4a20-94e5-29c4e9d552b7 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:27.628715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f1aef-93f5-4670-9b6c-51de4751c716 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:27.659181 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd4d31-a843-46b7-a9d3-744e83e7e0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:27.660304 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd4d31-a843-46b7-a9d3-744e83e7e0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:27.660753 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd4d31-a843-46b7-a9d3-744e83e7e0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:27.661169 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd4d31-a843-46b7-a9d3-744e83e7e0d8 None admin] PATH_INFO: `/v3/users/ff7d725fbdd346cbad2f26c6701d1cc5` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:27.662578 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd4d31-a843-46b7-a9d3-744e83e7e0d8 None admin] RBAC: Authorizing `identity:get_user(user_id=ff7d725fbdd346cbad2f26c6701d1cc5)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:27.664169 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd4d31-a843-46b7-a9d3-744e83e7e0d8 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:27.665994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 83/162] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:27 2022] GET /identity/v3/users/ff7d725fbdd346cbad2f26c6701d1cc5 => generated 275 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:27.666907 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd4d31-a843-46b7-a9d3-744e83e7e0d8 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:27.690673 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e02671-90c8-4ffc-afce-7e3b9c41b3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:27.691943 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e02671-90c8-4ffc-afce-7e3b9c41b3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:27.692377 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e02671-90c8-4ffc-afce-7e3b9c41b3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:27.692803 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e02671-90c8-4ffc-afce-7e3b9c41b3b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:27.693743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e02671-90c8-4ffc-afce-7e3b9c41b3b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:27.694231 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e02671-90c8-4ffc-afce-7e3b9c41b3b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:27.695750 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e02671-90c8-4ffc-afce-7e3b9c41b3b8 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:27.705011 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 80/163] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 21 05:40:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:27.711022 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b657d-c492-4a02-922d-b1eb81c11a0a None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:27.711520 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b657d-c492-4a02-922d-b1eb81c11a0a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:27.711949 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b657d-c492-4a02-922d-b1eb81c11a0a None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:27.713462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 81/164] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:27.714349 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b657d-c492-4a02-922d-b1eb81c11a0a None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:27.777963 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:27.842868 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:27.885730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd4d31-a843-46b7-a9d3-744e83e7e0d8 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:27.944003 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b657d-c492-4a02-922d-b1eb81c11a0a None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:27.944192 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c367ef-10c3-4dfb-859d-7b93396a5769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:27.944872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c367ef-10c3-4dfb-859d-7b93396a5769 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:27.945158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c367ef-10c3-4dfb-859d-7b93396a5769 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:27.945467 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c367ef-10c3-4dfb-859d-7b93396a5769 None admin] PATH_INFO: `/v3/projects/f8f1415161a745f387f7c6563159c122` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:27.948946 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c367ef-10c3-4dfb-859d-7b93396a5769 None admin] RBAC: Authorizing `identity:get_project(project_id=f8f1415161a745f387f7c6563159c122)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:27.950447 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c367ef-10c3-4dfb-859d-7b93396a5769 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:27.952179 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 84/165] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:27 2022] GET /identity/v3/projects/f8f1415161a745f387f7c6563159c122 => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:27.952944 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c367ef-10c3-4dfb-859d-7b93396a5769 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:28.000933 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861f4b5-b53d-4f15-b2fe-8f2409ca2c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:28.001594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861f4b5-b53d-4f15-b2fe-8f2409ca2c51 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:28.001885 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861f4b5-b53d-4f15-b2fe-8f2409ca2c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:28.002225 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861f4b5-b53d-4f15-b2fe-8f2409ca2c51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:28.077344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861f4b5-b53d-4f15-b2fe-8f2409ca2c51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:28.077344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861f4b5-b53d-4f15-b2fe-8f2409ca2c51 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:28.105129 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:28.190286 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 82/166] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:40:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:40:28.192015 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61738109-b9f8-41a2-9945-ba6d5fadf919 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:28.192470 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61738109-b9f8-41a2-9945-ba6d5fadf919 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:28.192894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61738109-b9f8-41a2-9945-ba6d5fadf919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:28.212572 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-61738109-b9f8-41a2-9945-ba6d5fadf919 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:28.214379 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-61738109-b9f8-41a2-9945-ba6d5fadf919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:28.224851 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c367ef-10c3-4dfb-859d-7b93396a5769 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:28.263616 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d2412-002f-4cfa-9a00-5025a9611713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:28.264727 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d2412-002f-4cfa-9a00-5025a9611713 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:28.265168 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d2412-002f-4cfa-9a00-5025a9611713 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:28.265602 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d2412-002f-4cfa-9a00-5025a9611713 None admin] PATH_INFO: `/v3/users/ff7d725fbdd346cbad2f26c6701d1cc5` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:28.267060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d2412-002f-4cfa-9a00-5025a9611713 None admin] RBAC: Authorizing `identity:get_user(user_id=ff7d725fbdd346cbad2f26c6701d1cc5)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:28.268815 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d2412-002f-4cfa-9a00-5025a9611713 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:28.270788 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 85/167] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:27 2022] GET /identity/v3/users/ff7d725fbdd346cbad2f26c6701d1cc5 => generated 275 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:28.272252 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467adb8-a987-4d62-bf1a-b7b1eb7043e7 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:28.272696 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467adb8-a987-4d62-bf1a-b7b1eb7043e7 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:28.273209 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467adb8-a987-4d62-bf1a-b7b1eb7043e7 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:28.274711 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 86/168] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:28.279413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467adb8-a987-4d62-bf1a-b7b1eb7043e7 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:28.298666 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 83/169] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:28.300354 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61738109-b9f8-41a2-9945-ba6d5fadf919 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:28.306768 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:28.370964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:28.415490 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467adb8-a987-4d62-bf1a-b7b1eb7043e7 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:28.432884 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61738109-b9f8-41a2-9945-ba6d5fadf919 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:28.459309 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bc11b-134b-4f29-90ea-40c6613c8110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:28.460970 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bc11b-134b-4f29-90ea-40c6613c8110 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:28.461775 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bc11b-134b-4f29-90ea-40c6613c8110 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:28.462281 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bc11b-134b-4f29-90ea-40c6613c8110 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:28.464084 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bc11b-134b-4f29-90ea-40c6613c8110 None admin] RBAC: Adding query filter params (role.id=24aa6040c86049f996560e477e83886f, scope.project.id=f8f1415161a745f387f7c6563159c122, user.id=79f991743edf4c82841603b9b9845e95) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:28.464916 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bc11b-134b-4f29-90ea-40c6613c8110 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:28.467373 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bc11b-134b-4f29-90ea-40c6613c8110 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:28.475107 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a6a38-56f4-497b-b547-036676b8f6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:28.476229 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a6a38-56f4-497b-b547-036676b8f6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:28.476644 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 87/170] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:40:28 2022] GET /identity/v3/role_assignments?user.id=79f991743edf4c82841603b9b9845e95&scope.project.id=f8f1415161a745f387f7c6563159c122&role.id=24aa6040c86049f996560e477e83886f => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:28.476947 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a6a38-56f4-497b-b547-036676b8f6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:28.477433 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a6a38-56f4-497b-b547-036676b8f6a6 None admin] PATH_INFO: `/v3/projects/f8f1415161a745f387f7c6563159c122` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:28.484535 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fc908-58e8-4bfe-973f-03af2d2bd976 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:28.484852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a6a38-56f4-497b-b547-036676b8f6a6 None admin] RBAC: Authorizing `identity:get_project(project_id=f8f1415161a745f387f7c6563159c122)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:28.487178 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a6a38-56f4-497b-b547-036676b8f6a6 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:28.487730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fc908-58e8-4bfe-973f-03af2d2bd976 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:28.488233 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fc908-58e8-4bfe-973f-03af2d2bd976 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:28.489965 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 88/171] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:28 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:28.492127 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fc908-58e8-4bfe-973f-03af2d2bd976 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:28.493313 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 84/172] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:28 2022] GET /identity/v3/projects/f8f1415161a745f387f7c6563159c122 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:28.495691 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48146515-48db-4531-aa2b-f8fc0d08efdc None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:28.498302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48146515-48db-4531-aa2b-f8fc0d08efdc None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:28.498785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48146515-48db-4531-aa2b-f8fc0d08efdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:28.533955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-48146515-48db-4531-aa2b-f8fc0d08efdc None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:28.533955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-48146515-48db-4531-aa2b-f8fc0d08efdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:28.652542 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 85/173] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:28.654578 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:28.655654 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48146515-48db-4531-aa2b-f8fc0d08efdc None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:28.684596 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fc908-58e8-4bfe-973f-03af2d2bd976 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:28.724623 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f72cdb-9d49-449f-8f03-e2b38dbf9d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:28.725559 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f72cdb-9d49-449f-8f03-e2b38dbf9d8e None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:28.726050 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f72cdb-9d49-449f-8f03-e2b38dbf9d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:28.726538 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f72cdb-9d49-449f-8f03-e2b38dbf9d8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:28.732564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:28.794127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48146515-48db-4531-aa2b-f8fc0d08efdc None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:28.827821 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f72cdb-9d49-449f-8f03-e2b38dbf9d8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:28.829573 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f72cdb-9d49-449f-8f03-e2b38dbf9d8e None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:28.838204 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45efd80d-e124-4400-af15-9a3559b4ffb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:28.839213 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efd80d-e124-4400-af15-9a3559b4ffb6 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:28.839641 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efd80d-e124-4400-af15-9a3559b4ffb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:28.840079 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efd80d-e124-4400-af15-9a3559b4ffb6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:28.851909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45efd80d-e124-4400-af15-9a3559b4ffb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:28.863200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-45efd80d-e124-4400-af15-9a3559b4ffb6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:28.863200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:28.863200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:28.863200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:28.863200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:28.863200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:28.863200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:28.863200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:28.863200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:28.863200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:28.863200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:28.863200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:28.863200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:28.863200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:28.863200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:28.863200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:28.864235 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:28.864235 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:28.864235 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:28.864235 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:28.864235 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:28.864235 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:28.864235 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:28.864235 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:28.864235 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:28.864235 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:28.864235 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:28.864235 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:28.864235 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:28.864235 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:28.864235 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:28.864235 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:28.865214 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:28.865214 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:28.865214 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:28.865214 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:28.865214 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:28.865214 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:28.865214 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:28.865214 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:28.865214 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:28.865214 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:28.865214 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:28.865214 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:40:28.868126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 86/174] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:28.869470 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0f56d-4597-461c-8e15-d1c981827617 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:28.869905 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0f56d-4597-461c-8e15-d1c981827617 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:28.870377 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0f56d-4597-461c-8e15-d1c981827617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:28.893328 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-91d0f56d-4597-461c-8e15-d1c981827617 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:28.895318 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-91d0f56d-4597-461c-8e15-d1c981827617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:28.917454 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:28.937483 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 89/175] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:40:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:40:28.938361 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f72cdb-9d49-449f-8f03-e2b38dbf9d8e None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:28.986044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 87/176] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:28.986044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196e015-0dd3-4e2e-83f2-3f0dd8d382ad None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:28.986044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196e015-0dd3-4e2e-83f2-3f0dd8d382ad None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:28.986044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196e015-0dd3-4e2e-83f2-3f0dd8d382ad None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:28.986044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 88/177] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:28.986786 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196e015-0dd3-4e2e-83f2-3f0dd8d382ad None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:29.044463 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f72cdb-9d49-449f-8f03-e2b38dbf9d8e None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:29.052953 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:29.090184 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336943f-8eb2-4153-a307-e4ec73c31bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:29.091245 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336943f-8eb2-4153-a307-e4ec73c31bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:29.091723 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336943f-8eb2-4153-a307-e4ec73c31bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:29.092197 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336943f-8eb2-4153-a307-e4ec73c31bc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:29.093231 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336943f-8eb2-4153-a307-e4ec73c31bc1 None admin] RBAC: Adding query filter params (role.id=ad23f352111e42de99e9d92fbfe2e1f4, scope.project.id=f8f1415161a745f387f7c6563159c122, user.id=ff7d725fbdd346cbad2f26c6701d1cc5) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:29.093740 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336943f-8eb2-4153-a307-e4ec73c31bc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:29.095433 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336943f-8eb2-4153-a307-e4ec73c31bc1 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:29.105748 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 90/178] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:40:28 2022] GET /identity/v3/role_assignments?user.id=ff7d725fbdd346cbad2f26c6701d1cc5&scope.project.id=f8f1415161a745f387f7c6563159c122&role.id=ad23f352111e42de99e9d92fbfe2e1f4 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:29.107221 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336943f-8eb2-4153-a307-e4ec73c31bc1 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:29.135023 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196e015-0dd3-4e2e-83f2-3f0dd8d382ad None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:29.171293 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:29.187175 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac57d3f-b1e2-4279-bf87-3bd39940740f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:29.188031 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac57d3f-b1e2-4279-bf87-3bd39940740f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:29.188318 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac57d3f-b1e2-4279-bf87-3bd39940740f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:29.188587 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac57d3f-b1e2-4279-bf87-3bd39940740f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:29.202456 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac57d3f-b1e2-4279-bf87-3bd39940740f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:29.211436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-cac57d3f-b1e2-4279-bf87-3bd39940740f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 05:40:29.211436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:29.211436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:29.211436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:29.211436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:29.211436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:29.211436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:29.211436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:29.211436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:29.211436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:29.211436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:29.211436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:29.211436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:29.211436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:29.211436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:29.211436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:29.212419 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:29.212419 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:29.212419 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:29.212419 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:29.212419 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:29.212419 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:29.212419 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:29.212419 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:29.212419 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:29.212419 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:29.212419 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:29.212419 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:29.212419 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:29.212419 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:29.212419 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:29.212419 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:29.213223 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:29.213223 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:29.213223 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:29.213223 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:29.213223 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:29.213223 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:29.213223 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:29.213223 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:29.213223 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:29.213223 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:29.213223 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 05:40:29.213223 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:40:29.217723 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 89/179] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 21 05:40:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:29.218731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac57d3f-b1e2-4279-bf87-3bd39940740f None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:29.262072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336943f-8eb2-4153-a307-e4ec73c31bc1 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:29.306991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb49c0-9f23-43b7-9926-1c31109973da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:29.307669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb49c0-9f23-43b7-9926-1c31109973da None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:29.307949 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb49c0-9f23-43b7-9926-1c31109973da None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:29.308221 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb49c0-9f23-43b7-9926-1c31109973da None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:29.309151 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb49c0-9f23-43b7-9926-1c31109973da None admin] RBAC: Adding query filter params (name=member) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:29.309457 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb49c0-9f23-43b7-9926-1c31109973da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:29.311720 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb49c0-9f23-43b7-9926-1c31109973da None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:29.321988 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 91/180] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 21 05:40:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:29.323729 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf91ee-a5b2-4918-b14f-857d8cf8b332 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:29.324019 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf91ee-a5b2-4918-b14f-857d8cf8b332 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:29.324299 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf91ee-a5b2-4918-b14f-857d8cf8b332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:29.346690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-dcbf91ee-a5b2-4918-b14f-857d8cf8b332 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:29.348526 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-dcbf91ee-a5b2-4918-b14f-857d8cf8b332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:29.355928 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac57d3f-b1e2-4279-bf87-3bd39940740f None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:29.366127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:29.394089 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781a82b-5f9a-4273-832f-5dd9fc7ad7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:29.394950 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781a82b-5f9a-4273-832f-5dd9fc7ad7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:29.395258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781a82b-5f9a-4273-832f-5dd9fc7ad7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:29.395532 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781a82b-5f9a-4273-832f-5dd9fc7ad7f4 None admin] PATH_INFO: `/v3/projects/dcbbb8ba61db478b9e73e0c6d021ddfe` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:29.396729 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781a82b-5f9a-4273-832f-5dd9fc7ad7f4 None admin] RBAC: Authorizing `identity:get_project(project_id=dcbbb8ba61db478b9e73e0c6d021ddfe)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:29.398223 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781a82b-5f9a-4273-832f-5dd9fc7ad7f4 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:29.399918 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 90/181] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:29 2022] GET /identity/v3/projects/dcbbb8ba61db478b9e73e0c6d021ddfe => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:29.400681 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781a82b-5f9a-4273-832f-5dd9fc7ad7f4 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:29.431926 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 92/182] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:29.433261 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa81f08-e65c-4165-b030-87ab4ccfb644 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:29.433616 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa81f08-e65c-4165-b030-87ab4ccfb644 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:29.433915 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa81f08-e65c-4165-b030-87ab4ccfb644 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:29.436313 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 93/183] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:29.436313 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa81f08-e65c-4165-b030-87ab4ccfb644 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:29.477871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:29.518558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781a82b-5f9a-4273-832f-5dd9fc7ad7f4 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:29.557215 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa81f08-e65c-4165-b030-87ab4ccfb644 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:29.557420 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995302c-4080-471d-a550-f9193d36949c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:29.558529 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995302c-4080-471d-a550-f9193d36949c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:29.558999 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995302c-4080-471d-a550-f9193d36949c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:29.559553 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995302c-4080-471d-a550-f9193d36949c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:29.574630 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995302c-4080-471d-a550-f9193d36949c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:29.589594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-2995302c-4080-471d-a550-f9193d36949c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:40:29.589594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:29.589594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:29.589594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:29.589594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:29.589594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:29.589594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:29.589594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:29.589594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:29.589594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:29.589594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:29.589594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:29.589594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:29.589594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:29.589594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:29.589594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:29.590544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:29.590544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:29.590544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:29.590544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:29.590544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:29.590544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:29.590544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:29.590544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:29.590544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:29.590544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:29.590544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:29.590544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:29.590544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:29.590544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:29.590544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:29.590544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:29.591358 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:29.591358 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:29.591358 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:29.591358 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:29.591358 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:29.591358 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:29.591358 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:29.591358 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:29.591358 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:29.591358 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:29.591358 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:40:29.591358 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:40:29.591358 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 91/184] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:40:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:29.592238 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995302c-4080-471d-a550-f9193d36949c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:29.608542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af7018-ccb6-47be-99f4-03dfc0130f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:29.609208 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af7018-ccb6-47be-99f4-03dfc0130f76 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:29.609488 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af7018-ccb6-47be-99f4-03dfc0130f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:29.609758 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af7018-ccb6-47be-99f4-03dfc0130f76 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:29.610531 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af7018-ccb6-47be-99f4-03dfc0130f76 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:29.610833 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af7018-ccb6-47be-99f4-03dfc0130f76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:29.612279 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af7018-ccb6-47be-99f4-03dfc0130f76 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:29.621605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 94/185] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:40:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:29.622492 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af7018-ccb6-47be-99f4-03dfc0130f76 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:29.635768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:29.714876 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995302c-4080-471d-a550-f9193d36949c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:29.724221 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:29.728748 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af7018-ccb6-47be-99f4-03dfc0130f76 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:29.751682 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287de22-ce8c-43ea-b703-909d75da9e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:29.752588 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287de22-ce8c-43ea-b703-909d75da9e7b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:29.752867 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287de22-ce8c-43ea-b703-909d75da9e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:29.753142 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287de22-ce8c-43ea-b703-909d75da9e7b None admin] PATH_INFO: `/v3/users/ff7d725fbdd346cbad2f26c6701d1cc5` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:29.754585 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287de22-ce8c-43ea-b703-909d75da9e7b None admin] RBAC: Authorizing `identity:get_user(user_id=ff7d725fbdd346cbad2f26c6701d1cc5)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:29.756075 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287de22-ce8c-43ea-b703-909d75da9e7b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:29.757706 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 92/186] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:29 2022] GET /identity/v3/users/ff7d725fbdd346cbad2f26c6701d1cc5 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:29.758897 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82766a-b0b1-4cd2-94d8-0613f671f72b None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:29.759187 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82766a-b0b1-4cd2-94d8-0613f671f72b None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:29.759453 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82766a-b0b1-4cd2-94d8-0613f671f72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:29.769063 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126325b-ccb8-4030-a1f9-68774359b7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:29.770224 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126325b-ccb8-4030-a1f9-68774359b7ce None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:29.770224 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126325b-ccb8-4030-a1f9-68774359b7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:29.770224 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126325b-ccb8-4030-a1f9-68774359b7ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:29.771108 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126325b-ccb8-4030-a1f9-68774359b7ce None admin] RBAC: Adding query filter params (role.id=a9602a7e01694084a0f9713d9d6394b1, scope.project.id=dcbbb8ba61db478b9e73e0c6d021ddfe, user.id=ff7d725fbdd346cbad2f26c6701d1cc5) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:29.771420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126325b-ccb8-4030-a1f9-68774359b7ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:29.772938 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126325b-ccb8-4030-a1f9-68774359b7ce None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:29.777346 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-2f82766a-b0b1-4cd2-94d8-0613f671f72b None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:29.778561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-2f82766a-b0b1-4cd2-94d8-0613f671f72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:29.780937 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 95/187] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:40:29 2022] GET /identity/v3/role_assignments?user.id=ff7d725fbdd346cbad2f26c6701d1cc5&scope.project.id=dcbbb8ba61db478b9e73e0c6d021ddfe&role.id=a9602a7e01694084a0f9713d9d6394b1 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:29.780937 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126325b-ccb8-4030-a1f9-68774359b7ce None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:29.868954 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 93/188] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:29.870909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82766a-b0b1-4cd2-94d8-0613f671f72b None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:29.907659 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:29.935710 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126325b-ccb8-4030-a1f9-68774359b7ce None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:29.987085 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259676b-0ba8-4629-ad06-575d06712806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:29.988189 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259676b-0ba8-4629-ad06-575d06712806 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:29.988484 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259676b-0ba8-4629-ad06-575d06712806 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:29.988771 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259676b-0ba8-4629-ad06-575d06712806 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:29.990644 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259676b-0ba8-4629-ad06-575d06712806 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:29.992398 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259676b-0ba8-4629-ad06-575d06712806 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:29.994299 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 96/189] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:40:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:29.995757 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259676b-0ba8-4629-ad06-575d06712806 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:30.000376 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82766a-b0b1-4cd2-94d8-0613f671f72b None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:30.034021 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:30.049310 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bdd75-9283-4fd2-a463-fafcd928b785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:30.050390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bdd75-9283-4fd2-a463-fafcd928b785 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:30.050701 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bdd75-9283-4fd2-a463-fafcd928b785 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:30.050986 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bdd75-9283-4fd2-a463-fafcd928b785 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:30.052673 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210bdd75-9283-4fd2-a463-fafcd928b785 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:30.052673 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210bdd75-9283-4fd2-a463-fafcd928b785 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:30.053465 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210bdd75-9283-4fd2-a463-fafcd928b785 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:30.062735 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 94/190] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:30.067198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bdd75-9283-4fd2-a463-fafcd928b785 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:30.116045 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259676b-0ba8-4629-ad06-575d06712806 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:30.155391 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733698e-ca4e-49ad-9207-3edb30948490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:30.156281 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733698e-ca4e-49ad-9207-3edb30948490 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:30.156623 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733698e-ca4e-49ad-9207-3edb30948490 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:30.156828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733698e-ca4e-49ad-9207-3edb30948490 None admin] PATH_INFO: `/v3/users/0dec7bd85c6c473db9cd6091e1ab7dea` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:30.173415 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733698e-ca4e-49ad-9207-3edb30948490 None admin] RBAC: Authorizing `identity:get_user(user_id=0dec7bd85c6c473db9cd6091e1ab7dea)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:30.175380 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733698e-ca4e-49ad-9207-3edb30948490 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:30.177119 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 97/191] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:29 2022] GET /identity/v3/users/0dec7bd85c6c473db9cd6091e1ab7dea => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:30.177899 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733698e-ca4e-49ad-9207-3edb30948490 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:30.180841 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:30.188428 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bdd75-9283-4fd2-a463-fafcd928b785 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:30.224005 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3ac63-5392-4d53-ac6a-6d4da1b2e849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:30.224665 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3ac63-5392-4d53-ac6a-6d4da1b2e849 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:30.224954 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3ac63-5392-4d53-ac6a-6d4da1b2e849 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:30.225231 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3ac63-5392-4d53-ac6a-6d4da1b2e849 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:30.274975 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:30.287842 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733698e-ca4e-49ad-9207-3edb30948490 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:30.304339 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3ac63-5392-4d53-ac6a-6d4da1b2e849 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:30.305805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3ac63-5392-4d53-ac6a-6d4da1b2e849 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:30.325645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb2605-d9e0-47bb-a6bb-5e47233a18dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:30.326468 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb2605-d9e0-47bb-a6bb-5e47233a18dc None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:30.326793 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb2605-d9e0-47bb-a6bb-5e47233a18dc None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:30.327070 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb2605-d9e0-47bb-a6bb-5e47233a18dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:30.338419 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb2605-d9e0-47bb-a6bb-5e47233a18dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:30.346158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-09eb2605-d9e0-47bb-a6bb-5e47233a18dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 05:40:30.346158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:30.346158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:30.346158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:30.346158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:30.346158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:30.346158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:30.346158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:30.346158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:30.346158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:30.346158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:30.346158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:30.346158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:30.346158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:30.346158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:30.346158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:30.347072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:30.347072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:30.347072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:30.347072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:30.347072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:30.347072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:30.347072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:30.347072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:30.347072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:30.347072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:30.347072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:30.347072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:30.347072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:30.347072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:30.347072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:30.347072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:30.347922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:30.347922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:30.347922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:30.347922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:30.347922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:30.347922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:30.347922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:30.347922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:30.347922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:30.347922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:30.347922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 05:40:30.347922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:40:30.347922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 98/192] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:30.349336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb2605-d9e0-47bb-a6bb-5e47233a18dc None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:30.410145 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:30.418287 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 95/193] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:40:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:40:30.419116 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3ac63-5392-4d53-ac6a-6d4da1b2e849 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:30.470614 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb2605-d9e0-47bb-a6bb-5e47233a18dc None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:30.511362 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e75f71-8a8a-4e4a-b2a5-d7eef43429b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:30.512057 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e75f71-8a8a-4e4a-b2a5-d7eef43429b7 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:30.512396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e75f71-8a8a-4e4a-b2a5-d7eef43429b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:30.513114 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e75f71-8a8a-4e4a-b2a5-d7eef43429b7 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:30.513842 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e75f71-8a8a-4e4a-b2a5-d7eef43429b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:30.515358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e75f71-8a8a-4e4a-b2a5-d7eef43429b7 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:30.526476 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3ac63-5392-4d53-ac6a-6d4da1b2e849 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:30.550767 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 99/194] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 21 05:40:30 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:40:30.550767 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e75f71-8a8a-4e4a-b2a5-d7eef43429b7 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:30.553259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:30.573399 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0740d-f6c3-4762-b30c-c4d52a7335e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:30.574706 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0740d-f6c3-4762-b30c-c4d52a7335e6 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:30.575193 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0740d-f6c3-4762-b30c-c4d52a7335e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:30.575652 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0740d-f6c3-4762-b30c-c4d52a7335e6 None admin] PATH_INFO: `/v3/users/0dec7bd85c6c473db9cd6091e1ab7dea` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:30.577370 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0740d-f6c3-4762-b30c-c4d52a7335e6 None admin] RBAC: Authorizing `identity:get_user(user_id=0dec7bd85c6c473db9cd6091e1ab7dea)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:30.578973 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0740d-f6c3-4762-b30c-c4d52a7335e6 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:30.580966 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 96/195] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:30 2022] GET /identity/v3/users/0dec7bd85c6c473db9cd6091e1ab7dea => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:30.581768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0740d-f6c3-4762-b30c-c4d52a7335e6 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:30.672158 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:30.703073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e75f71-8a8a-4e4a-b2a5-d7eef43429b7 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:30.732291 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0740d-f6c3-4762-b30c-c4d52a7335e6 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:30.755305 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd9fe1-5f1a-47d3-891c-7b7649d4d925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:30.756043 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd9fe1-5f1a-47d3-891c-7b7649d4d925 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:30.756258 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd9fe1-5f1a-47d3-891c-7b7649d4d925 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:30.757305 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd9fe1-5f1a-47d3-891c-7b7649d4d925 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:30.776434 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d690678-5c11-40a4-be48-d65151588efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:30.777211 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d690678-5c11-40a4-be48-d65151588efb None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:30.777408 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d690678-5c11-40a4-be48-d65151588efb None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:30.777691 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d690678-5c11-40a4-be48-d65151588efb None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:30.778480 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d690678-5c11-40a4-be48-d65151588efb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:30.779539 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d690678-5c11-40a4-be48-d65151588efb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:30.780180 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d690678-5c11-40a4-be48-d65151588efb None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:30.791206 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 97/196] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 21 05:40:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:30.792194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d690678-5c11-40a4-be48-d65151588efb None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:30.854375 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd9fe1-5f1a-47d3-891c-7b7649d4d925 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:30.857517 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd9fe1-5f1a-47d3-891c-7b7649d4d925 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:30.862360 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:30.929643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d690678-5c11-40a4-be48-d65151588efb None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:30.958346 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:30.977963 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f2a1b-354d-4357-9fb4-9f44c600a81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:30.977963 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f2a1b-354d-4357-9fb4-9f44c600a81b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:30.977963 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f2a1b-354d-4357-9fb4-9f44c600a81b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:30.977963 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f2a1b-354d-4357-9fb4-9f44c600a81b None admin] PATH_INFO: `/v3/projects/f8f1415161a745f387f7c6563159c122` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:30.978359 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f2a1b-354d-4357-9fb4-9f44c600a81b None admin] RBAC: Authorizing `identity:get_project(project_id=f8f1415161a745f387f7c6563159c122)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:30.978945 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f2a1b-354d-4357-9fb4-9f44c600a81b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:30.980870 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 98/197] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:30 2022] GET /identity/v3/projects/f8f1415161a745f387f7c6563159c122 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:30.982127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f2a1b-354d-4357-9fb4-9f44c600a81b None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:31.006843 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 100/198] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:40:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:40:31.007724 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd9fe1-5f1a-47d3-891c-7b7649d4d925 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:31.125090 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f2a1b-354d-4357-9fb4-9f44c600a81b None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:31.128623 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd9fe1-5f1a-47d3-891c-7b7649d4d925 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:31.131357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:31.171210 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9fb0e-36c5-4245-be74-d37f822cc618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:31.171598 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba65289-7723-4b8b-9b7c-2b2f54133def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:31.172274 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba65289-7723-4b8b-9b7c-2b2f54133def None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:31.172561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba65289-7723-4b8b-9b7c-2b2f54133def None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:31.172842 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba65289-7723-4b8b-9b7c-2b2f54133def None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:31.173308 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9fb0e-36c5-4245-be74-d37f822cc618 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:31.173924 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9fb0e-36c5-4245-be74-d37f822cc618 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:31.174433 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9fb0e-36c5-4245-be74-d37f822cc618 None admin] PATH_INFO: `/v3/users/bc6a628b683a42008a8465f366eff414` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:31.175903 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9fb0e-36c5-4245-be74-d37f822cc618 None admin] RBAC: Authorizing `identity:get_user(user_id=bc6a628b683a42008a8465f366eff414)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:31.177594 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9fb0e-36c5-4245-be74-d37f822cc618 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:31.179709 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 101/199] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:31 2022] GET /identity/v3/users/bc6a628b683a42008a8465f366eff414 => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:31.180959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9fb0e-36c5-4245-be74-d37f822cc618 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:31.254197 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:31.271178 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba65289-7723-4b8b-9b7c-2b2f54133def None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:31.273234 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba65289-7723-4b8b-9b7c-2b2f54133def None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:31.293205 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9fb0e-36c5-4245-be74-d37f822cc618 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:31.331853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdaf6e-958b-4b36-8b28-091fb95b8e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:31.333348 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdaf6e-958b-4b36-8b28-091fb95b8e73 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:31.334006 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdaf6e-958b-4b36-8b28-091fb95b8e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:31.334619 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdaf6e-958b-4b36-8b28-091fb95b8e73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:31.335671 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdaf6e-958b-4b36-8b28-091fb95b8e73 None admin] RBAC: Adding query filter params (role.id=a9602a7e01694084a0f9713d9d6394b1, scope.project.id=f8f1415161a745f387f7c6563159c122, user.id=ff7d725fbdd346cbad2f26c6701d1cc5) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:31.336491 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdaf6e-958b-4b36-8b28-091fb95b8e73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:31.338610 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdaf6e-958b-4b36-8b28-091fb95b8e73 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:31.348790 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 102/200] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:40:31 2022] GET /identity/v3/role_assignments?user.id=ff7d725fbdd346cbad2f26c6701d1cc5&scope.project.id=f8f1415161a745f387f7c6563159c122&role.id=a9602a7e01694084a0f9713d9d6394b1 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:31.350338 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdaf6e-958b-4b36-8b28-091fb95b8e73 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:31.411142 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:31.421654 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 99/201] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:40:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:40:31.422602 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba65289-7723-4b8b-9b7c-2b2f54133def None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:31.569367 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdaf6e-958b-4b36-8b28-091fb95b8e73 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:31.590535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:31.607236 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba65289-7723-4b8b-9b7c-2b2f54133def None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:31.621766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be0009-c6fd-404a-b2f9-46519daea38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:31.622793 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be0009-c6fd-404a-b2f9-46519daea38c None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:31.623074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be0009-c6fd-404a-b2f9-46519daea38c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:31.623352 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be0009-c6fd-404a-b2f9-46519daea38c None admin] PATH_INFO: `/v3/projects/6b293e7dd1fa40ad886795d229901112` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:31.624593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be0009-c6fd-404a-b2f9-46519daea38c None admin] RBAC: Authorizing `identity:get_project(project_id=6b293e7dd1fa40ad886795d229901112)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:31.626339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be0009-c6fd-404a-b2f9-46519daea38c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:31.628650 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 103/202] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:31 2022] GET /identity/v3/projects/6b293e7dd1fa40ad886795d229901112 => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:31.629517 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be0009-c6fd-404a-b2f9-46519daea38c None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:31.649702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998a972-128e-4179-8ffa-720f2c01e419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:31.650397 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998a972-128e-4179-8ffa-720f2c01e419 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:31.650742 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998a972-128e-4179-8ffa-720f2c01e419 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:31.651027 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998a972-128e-4179-8ffa-720f2c01e419 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:31.743800 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998a972-128e-4179-8ffa-720f2c01e419 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:31.745194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998a972-128e-4179-8ffa-720f2c01e419 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:31.769751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be0009-c6fd-404a-b2f9-46519daea38c None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:31.773900 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:31.819751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0dec97-7247-47a4-906e-3b796a3599f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:31.821003 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dec97-7247-47a4-906e-3b796a3599f7 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:31.821523 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dec97-7247-47a4-906e-3b796a3599f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:31.822136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dec97-7247-47a4-906e-3b796a3599f7 None admin] PATH_INFO: `/v3/projects/6b293e7dd1fa40ad886795d229901112` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:31.823619 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0dec97-7247-47a4-906e-3b796a3599f7 None admin] RBAC: Authorizing `identity:get_project(project_id=6b293e7dd1fa40ad886795d229901112)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:31.826069 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0dec97-7247-47a4-906e-3b796a3599f7 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:31.828863 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 104/203] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:31 2022] GET /identity/v3/projects/6b293e7dd1fa40ad886795d229901112 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:31.830441 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0dec97-7247-47a4-906e-3b796a3599f7 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:31.878212 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:31.896128 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 100/204] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:40:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:40:31.902830 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998a972-128e-4179-8ffa-720f2c01e419 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:31.965422 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0dec97-7247-47a4-906e-3b796a3599f7 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:32.022198 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684279b8-9577-4e2c-aa5d-1a065d606cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:32.022965 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684279b8-9577-4e2c-aa5d-1a065d606cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:32.023531 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684279b8-9577-4e2c-aa5d-1a065d606cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:32.023696 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684279b8-9577-4e2c-aa5d-1a065d606cb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:32.024652 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684279b8-9577-4e2c-aa5d-1a065d606cb7 None admin] RBAC: Adding query filter params (role.id=ad23f352111e42de99e9d92fbfe2e1f4, scope.project.id=6b293e7dd1fa40ad886795d229901112, user.id=0dec7bd85c6c473db9cd6091e1ab7dea) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:32.025059 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684279b8-9577-4e2c-aa5d-1a065d606cb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:32.026648 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684279b8-9577-4e2c-aa5d-1a065d606cb7 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:32.031408 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998a972-128e-4179-8ffa-720f2c01e419 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:32.032899 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 105/205] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:40:31 2022] GET /identity/v3/role_assignments?user.id=0dec7bd85c6c473db9cd6091e1ab7dea&scope.project.id=6b293e7dd1fa40ad886795d229901112&role.id=ad23f352111e42de99e9d92fbfe2e1f4 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:32.035735 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684279b8-9577-4e2c-aa5d-1a065d606cb7 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:32.076987 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a485c6f-3ad7-41ff-a4d0-0eebd6ddae98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:32.078107 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a485c6f-3ad7-41ff-a4d0-0eebd6ddae98 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:32.078547 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a485c6f-3ad7-41ff-a4d0-0eebd6ddae98 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:32.079005 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a485c6f-3ad7-41ff-a4d0-0eebd6ddae98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:32.080989 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a485c6f-3ad7-41ff-a4d0-0eebd6ddae98 None admin] RBAC: Adding query filter params (role.id=24aa6040c86049f996560e477e83886f, scope.project.id=6b293e7dd1fa40ad886795d229901112, user.id=0dec7bd85c6c473db9cd6091e1ab7dea) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:32.081462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a485c6f-3ad7-41ff-a4d0-0eebd6ddae98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:32.083790 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a485c6f-3ad7-41ff-a4d0-0eebd6ddae98 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:32.091575 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 101/206] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:40:31 2022] GET /identity/v3/role_assignments?user.id=0dec7bd85c6c473db9cd6091e1ab7dea&scope.project.id=6b293e7dd1fa40ad886795d229901112&role.id=24aa6040c86049f996560e477e83886f => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:32.128858 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:32.210302 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684279b8-9577-4e2c-aa5d-1a065d606cb7 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:32.254578 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81386ed0-dccf-4db2-8d44-b671572d32cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:32.255474 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81386ed0-dccf-4db2-8d44-b671572d32cc None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:32.255764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81386ed0-dccf-4db2-8d44-b671572d32cc None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:32.256045 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81386ed0-dccf-4db2-8d44-b671572d32cc None admin] PATH_INFO: `/v3/projects/f8f1415161a745f387f7c6563159c122` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:32.257471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81386ed0-dccf-4db2-8d44-b671572d32cc None admin] RBAC: Authorizing `identity:get_project(project_id=f8f1415161a745f387f7c6563159c122)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:32.259047 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81386ed0-dccf-4db2-8d44-b671572d32cc None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:32.260818 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 106/207] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:32 2022] GET /identity/v3/projects/f8f1415161a745f387f7c6563159c122 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:32.266759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a485c6f-3ad7-41ff-a4d0-0eebd6ddae98 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:32.337431 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:32.387330 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a485c6f-3ad7-41ff-a4d0-0eebd6ddae98 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:32.425086 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997138f4-79d3-4630-9a3a-ba77aa6b6a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:32.425756 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997138f4-79d3-4630-9a3a-ba77aa6b6a0e None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:32.426076 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997138f4-79d3-4630-9a3a-ba77aa6b6a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:32.426362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997138f4-79d3-4630-9a3a-ba77aa6b6a0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:32.427215 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997138f4-79d3-4630-9a3a-ba77aa6b6a0e None admin] RBAC: Adding query filter params (role.id=3e721e6a74074d32bb3d80dad6e9974e, scope.project.id=f8f1415161a745f387f7c6563159c122, user.id=bc6a628b683a42008a8465f366eff414) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:32.427534 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997138f4-79d3-4630-9a3a-ba77aa6b6a0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:32.429117 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997138f4-79d3-4630-9a3a-ba77aa6b6a0e None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:32.435975 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 102/208] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:40:32 2022] GET /identity/v3/role_assignments?user.id=bc6a628b683a42008a8465f366eff414&scope.project.id=f8f1415161a745f387f7c6563159c122&role.id=3e721e6a74074d32bb3d80dad6e9974e => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:32.895186 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7299f0c-23a8-4f0a-ac92-e51748d4470c None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:32.895712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7299f0c-23a8-4f0a-ac92-e51748d4470c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:32.895712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7299f0c-23a8-4f0a-ac92-e51748d4470c None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:32.897114 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 107/209] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:32.903382 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3cb0d-ef45-4cc6-a87b-ac44e52732cd None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:32.903900 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3cb0d-ef45-4cc6-a87b-ac44e52732cd None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:32.904178 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3cb0d-ef45-4cc6-a87b-ac44e52732cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:32.922878 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-10a3cb0d-ef45-4cc6-a87b-ac44e52732cd None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:32.924123 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-10a3cb0d-ef45-4cc6-a87b-ac44e52732cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:33.005319 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 103/210] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:33.029689 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7299f0c-23a8-4f0a-ac92-e51748d4470c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:33.088113 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb79c1e-2c9b-4c17-b6fc-df9e95f0ff3a None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:33.088424 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb79c1e-2c9b-4c17-b6fc-df9e95f0ff3a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:33.088698 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb79c1e-2c9b-4c17-b6fc-df9e95f0ff3a None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:33.091115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 104/211] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:33.095965 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7bf6e6-a8b1-4fb9-9505-5dd940178930 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:33.096267 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7bf6e6-a8b1-4fb9-9505-5dd940178930 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:33.096653 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7bf6e6-a8b1-4fb9-9505-5dd940178930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:33.115064 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-5c7bf6e6-a8b1-4fb9-9505-5dd940178930 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:33.116279 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-5c7bf6e6-a8b1-4fb9-9505-5dd940178930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:33.155507 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7299f0c-23a8-4f0a-ac92-e51748d4470c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:33.158571 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:33.168429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:33.196323 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 105/212] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:33.199537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9dc06-8b16-4059-9267-2016d3018fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:33.200524 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9dc06-8b16-4059-9267-2016d3018fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:33.200938 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9dc06-8b16-4059-9267-2016d3018fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:33.201344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9dc06-8b16-4059-9267-2016d3018fb3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:33.213074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9dc06-8b16-4059-9267-2016d3018fb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:33.221313 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-32a9dc06-8b16-4059-9267-2016d3018fb3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:33.221313 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:33.221313 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:33.221313 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:33.221313 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:33.221313 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:33.221313 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:33.221313 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:33.221313 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:33.221313 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:33.221313 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:33.221313 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:33.221313 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:33.221313 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:33.221313 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:33.221313 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:33.222451 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:33.222451 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:33.222451 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:33.222451 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:33.222451 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:33.222451 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:33.222451 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:33.222451 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:33.222451 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:33.222451 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:33.222451 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:33.222451 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:33.222451 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:33.222451 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:33.222451 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:33.222451 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:33.223444 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:33.223444 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:33.223444 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:33.223444 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:33.223444 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:33.223444 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:33.223444 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:33.223444 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:33.223444 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:33.223444 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:33.223444 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:33.223444 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:40:33.225693 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 108/213] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:33.225966 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7bf6e6-a8b1-4fb9-9505-5dd940178930 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:33.234914 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9dc06-8b16-4059-9267-2016d3018fb3 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:33.350846 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7bf6e6-a8b1-4fb9-9505-5dd940178930 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:33.364479 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9dc06-8b16-4059-9267-2016d3018fb3 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:33.401462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9344bb-f09c-4a6f-b8a4-b3c99ed5c73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:33.402905 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9344bb-f09c-4a6f-b8a4-b3c99ed5c73b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:33.403400 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9344bb-f09c-4a6f-b8a4-b3c99ed5c73b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:33.403918 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9344bb-f09c-4a6f-b8a4-b3c99ed5c73b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:33.405730 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9344bb-f09c-4a6f-b8a4-b3c99ed5c73b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:33.406318 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e4615-914e-47d7-8364-786ca18a93ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:33.407091 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e4615-914e-47d7-8364-786ca18a93ca None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:33.407488 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e4615-914e-47d7-8364-786ca18a93ca None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:33.407852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9344bb-f09c-4a6f-b8a4-b3c99ed5c73b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:33.407986 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e4615-914e-47d7-8364-786ca18a93ca None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:33.408871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e4615-914e-47d7-8364-786ca18a93ca None admin] RBAC: Adding query filter params (name=member) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:33.409275 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e4615-914e-47d7-8364-786ca18a93ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:33.414683 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e4615-914e-47d7-8364-786ca18a93ca None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:33.415137 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 106/214] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:40:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:33.416775 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9344bb-f09c-4a6f-b8a4-b3c99ed5c73b None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:33.427479 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 109/215] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 21 05:40:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:33.439920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e4615-914e-47d7-8364-786ca18a93ca None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:33.479325 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:33.483282 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:33.557586 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9344bb-f09c-4a6f-b8a4-b3c99ed5c73b None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:33.588973 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e4615-914e-47d7-8364-786ca18a93ca None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:33.602914 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41225a5-9648-489c-9a70-6347e7d3f6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:33.603762 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41225a5-9648-489c-9a70-6347e7d3f6b7 None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:33.604142 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41225a5-9648-489c-9a70-6347e7d3f6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:33.604526 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41225a5-9648-489c-9a70-6347e7d3f6b7 None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:33.605352 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41225a5-9648-489c-9a70-6347e7d3f6b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:33.607249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41225a5-9648-489c-9a70-6347e7d3f6b7 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:33.641961 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 107/216] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 21 05:40:33 2022] POST /identity/v3/users => generated 297 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:40:33.644161 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420e9fc-d028-4d7a-8c9f-06677dbb671d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:33.645168 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420e9fc-d028-4d7a-8c9f-06677dbb671d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:33.645455 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420e9fc-d028-4d7a-8c9f-06677dbb671d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:33.645719 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420e9fc-d028-4d7a-8c9f-06677dbb671d None admin] PATH_INFO: `/v3/users/0fdf518fa39e4e6b9594b98c225c3816` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:33.664026 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420e9fc-d028-4d7a-8c9f-06677dbb671d None admin] RBAC: Authorizing `identity:get_user(user_id=0fdf518fa39e4e6b9594b98c225c3816)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:33.665476 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420e9fc-d028-4d7a-8c9f-06677dbb671d None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:33.667723 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 110/217] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:33 2022] GET /identity/v3/users/0fdf518fa39e4e6b9594b98c225c3816 => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:33.673593 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41225a5-9648-489c-9a70-6347e7d3f6b7 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:33.798225 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41225a5-9648-489c-9a70-6347e7d3f6b7 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:33.801527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:33.848958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc63456-9e26-421d-8d1b-a57baa45c7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:33.850121 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc63456-9e26-421d-8d1b-a57baa45c7d0 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:33.850622 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc63456-9e26-421d-8d1b-a57baa45c7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:33.851096 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc63456-9e26-421d-8d1b-a57baa45c7d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:33.937718 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc63456-9e26-421d-8d1b-a57baa45c7d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:33.939320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc63456-9e26-421d-8d1b-a57baa45c7d0 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:34.058800 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 108/218] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:40:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:40:34.064498 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420e9fc-d028-4d7a-8c9f-06677dbb671d None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:34.161335 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:34.182652 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420e9fc-d028-4d7a-8c9f-06677dbb671d None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:34.228978 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e6d15-c526-4dc4-a2dd-4dd3d772f669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:34.229745 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e6d15-c526-4dc4-a2dd-4dd3d772f669 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:34.230063 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e6d15-c526-4dc4-a2dd-4dd3d772f669 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:34.230313 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e6d15-c526-4dc4-a2dd-4dd3d772f669 None admin] PATH_INFO: `/v3/projects/6b293e7dd1fa40ad886795d229901112` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:34.231533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e6d15-c526-4dc4-a2dd-4dd3d772f669 None admin] RBAC: Authorizing `identity:get_project(project_id=6b293e7dd1fa40ad886795d229901112)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:34.233278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e6d15-c526-4dc4-a2dd-4dd3d772f669 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:34.235212 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 111/219] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:34 2022] GET /identity/v3/projects/6b293e7dd1fa40ad886795d229901112 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:34.240833 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc63456-9e26-421d-8d1b-a57baa45c7d0 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:34.244982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:34.380248 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9fd17-9364-47c4-b459-f55631cba905 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:34.380574 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9fd17-9364-47c4-b459-f55631cba905 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:34.380821 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9fd17-9364-47c4-b459-f55631cba905 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:34.382616 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 112/220] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:34.388104 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514a972-4057-4a07-bd11-e4806f28535a None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:34.388399 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514a972-4057-4a07-bd11-e4806f28535a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:34.388673 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514a972-4057-4a07-bd11-e4806f28535a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:34.406534 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-e514a972-4057-4a07-bd11-e4806f28535a None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:34.407761 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e514a972-4057-4a07-bd11-e4806f28535a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:34.432424 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc63456-9e26-421d-8d1b-a57baa45c7d0 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:34.500683 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbfd74-4d69-472f-8c68-200c0d4e7163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:34.501277 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbfd74-4d69-472f-8c68-200c0d4e7163 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:34.501559 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbfd74-4d69-472f-8c68-200c0d4e7163 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:34.502439 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbfd74-4d69-472f-8c68-200c0d4e7163 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:34.503254 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbfd74-4d69-472f-8c68-200c0d4e7163 None admin] RBAC: Adding query filter params (role.id=a9602a7e01694084a0f9713d9d6394b1, scope.project.id=6b293e7dd1fa40ad886795d229901112, user.id=0fdf518fa39e4e6b9594b98c225c3816) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:34.503566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbfd74-4d69-472f-8c68-200c0d4e7163 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:34.506584 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbfd74-4d69-472f-8c68-200c0d4e7163 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:34.519781 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 109/221] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:40:34 2022] GET /identity/v3/role_assignments?user.id=0fdf518fa39e4e6b9594b98c225c3816&scope.project.id=6b293e7dd1fa40ad886795d229901112&role.id=a9602a7e01694084a0f9713d9d6394b1 => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:34.536436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d39eef-1750-4ae3-9958-53f56c2d0f32 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:34.536749 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d39eef-1750-4ae3-9958-53f56c2d0f32 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:34.537007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d39eef-1750-4ae3-9958-53f56c2d0f32 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:34.542968 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 110/222] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 05:40:34.544840 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12035c-98dc-4ea3-a2d0-b42e5a38cb7d None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:34.545217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12035c-98dc-4ea3-a2d0-b42e5a38cb7d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:34.545581 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12035c-98dc-4ea3-a2d0-b42e5a38cb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:34.575094 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 113/223] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 05:40:34.576168 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-8e12035c-98dc-4ea3-a2d0-b42e5a38cb7d None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:34.577453 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-8e12035c-98dc-4ea3-a2d0-b42e5a38cb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:34.610691 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514a972-4057-4a07-bd11-e4806f28535a None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:34.699768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 111/224] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:34.701647 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:34.727012 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12035c-98dc-4ea3-a2d0-b42e5a38cb7d None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:34.742217 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:34.769179 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514a972-4057-4a07-bd11-e4806f28535a None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:34.853447 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13415e21-21c5-49ce-9ffe-31ade82d7601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:34.862448 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13415e21-21c5-49ce-9ffe-31ade82d7601 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:34.862741 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13415e21-21c5-49ce-9ffe-31ade82d7601 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:34.863025 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13415e21-21c5-49ce-9ffe-31ade82d7601 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:34.881213 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12035c-98dc-4ea3-a2d0-b42e5a38cb7d None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:34.900477 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13415e21-21c5-49ce-9ffe-31ade82d7601 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:34.908766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-13415e21-21c5-49ce-9ffe-31ade82d7601 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 05:40:34.908766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:34.908766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:34.908766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:34.908766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:34.908766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:34.908766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:34.908766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:34.908766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:34.908766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:34.908766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:34.908766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:34.908766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:34.908766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:34.908766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:34.908766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:34.909680 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:34.909680 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:34.909680 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:34.909680 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:34.909680 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:34.909680 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:34.909680 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:34.909680 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:34.909680 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:34.909680 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:34.909680 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:34.909680 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:34.909680 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:34.909680 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:34.909680 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:34.909680 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:34.910516 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:34.910516 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:34.910516 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:34.910516 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:34.910516 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:34.910516 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:34.910516 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:34.910516 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:34.910516 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:34.910516 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:34.910516 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 05:40:34.910516 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:40:34.921675 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 114/225] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 21 05:40:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:40:34.922658 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13415e21-21c5-49ce-9ffe-31ade82d7601 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:34.944738 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dcd288-f625-4e3b-ba1c-a8b1293bb64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:34.945552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcd288-f625-4e3b-ba1c-a8b1293bb64b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:34.945835 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcd288-f625-4e3b-ba1c-a8b1293bb64b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:34.946146 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcd288-f625-4e3b-ba1c-a8b1293bb64b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:34.971051 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dcd288-f625-4e3b-ba1c-a8b1293bb64b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:34.978916 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-d7dcd288-f625-4e3b-ba1c-a8b1293bb64b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:40:34.978916 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:34.978916 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:34.978916 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:34.978916 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:34.978916 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:34.978916 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:34.978916 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:34.978916 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:34.978916 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:34.978916 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:34.978916 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:34.978916 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:34.978916 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:34.978916 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:34.978916 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:34.979792 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:34.979792 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:34.979792 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:34.979792 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:34.979792 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:34.979792 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:34.979792 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:34.979792 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:34.979792 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:34.979792 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:34.979792 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:34.979792 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:34.979792 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:34.979792 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:34.979792 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:34.979792 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:34.980756 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:34.980756 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:34.980756 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:34.980756 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:34.980756 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:34.980756 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:34.980756 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:34.980756 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:34.980756 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:34.980756 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:34.980756 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:40:34.980756 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:40:34.980756 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 112/226] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:40:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:34.994990 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dcd288-f625-4e3b-ba1c-a8b1293bb64b None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:35.067495 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13415e21-21c5-49ce-9ffe-31ade82d7601 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:35.110714 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38a10c-fcec-4bde-816d-bfa74c91886a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:35.111665 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38a10c-fcec-4bde-816d-bfa74c91886a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:35.111904 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38a10c-fcec-4bde-816d-bfa74c91886a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:35.112136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38a10c-fcec-4bde-816d-bfa74c91886a None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:35.113256 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38a10c-fcec-4bde-816d-bfa74c91886a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:35.113580 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38a10c-fcec-4bde-816d-bfa74c91886a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:35.117961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38a10c-fcec-4bde-816d-bfa74c91886a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:35.124559 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 115/227] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:40:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:35.130448 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38a10c-fcec-4bde-816d-bfa74c91886a None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:35.135067 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:35.146373 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:35.252890 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dcd288-f625-4e3b-ba1c-a8b1293bb64b None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:35.268638 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38a10c-fcec-4bde-816d-bfa74c91886a None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:35.302242 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b61a4a-6673-4022-8887-0d4855cc83c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:35.302926 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b61a4a-6673-4022-8887-0d4855cc83c2 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:35.303259 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b61a4a-6673-4022-8887-0d4855cc83c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:35.303549 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b61a4a-6673-4022-8887-0d4855cc83c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:35.304304 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b61a4a-6673-4022-8887-0d4855cc83c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:35.304616 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b61a4a-6673-4022-8887-0d4855cc83c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:35.306027 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b61a4a-6673-4022-8887-0d4855cc83c2 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:35.315453 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 113/228] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:35.320713 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b61a4a-6673-4022-8887-0d4855cc83c2 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:35.367173 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68747385-b150-4440-ac23-035b43eec834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:35.368072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68747385-b150-4440-ac23-035b43eec834 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:35.368355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68747385-b150-4440-ac23-035b43eec834 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:35.368633 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68747385-b150-4440-ac23-035b43eec834 None admin] PATH_INFO: `/v3/users/0dec7bd85c6c473db9cd6091e1ab7dea` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:35.370737 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68747385-b150-4440-ac23-035b43eec834 None admin] RBAC: Authorizing `identity:get_user(user_id=0dec7bd85c6c473db9cd6091e1ab7dea)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:35.372457 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68747385-b150-4440-ac23-035b43eec834 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:35.374569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 116/229] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:35 2022] GET /identity/v3/users/0dec7bd85c6c473db9cd6091e1ab7dea => generated 283 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:40:35.380598 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68747385-b150-4440-ac23-035b43eec834 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:35.438158 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b61a4a-6673-4022-8887-0d4855cc83c2 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:35.460996 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:35.475913 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f9da2-5dfe-4b18-8ed0-5b9c343953cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:35.476845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f9da2-5dfe-4b18-8ed0-5b9c343953cb None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:35.477133 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f9da2-5dfe-4b18-8ed0-5b9c343953cb None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:35.477407 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f9da2-5dfe-4b18-8ed0-5b9c343953cb None admin] PATH_INFO: `/v3/users/0dec7bd85c6c473db9cd6091e1ab7dea` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:35.478833 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f9da2-5dfe-4b18-8ed0-5b9c343953cb None admin] RBAC: Authorizing `identity:get_user(user_id=0dec7bd85c6c473db9cd6091e1ab7dea)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:35.485959 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f9da2-5dfe-4b18-8ed0-5b9c343953cb None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:35.485959 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 114/230] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:35 2022] GET /identity/v3/users/0dec7bd85c6c473db9cd6091e1ab7dea => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:40:35.499686 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f9da2-5dfe-4b18-8ed0-5b9c343953cb None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:35.518685 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:35.551151 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68747385-b150-4440-ac23-035b43eec834 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:35.585699 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39ada9-1495-483b-9d8b-ce36af98089d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:35.586521 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39ada9-1495-483b-9d8b-ce36af98089d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:35.586871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39ada9-1495-483b-9d8b-ce36af98089d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:35.587144 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39ada9-1495-483b-9d8b-ce36af98089d None admin] PATH_INFO: `/v3/projects/6b293e7dd1fa40ad886795d229901112` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:35.588341 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39ada9-1495-483b-9d8b-ce36af98089d None admin] RBAC: Authorizing `identity:get_project(project_id=6b293e7dd1fa40ad886795d229901112)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:35.589802 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39ada9-1495-483b-9d8b-ce36af98089d None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:35.591814 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 117/231] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:35 2022] GET /identity/v3/projects/6b293e7dd1fa40ad886795d229901112 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:40:35.597303 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39ada9-1495-483b-9d8b-ce36af98089d None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:35.692640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f9da2-5dfe-4b18-8ed0-5b9c343953cb None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:35.710275 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39ada9-1495-483b-9d8b-ce36af98089d None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:35.748033 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3be2f1-0580-4796-88e0-722d49f2946c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:35.748916 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3be2f1-0580-4796-88e0-722d49f2946c None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:35.749195 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3be2f1-0580-4796-88e0-722d49f2946c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:35.749470 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3be2f1-0580-4796-88e0-722d49f2946c None admin] PATH_INFO: `/v3/projects/6b293e7dd1fa40ad886795d229901112/users/0dec7bd85c6c473db9cd6091e1ab7dea/roles/ad23f352111e42de99e9d92fbfe2e1f4` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:35.752858 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3be2f1-0580-4796-88e0-722d49f2946c None admin] RBAC: Authorizing `identity:create_grant(project_id=6b293e7dd1fa40ad886795d229901112, user_id=0dec7bd85c6c473db9cd6091e1ab7dea, role_id=ad23f352111e42de99e9d92fbfe2e1f4)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:35.754341 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3be2f1-0580-4796-88e0-722d49f2946c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:35.767235 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:35.768803 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ed458-2ed4-4ff2-8c65-d23563089a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:35.769767 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ed458-2ed4-4ff2-8c65-d23563089a71 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:35.770121 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ed458-2ed4-4ff2-8c65-d23563089a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:35.770573 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ed458-2ed4-4ff2-8c65-d23563089a71 None admin] PATH_INFO: `/v3/projects/6b293e7dd1fa40ad886795d229901112` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:35.772317 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 118/232] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 21 05:40:35 2022] PUT /identity/v3/projects/6b293e7dd1fa40ad886795d229901112/users/0dec7bd85c6c473db9cd6091e1ab7dea/roles/ad23f352111e42de99e9d92fbfe2e1f4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:40:35.773670 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ed458-2ed4-4ff2-8c65-d23563089a71 None admin] RBAC: Authorizing `identity:get_project(project_id=6b293e7dd1fa40ad886795d229901112)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:35.782089 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ed458-2ed4-4ff2-8c65-d23563089a71 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:35.784552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 115/233] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:35 2022] GET /identity/v3/projects/6b293e7dd1fa40ad886795d229901112 => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:40:35.790053 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3be2f1-0580-4796-88e0-722d49f2946c None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:35.933510 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3be2f1-0580-4796-88e0-722d49f2946c None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:35.971006 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e75d1-8d7b-4d8d-bc40-b9ee528cff29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:35.971907 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e75d1-8d7b-4d8d-bc40-b9ee528cff29 None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:35.972188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e75d1-8d7b-4d8d-bc40-b9ee528cff29 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:35.972463 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e75d1-8d7b-4d8d-bc40-b9ee528cff29 None admin] PATH_INFO: `/v3/projects/6b293e7dd1fa40ad886795d229901112/users/0dec7bd85c6c473db9cd6091e1ab7dea/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:35.974493 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e75d1-8d7b-4d8d-bc40-b9ee528cff29 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b293e7dd1fa40ad886795d229901112, user_id=0dec7bd85c6c473db9cd6091e1ab7dea, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:35.975942 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e75d1-8d7b-4d8d-bc40-b9ee528cff29 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:35.995911 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 119/234] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 21 05:40:35 2022] PUT /identity/v3/projects/6b293e7dd1fa40ad886795d229901112/users/0dec7bd85c6c473db9cd6091e1ab7dea/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:40:36.524108 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe807372-0f13-42ee-84ca-d5cb596ca48a None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:36.525013 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe807372-0f13-42ee-84ca-d5cb596ca48a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:36.525013 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe807372-0f13-42ee-84ca-d5cb596ca48a None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:36.526434 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 116/235] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:36.531843 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae773205-2136-4861-a186-9fe9c90756e8 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:36.532665 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae773205-2136-4861-a186-9fe9c90756e8 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:36.532665 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae773205-2136-4861-a186-9fe9c90756e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:36.559847 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-ae773205-2136-4861-a186-9fe9c90756e8 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:36.561059 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ae773205-2136-4861-a186-9fe9c90756e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:36.645165 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:36.658387 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 120/236] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 05:40:36.700035 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe807372-0f13-42ee-84ca-d5cb596ca48a None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:36.739186 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570c389-f071-4788-b3e0-2b842aa3d942 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:36.739592 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570c389-f071-4788-b3e0-2b842aa3d942 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:36.740121 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570c389-f071-4788-b3e0-2b842aa3d942 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:36.741401 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 121/237] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:36.750566 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3b9df-3637-435e-b573-d97830c8d07b None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:36.751414 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3b9df-3637-435e-b573-d97830c8d07b None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:36.753514 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3b9df-3637-435e-b573-d97830c8d07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:36.784766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-dfc3b9df-3637-435e-b573-d97830c8d07b None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:36.788931 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-dfc3b9df-3637-435e-b573-d97830c8d07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:36.799568 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:36.883673 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe807372-0f13-42ee-84ca-d5cb596ca48a None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:36.898010 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 122/238] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 05:40:36.925465 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3b9df-3637-435e-b573-d97830c8d07b None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:36.954962 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3a12b-e84c-4e27-9b47-a1aebf55939e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:36.955621 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3a12b-e84c-4e27-9b47-a1aebf55939e None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:36.955915 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3a12b-e84c-4e27-9b47-a1aebf55939e None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:36.956200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3a12b-e84c-4e27-9b47-a1aebf55939e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:36.957543 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3a12b-e84c-4e27-9b47-a1aebf55939e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:36.959048 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3a12b-e84c-4e27-9b47-a1aebf55939e None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:36.961082 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 117/239] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:40:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:36.966506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3a12b-e84c-4e27-9b47-a1aebf55939e None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:37.093685 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3b9df-3637-435e-b573-d97830c8d07b None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:37.129705 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:37.146542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5416b6-a90c-4852-a948-afcee5d95ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:37.147334 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5416b6-a90c-4852-a948-afcee5d95ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:37.147672 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5416b6-a90c-4852-a948-afcee5d95ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:37.147952 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5416b6-a90c-4852-a948-afcee5d95ae0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:37.159603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5416b6-a90c-4852-a948-afcee5d95ae0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:37.170739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-ff5416b6-a90c-4852-a948-afcee5d95ae0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 05:40:37.170739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:37.170739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:37.170739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:37.170739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:37.170739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:37.170739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:37.170739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:37.170739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:37.170739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:37.170739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:37.170739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:37.170739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:37.170739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:37.170739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:37.170739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:37.171664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:37.171664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:37.171664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:37.171664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:37.171664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:37.171664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:37.171664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:37.171664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:37.171664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:37.171664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:37.171664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:37.171664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:37.171664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:37.171664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:37.171664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:37.171664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:37.172890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:37.172890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:37.172890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:37.172890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:37.172890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:37.172890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:37.172890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:37.172890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:37.172890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:37.172890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:37.172890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 05:40:37.172890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:40:37.172890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 123/240] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:37.174185 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94d5c0-7ed6-4e1c-8331-4fe3636e28e7 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:37.174185 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94d5c0-7ed6-4e1c-8331-4fe3636e28e7 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:37.174581 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94d5c0-7ed6-4e1c-8331-4fe3636e28e7 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:37.175941 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 124/241] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:37.185226 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9642c3-8d1b-4d46-8d5a-12341fa37b0b None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:37.185586 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9642c3-8d1b-4d46-8d5a-12341fa37b0b None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:37.185965 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9642c3-8d1b-4d46-8d5a-12341fa37b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:37.202266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3a12b-e84c-4e27-9b47-a1aebf55939e None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:37.208956 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-3f9642c3-8d1b-4d46-8d5a-12341fa37b0b None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:37.210223 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3f9642c3-8d1b-4d46-8d5a-12341fa37b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:37.249197 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:37.265767 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9774991-a32a-4caa-85c3-0c591afdde6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:37.266861 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9774991-a32a-4caa-85c3-0c591afdde6c None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:37.267384 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9774991-a32a-4caa-85c3-0c591afdde6c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:37.267860 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9774991-a32a-4caa-85c3-0c591afdde6c None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:37.268777 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9774991-a32a-4caa-85c3-0c591afdde6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:37.270963 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9774991-a32a-4caa-85c3-0c591afdde6c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:37.306770 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 118/242] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 21 05:40:36 2022] POST /identity/v3/users => generated 293 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:40:37.307649 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9774991-a32a-4caa-85c3-0c591afdde6c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:37.321668 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 125/243] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:37.360082 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9642c3-8d1b-4d46-8d5a-12341fa37b0b None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:37.519742 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9774991-a32a-4caa-85c3-0c591afdde6c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:37.561525 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9642c3-8d1b-4d46-8d5a-12341fa37b0b None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:37.565770 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15873115-5b26-4241-a671-414fe72273cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:37.567161 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15873115-5b26-4241-a671-414fe72273cb None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:37.567600 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15873115-5b26-4241-a671-414fe72273cb None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:37.568031 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15873115-5b26-4241-a671-414fe72273cb None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:37.568976 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15873115-5b26-4241-a671-414fe72273cb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:37.569451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15873115-5b26-4241-a671-414fe72273cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:37.571151 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15873115-5b26-4241-a671-414fe72273cb None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:37.575848 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:37.586526 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 119/244] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 21 05:40:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:37.593986 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15873115-5b26-4241-a671-414fe72273cb None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:37.604702 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c807fe-3e30-4144-9a6d-561a407d19cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:37.605505 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c807fe-3e30-4144-9a6d-561a407d19cc None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:37.605787 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c807fe-3e30-4144-9a6d-561a407d19cc None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:37.606094 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c807fe-3e30-4144-9a6d-561a407d19cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:37.621755 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c807fe-3e30-4144-9a6d-561a407d19cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:37.632459 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-92c807fe-3e30-4144-9a6d-561a407d19cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:37.632459 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:37.632459 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:37.632459 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:37.632459 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:37.632459 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:37.632459 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:37.632459 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:37.632459 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:37.632459 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:37.632459 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:37.632459 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:37.632459 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:37.632459 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:37.632459 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:37.632459 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:37.633426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:37.633426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:37.633426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:37.633426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:37.633426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:37.633426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:37.633426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:37.633426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:37.633426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:37.633426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:37.633426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:37.633426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:37.633426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:37.633426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:37.633426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:37.633426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:37.634285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:37.634285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:37.634285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:37.634285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:37.634285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:37.634285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:37.634285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:37.634285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:37.634285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:37.634285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:37.634285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:37.634285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:40:37.637253 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 126/245] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:40:37.642997 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c807fe-3e30-4144-9a6d-561a407d19cc None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:37.649597 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:37.725887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15873115-5b26-4241-a671-414fe72273cb None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:37.763500 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336fee1-7318-4e94-b867-20f028af06f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:37.764804 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336fee1-7318-4e94-b867-20f028af06f3 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:37.765309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336fee1-7318-4e94-b867-20f028af06f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:37.765786 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336fee1-7318-4e94-b867-20f028af06f3 None admin] PATH_INFO: `/v3/users/bd8ee6be30b047cc9e5e5c2c5e9479fb` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:37.780381 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c807fe-3e30-4144-9a6d-561a407d19cc None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:37.785196 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d336fee1-7318-4e94-b867-20f028af06f3 None admin] RBAC: Authorizing `identity:get_user(user_id=bd8ee6be30b047cc9e5e5c2c5e9479fb)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:37.786950 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d336fee1-7318-4e94-b867-20f028af06f3 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:37.788912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 120/246] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:37 2022] GET /identity/v3/users/bd8ee6be30b047cc9e5e5c2c5e9479fb => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:37.805159 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336fee1-7318-4e94-b867-20f028af06f3 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:37.827008 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7583df-3127-41f3-a784-00953dfebc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:37.827852 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7583df-3127-41f3-a784-00953dfebc4d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:37.828157 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7583df-3127-41f3-a784-00953dfebc4d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:37.828437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7583df-3127-41f3-a784-00953dfebc4d None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:37.829307 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7583df-3127-41f3-a784-00953dfebc4d None admin] RBAC: Adding query filter params (name=member) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:37.829617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7583df-3127-41f3-a784-00953dfebc4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:37.831748 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7583df-3127-41f3-a784-00953dfebc4d None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:37.841371 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 127/247] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 21 05:40:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:40:37.849226 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7583df-3127-41f3-a784-00953dfebc4d None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:37.912046 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:37.946942 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:37.950381 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336fee1-7318-4e94-b867-20f028af06f3 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:37.990175 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89b7d4-a495-46e2-8cdc-a8f8bc712833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:37.990838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89b7d4-a495-46e2-8cdc-a8f8bc712833 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:37.991126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89b7d4-a495-46e2-8cdc-a8f8bc712833 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:37.991420 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89b7d4-a495-46e2-8cdc-a8f8bc712833 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:37.992159 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7583df-3127-41f3-a784-00953dfebc4d None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:38.028836 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83e095-58a4-4d73-b49e-f69e97338ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:38.029716 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83e095-58a4-4d73-b49e-f69e97338ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:38.030019 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83e095-58a4-4d73-b49e-f69e97338ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:38.030304 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83e095-58a4-4d73-b49e-f69e97338ee3 None admin] PATH_INFO: `/v3/users/0fdf518fa39e4e6b9594b98c225c3816` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:38.031509 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b83e095-58a4-4d73-b49e-f69e97338ee3 None admin] RBAC: Authorizing `identity:get_user(user_id=0fdf518fa39e4e6b9594b98c225c3816)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:38.033583 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b83e095-58a4-4d73-b49e-f69e97338ee3 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:38.036509 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 128/248] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:37 2022] GET /identity/v3/users/0fdf518fa39e4e6b9594b98c225c3816 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:38.046937 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83e095-58a4-4d73-b49e-f69e97338ee3 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:38.083084 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89b7d4-a495-46e2-8cdc-a8f8bc712833 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:38.084558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89b7d4-a495-46e2-8cdc-a8f8bc712833 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:38.184075 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:38.187301 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83e095-58a4-4d73-b49e-f69e97338ee3 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:38.234213 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:38.235545 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114292f0-7bf9-45e5-b77b-01b45008391b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:38.238682 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114292f0-7bf9-45e5-b77b-01b45008391b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:38.242878 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 121/249] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:40:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 05:40:38.243037 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114292f0-7bf9-45e5-b77b-01b45008391b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:38.243037 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114292f0-7bf9-45e5-b77b-01b45008391b None admin] PATH_INFO: `/v3/projects/6b293e7dd1fa40ad886795d229901112` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:38.243970 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114292f0-7bf9-45e5-b77b-01b45008391b None admin] RBAC: Authorizing `identity:get_project(project_id=6b293e7dd1fa40ad886795d229901112)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:38.245426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114292f0-7bf9-45e5-b77b-01b45008391b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:38.246891 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89b7d4-a495-46e2-8cdc-a8f8bc712833 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:38.247305 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 129/250] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:38 2022] GET /identity/v3/projects/6b293e7dd1fa40ad886795d229901112 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:38.253355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114292f0-7bf9-45e5-b77b-01b45008391b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:38.387918 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114292f0-7bf9-45e5-b77b-01b45008391b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:38.395410 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89b7d4-a495-46e2-8cdc-a8f8bc712833 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:38.425657 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ae49e-0202-4d06-a9bd-8f204dc8ff19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:38.426573 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ae49e-0202-4d06-a9bd-8f204dc8ff19 None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:38.426853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ae49e-0202-4d06-a9bd-8f204dc8ff19 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:38.427129 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ae49e-0202-4d06-a9bd-8f204dc8ff19 None admin] PATH_INFO: `/v3/projects/6b293e7dd1fa40ad886795d229901112/users/0fdf518fa39e4e6b9594b98c225c3816/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:38.429154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ae49e-0202-4d06-a9bd-8f204dc8ff19 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b293e7dd1fa40ad886795d229901112, user_id=0fdf518fa39e4e6b9594b98c225c3816, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:38.430669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ae49e-0202-4d06-a9bd-8f204dc8ff19 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:38.444121 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39986c6-07f2-4e19-9d12-93683a83865f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:38.445308 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39986c6-07f2-4e19-9d12-93683a83865f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:38.445915 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39986c6-07f2-4e19-9d12-93683a83865f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:38.446037 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 130/251] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 21 05:40:38 2022] PUT /identity/v3/projects/6b293e7dd1fa40ad886795d229901112/users/0fdf518fa39e4e6b9594b98c225c3816/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:40:38.446565 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39986c6-07f2-4e19-9d12-93683a83865f None admin] PATH_INFO: `/v3/projects/6b293e7dd1fa40ad886795d229901112` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:38.448304 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39986c6-07f2-4e19-9d12-93683a83865f None admin] RBAC: Authorizing `identity:get_project(project_id=6b293e7dd1fa40ad886795d229901112)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:38.450169 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39986c6-07f2-4e19-9d12-93683a83865f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:38.458184 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 122/252] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:38 2022] GET /identity/v3/projects/6b293e7dd1fa40ad886795d229901112 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:38.460795 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ae49e-0202-4d06-a9bd-8f204dc8ff19 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:38.498320 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:38.587640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ae49e-0202-4d06-a9bd-8f204dc8ff19 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:38.638149 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e5613-2810-4fb7-adf6-a2e4550f4ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:38.639180 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e5613-2810-4fb7-adf6-a2e4550f4ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:38.639656 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e5613-2810-4fb7-adf6-a2e4550f4ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:38.640142 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e5613-2810-4fb7-adf6-a2e4550f4ec9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:38.641171 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e5613-2810-4fb7-adf6-a2e4550f4ec9 None admin] RBAC: Adding query filter params (role.id=3e721e6a74074d32bb3d80dad6e9974e, scope.project.id=6b293e7dd1fa40ad886795d229901112, user.id=bd8ee6be30b047cc9e5e5c2c5e9479fb) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:38.641676 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e5613-2810-4fb7-adf6-a2e4550f4ec9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:38.644026 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e5613-2810-4fb7-adf6-a2e4550f4ec9 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:38.653990 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 131/253] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:40:38 2022] GET /identity/v3/role_assignments?user.id=bd8ee6be30b047cc9e5e5c2c5e9479fb&scope.project.id=6b293e7dd1fa40ad886795d229901112&role.id=3e721e6a74074d32bb3d80dad6e9974e => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:38.669015 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cdc12-2d58-4ac5-ad9b-a076712e4c78 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:38.670025 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cdc12-2d58-4ac5-ad9b-a076712e4c78 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:38.670483 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cdc12-2d58-4ac5-ad9b-a076712e4c78 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:38.672082 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 123/254] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:38.678029 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b77c1-ef6d-4d0e-86b5-9587d0fbfd83 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:38.678346 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b77c1-ef6d-4d0e-86b5-9587d0fbfd83 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:38.678599 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b77c1-ef6d-4d0e-86b5-9587d0fbfd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:38.697156 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-232b77c1-ef6d-4d0e-86b5-9587d0fbfd83 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:38.698626 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-232b77c1-ef6d-4d0e-86b5-9587d0fbfd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:38.785092 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 132/255] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:38.830860 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cdc12-2d58-4ac5-ad9b-a076712e4c78 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:38.930766 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:38.975870 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cdc12-2d58-4ac5-ad9b-a076712e4c78 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:39.020559 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb03d6-ab35-4c71-87ff-2b0aa46d2c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:39.021378 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb03d6-ab35-4c71-87ff-2b0aa46d2c17 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:39.021662 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb03d6-ab35-4c71-87ff-2b0aa46d2c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:39.021960 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb03d6-ab35-4c71-87ff-2b0aa46d2c17 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:39.041082 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb03d6-ab35-4c71-87ff-2b0aa46d2c17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:39.049331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-1cfb03d6-ab35-4c71-87ff-2b0aa46d2c17 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 05:40:39.049331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:39.049331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:39.049331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:39.049331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:39.049331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:39.049331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:39.049331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:39.049331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:39.049331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:39.049331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:39.049331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:39.049331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:39.049331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:39.049331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:39.049331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:39.050272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:39.050272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:39.050272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:39.050272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:39.050272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:39.050272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:39.050272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:39.050272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:39.050272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:39.050272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:39.050272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:39.050272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:39.050272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:39.050272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:39.050272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:39.050272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:39.051063 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:39.051063 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:39.051063 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:39.051063 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:39.051063 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:39.051063 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:39.051063 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:39.051063 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:39.051063 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:39.051063 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:39.051063 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 05:40:39.051063 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:40:39.051063 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 124/256] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 21 05:40:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:39.058978 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b77c1-ef6d-4d0e-86b5-9587d0fbfd83 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:39.064888 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d04346-8dc0-409a-9e3f-9e12c2ebef1d None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:39.065174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d04346-8dc0-409a-9e3f-9e12c2ebef1d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:39.065447 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d04346-8dc0-409a-9e3f-9e12c2ebef1d None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:39.067152 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 125/257] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 05:40:39.072494 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a8265-ebb3-482d-a19d-c637181a5e19 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:39.077856 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a8265-ebb3-482d-a19d-c637181a5e19 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:39.077856 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a8265-ebb3-482d-a19d-c637181a5e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:39.093622 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-0f9a8265-ebb3-482d-a19d-c637181a5e19 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:39.093622 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0f9a8265-ebb3-482d-a19d-c637181a5e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:39.116501 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:39.236887 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b77c1-ef6d-4d0e-86b5-9587d0fbfd83 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:39.254496 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 126/258] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 05:40:39.293069 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a8265-ebb3-482d-a19d-c637181a5e19 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:39.299338 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82736ee-2ab3-4c67-87f1-7ce8542a8f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:39.300251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82736ee-2ab3-4c67-87f1-7ce8542a8f03 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:39.300675 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82736ee-2ab3-4c67-87f1-7ce8542a8f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:39.301077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82736ee-2ab3-4c67-87f1-7ce8542a8f03 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:39.302009 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82736ee-2ab3-4c67-87f1-7ce8542a8f03 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:39.302444 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82736ee-2ab3-4c67-87f1-7ce8542a8f03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:39.303965 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82736ee-2ab3-4c67-87f1-7ce8542a8f03 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:39.318530 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 133/259] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:40:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:39.324198 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82736ee-2ab3-4c67-87f1-7ce8542a8f03 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:39.410322 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:39.500171 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a8265-ebb3-482d-a19d-c637181a5e19 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:39.514293 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:39.556143 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82736ee-2ab3-4c67-87f1-7ce8542a8f03 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:39.558793 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16494f38-9e3b-4643-b664-a44fafbe9e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:39.559974 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16494f38-9e3b-4643-b664-a44fafbe9e4d None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:39.560497 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16494f38-9e3b-4643-b664-a44fafbe9e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:39.561011 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16494f38-9e3b-4643-b664-a44fafbe9e4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:39.586900 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16494f38-9e3b-4643-b664-a44fafbe9e4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:39.596887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-16494f38-9e3b-4643-b664-a44fafbe9e4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:40:39.596887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:39.596887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:39.596887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:39.596887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:39.596887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:39.596887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:39.596887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:39.596887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:39.596887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:39.596887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:39.596887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:39.596887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:39.596887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:39.596887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:39.596887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:39.597837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:39.597837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:39.597837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:39.597837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:39.597837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:39.597837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:39.597837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:39.597837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:39.597837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:39.597837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:39.597837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:39.597837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:39.597837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:39.597837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:39.597837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:39.597837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:39.598747 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:39.598747 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:39.598747 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:39.598747 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:39.598747 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:39.598747 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:39.598747 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:39.598747 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:39.598747 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:39.598747 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:39.598747 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:40:39.598747 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:40:39.608494 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 127/260] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:40:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:39.614361 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16494f38-9e3b-4643-b664-a44fafbe9e4d None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:39.666826 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d924819-c360-40b3-9eed-2f02e668197f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:39.667737 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d924819-c360-40b3-9eed-2f02e668197f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:39.668021 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d924819-c360-40b3-9eed-2f02e668197f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:39.668298 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d924819-c360-40b3-9eed-2f02e668197f None admin] PATH_INFO: `/v3/users/0dec7bd85c6c473db9cd6091e1ab7dea` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:39.669673 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d924819-c360-40b3-9eed-2f02e668197f None admin] RBAC: Authorizing `identity:get_user(user_id=0dec7bd85c6c473db9cd6091e1ab7dea)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:39.671179 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d924819-c360-40b3-9eed-2f02e668197f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:39.672867 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 134/261] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:39 2022] GET /identity/v3/users/0dec7bd85c6c473db9cd6091e1ab7dea => generated 283 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:40:39.680697 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d924819-c360-40b3-9eed-2f02e668197f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:39.805217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16494f38-9e3b-4643-b664-a44fafbe9e4d None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:39.842312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:39.857536 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567475e-e267-4313-8e7a-9cf2e4ffbdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:39.858552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567475e-e267-4313-8e7a-9cf2e4ffbdb9 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:39.858843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567475e-e267-4313-8e7a-9cf2e4ffbdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:39.859124 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567475e-e267-4313-8e7a-9cf2e4ffbdb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:39.859887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567475e-e267-4313-8e7a-9cf2e4ffbdb9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:39.860199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567475e-e267-4313-8e7a-9cf2e4ffbdb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:39.861657 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567475e-e267-4313-8e7a-9cf2e4ffbdb9 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:39.888572 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 128/262] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:39.890270 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567475e-e267-4313-8e7a-9cf2e4ffbdb9 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:39.952169 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d924819-c360-40b3-9eed-2f02e668197f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:40.016159 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567475e-e267-4313-8e7a-9cf2e4ffbdb9 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:40.053901 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230486c-c9ea-4bce-8ed8-bd7de1f3184c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:40.054813 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230486c-c9ea-4bce-8ed8-bd7de1f3184c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:40.055098 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230486c-c9ea-4bce-8ed8-bd7de1f3184c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:40.055433 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230486c-c9ea-4bce-8ed8-bd7de1f3184c None admin] PATH_INFO: `/v3/users/0dec7bd85c6c473db9cd6091e1ab7dea` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:40.056625 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230486c-c9ea-4bce-8ed8-bd7de1f3184c None admin] RBAC: Authorizing `identity:get_user(user_id=0dec7bd85c6c473db9cd6091e1ab7dea)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:40.058160 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230486c-c9ea-4bce-8ed8-bd7de1f3184c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:40.065022 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 129/263] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:39 2022] GET /identity/v3/users/0dec7bd85c6c473db9cd6091e1ab7dea => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:40.066419 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230486c-c9ea-4bce-8ed8-bd7de1f3184c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:40.087313 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c497508-0207-4d4d-8946-75f9b1889735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:40.088170 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c497508-0207-4d4d-8946-75f9b1889735 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:40.088505 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c497508-0207-4d4d-8946-75f9b1889735 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:40.088814 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c497508-0207-4d4d-8946-75f9b1889735 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:40.127567 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:40.157116 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:40.172602 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230486c-c9ea-4bce-8ed8-bd7de1f3184c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:40.216731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400dc52-df2d-4829-af06-71d46e6ce3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:40.217428 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400dc52-df2d-4829-af06-71d46e6ce3eb None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:40.217712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400dc52-df2d-4829-af06-71d46e6ce3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:40.218012 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400dc52-df2d-4829-af06-71d46e6ce3eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:40.265480 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c497508-0207-4d4d-8946-75f9b1889735 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:40.267030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c497508-0207-4d4d-8946-75f9b1889735 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:40.295353 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400dc52-df2d-4829-af06-71d46e6ce3eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:40.296835 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400dc52-df2d-4829-af06-71d46e6ce3eb None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:40.367947 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:40.418056 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 130/264] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:40:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:40:40.422568 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400dc52-df2d-4829-af06-71d46e6ce3eb None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:40.582127 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 135/265] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:40:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 902 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 05:40:40.585958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400dc52-df2d-4829-af06-71d46e6ce3eb None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:40.590966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c497508-0207-4d4d-8946-75f9b1889735 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:40.629798 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75c50c-239e-441b-ab0d-a3bc3b7668cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:40.630635 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75c50c-239e-441b-ab0d-a3bc3b7668cd None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:40.630925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75c50c-239e-441b-ab0d-a3bc3b7668cd None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:40.631210 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75c50c-239e-441b-ab0d-a3bc3b7668cd None admin] PATH_INFO: `/v3/projects/6b293e7dd1fa40ad886795d229901112` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:40.632785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75c50c-239e-441b-ab0d-a3bc3b7668cd None admin] RBAC: Authorizing `identity:get_project(project_id=6b293e7dd1fa40ad886795d229901112)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:40.634270 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75c50c-239e-441b-ab0d-a3bc3b7668cd None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:40.636789 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 131/266] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:40 2022] GET /identity/v3/projects/6b293e7dd1fa40ad886795d229901112 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:40:40.643314 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75c50c-239e-441b-ab0d-a3bc3b7668cd None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:40.664976 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:40.724283 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:40.759415 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75c50c-239e-441b-ab0d-a3bc3b7668cd None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:40.797871 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23303d-197f-476b-bfd2-f88c4c299c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:40.799103 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23303d-197f-476b-bfd2-f88c4c299c7a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:40.800232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23303d-197f-476b-bfd2-f88c4c299c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:40.800532 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23303d-197f-476b-bfd2-f88c4c299c7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:40.801387 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23303d-197f-476b-bfd2-f88c4c299c7a None admin] RBAC: Adding query filter params (role.id=24aa6040c86049f996560e477e83886f, scope.project.id=6b293e7dd1fa40ad886795d229901112, user.id=0dec7bd85c6c473db9cd6091e1ab7dea) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:40.801704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23303d-197f-476b-bfd2-f88c4c299c7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:40.803185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23303d-197f-476b-bfd2-f88c4c299c7a None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:40.809988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 132/267] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:40:40 2022] GET /identity/v3/role_assignments?user.id=0dec7bd85c6c473db9cd6091e1ab7dea&scope.project.id=6b293e7dd1fa40ad886795d229901112&role.id=24aa6040c86049f996560e477e83886f => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:40:40.818199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8227479-9efa-4261-b4d4-dede55dcba77 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:40.818501 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8227479-9efa-4261-b4d4-dede55dcba77 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:40.818789 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8227479-9efa-4261-b4d4-dede55dcba77 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:40.820529 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 133/268] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:40 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:40.826278 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fc52b-2627-4586-83bf-f3e2e7e1bc25 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:40.826587 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fc52b-2627-4586-83bf-f3e2e7e1bc25 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:40.826844 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fc52b-2627-4586-83bf-f3e2e7e1bc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:40.854353 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-717fc52b-2627-4586-83bf-f3e2e7e1bc25 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:40.855780 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-717fc52b-2627-4586-83bf-f3e2e7e1bc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:40.905007 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c497508-0207-4d4d-8946-75f9b1889735 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:40.968266 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a1a4f-912e-4f8f-b958-8524ebba731d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:40.969149 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a1a4f-912e-4f8f-b958-8524ebba731d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:40.969430 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a1a4f-912e-4f8f-b958-8524ebba731d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:40.969705 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a1a4f-912e-4f8f-b958-8524ebba731d None admin] PATH_INFO: `/v3/projects/6b293e7dd1fa40ad886795d229901112` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:40.976025 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a1a4f-912e-4f8f-b958-8524ebba731d None admin] RBAC: Authorizing `identity:get_project(project_id=6b293e7dd1fa40ad886795d229901112)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:40.977525 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a1a4f-912e-4f8f-b958-8524ebba731d None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:40.979390 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 136/269] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:40 2022] GET /identity/v3/projects/6b293e7dd1fa40ad886795d229901112 => generated 302 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:40.982758 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 134/270] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:40.989730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a1a4f-912e-4f8f-b958-8524ebba731d None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:41.022927 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717fc52b-2627-4586-83bf-f3e2e7e1bc25 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:41.049564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:41.169420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a1a4f-912e-4f8f-b958-8524ebba731d None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:41.207201 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:41.208034 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717fc52b-2627-4586-83bf-f3e2e7e1bc25 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:41.237493 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc909cd5-5747-44c8-b222-4952f8b724af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:41.238566 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc909cd5-5747-44c8-b222-4952f8b724af None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:41.238996 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc909cd5-5747-44c8-b222-4952f8b724af None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:41.239490 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc909cd5-5747-44c8-b222-4952f8b724af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:41.240534 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc909cd5-5747-44c8-b222-4952f8b724af None admin] RBAC: Adding query filter params (role.id=ad23f352111e42de99e9d92fbfe2e1f4, scope.project.id=6b293e7dd1fa40ad886795d229901112, user.id=0dec7bd85c6c473db9cd6091e1ab7dea) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:41.240991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc909cd5-5747-44c8-b222-4952f8b724af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:41.242909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc909cd5-5747-44c8-b222-4952f8b724af None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:41.247978 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a4b76-1292-42c4-88b8-f895e4756dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:41.248793 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a4b76-1292-42c4-88b8-f895e4756dfc None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:41.249081 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a4b76-1292-42c4-88b8-f895e4756dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:41.249361 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a4b76-1292-42c4-88b8-f895e4756dfc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:41.251281 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 137/271] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:40:40 2022] GET /identity/v3/role_assignments?user.id=0dec7bd85c6c473db9cd6091e1ab7dea&scope.project.id=6b293e7dd1fa40ad886795d229901112&role.id=ad23f352111e42de99e9d92fbfe2e1f4 => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:41.263035 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a4b76-1292-42c4-88b8-f895e4756dfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:41.272174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-561a4b76-1292-42c4-88b8-f895e4756dfc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:41.272174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:41.272174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:41.272174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:41.272174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:41.272174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:41.272174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:41.272174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:41.272174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:41.272174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:41.272174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:41.272174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:41.272174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:41.272174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:41.272174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:41.272174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:41.273154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:41.273154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:41.273154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:41.273154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:41.273154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:41.273154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:41.273154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:41.273154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:41.273154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:41.273154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:41.273154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:41.273154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:41.273154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:41.273154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:41.273154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:41.273154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:41.274060 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:41.274060 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:41.274060 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:41.274060 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:41.274060 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:41.274060 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:41.274060 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:41.274060 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:41.274060 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:41.274060 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:41.274060 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:41.274060 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:40:41.274060 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 135/272] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:41.279997 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc909cd5-5747-44c8-b222-4952f8b724af None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:41.322217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c86494-f860-4fe1-8139-0e0535941273 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:41.322565 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c86494-f860-4fe1-8139-0e0535941273 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:41.322791 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c86494-f860-4fe1-8139-0e0535941273 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:41.324268 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 136/273] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 05:40:41.330371 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a6a93-401c-4d20-8e94-f154f5de7045 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:41.330680 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a6a93-401c-4d20-8e94-f154f5de7045 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:41.330951 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a6a93-401c-4d20-8e94-f154f5de7045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:41.351504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-582a6a93-401c-4d20-8e94-f154f5de7045 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:41.353145 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-582a6a93-401c-4d20-8e94-f154f5de7045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:41.433271 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:41.439094 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 137/274] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 05:40:41.446640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc909cd5-5747-44c8-b222-4952f8b724af None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:41.464870 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a6a93-401c-4d20-8e94-f154f5de7045 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:41.496311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96e7bb-dda4-4212-beee-c9f6b1f41771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:41.497398 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96e7bb-dda4-4212-beee-c9f6b1f41771 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:41.497696 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96e7bb-dda4-4212-beee-c9f6b1f41771 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:41.498288 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96e7bb-dda4-4212-beee-c9f6b1f41771 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:41.499062 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96e7bb-dda4-4212-beee-c9f6b1f41771 None admin] RBAC: Adding query filter params (name=member) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:41.499546 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96e7bb-dda4-4212-beee-c9f6b1f41771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:41.501627 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96e7bb-dda4-4212-beee-c9f6b1f41771 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:41.512967 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 138/275] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 21 05:40:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:41.518989 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96e7bb-dda4-4212-beee-c9f6b1f41771 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:41.587789 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:41.602824 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a6a93-401c-4d20-8e94-f154f5de7045 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:41.640481 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260271aa-67c5-4dca-ac96-81f7063ac247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:41.641320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260271aa-67c5-4dca-ac96-81f7063ac247 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:41.641605 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260271aa-67c5-4dca-ac96-81f7063ac247 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:41.641908 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260271aa-67c5-4dca-ac96-81f7063ac247 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:41.644344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260271aa-67c5-4dca-ac96-81f7063ac247 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:41.646563 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260271aa-67c5-4dca-ac96-81f7063ac247 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:41.648385 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 138/276] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:40:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:40:41.654129 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96e7bb-dda4-4212-beee-c9f6b1f41771 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:41.654290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260271aa-67c5-4dca-ac96-81f7063ac247 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:41.692319 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da937f-9dc3-4562-bc8a-57fd16dfea38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:41.693217 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da937f-9dc3-4562-bc8a-57fd16dfea38 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:41.693510 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da937f-9dc3-4562-bc8a-57fd16dfea38 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:41.693783 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da937f-9dc3-4562-bc8a-57fd16dfea38 None admin] PATH_INFO: `/v3/users/7964a1de2d2b450490c433cfebf4f7dd` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:41.709504 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da937f-9dc3-4562-bc8a-57fd16dfea38 None admin] RBAC: Authorizing `identity:get_user(user_id=7964a1de2d2b450490c433cfebf4f7dd)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:41.711100 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da937f-9dc3-4562-bc8a-57fd16dfea38 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:41.714101 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 139/277] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:41 2022] GET /identity/v3/users/7964a1de2d2b450490c433cfebf4f7dd => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:41.724039 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da937f-9dc3-4562-bc8a-57fd16dfea38 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:41.746369 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:41.784095 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260271aa-67c5-4dca-ac96-81f7063ac247 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:41.827753 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b66d8e-dd7f-45c6-835a-237ae4d95769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:41.828455 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b66d8e-dd7f-45c6-835a-237ae4d95769 None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:41.828700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b66d8e-dd7f-45c6-835a-237ae4d95769 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:41.828976 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b66d8e-dd7f-45c6-835a-237ae4d95769 None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:41.830283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b66d8e-dd7f-45c6-835a-237ae4d95769 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:41.831724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b66d8e-dd7f-45c6-835a-237ae4d95769 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:41.838342 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da937f-9dc3-4562-bc8a-57fd16dfea38 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:41.841166 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:41.865962 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 139/278] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 21 05:40:41 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 05:40:41.865962 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94165e-f79e-41c1-a061-7acb8c2fa857 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:41.865962 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94165e-f79e-41c1-a061-7acb8c2fa857 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:41.865962 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94165e-f79e-41c1-a061-7acb8c2fa857 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:41.865962 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 140/279] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:41.865962 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca60c9f-8762-4499-ae80-17d91a0a4b38 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:41.865962 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca60c9f-8762-4499-ae80-17d91a0a4b38 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:41.866526 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca60c9f-8762-4499-ae80-17d91a0a4b38 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:41.866526 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 141/280] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:41.870876 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ed52e-1427-4a45-9c46-8cf695834c08 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:41.871171 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ed52e-1427-4a45-9c46-8cf695834c08 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:41.871458 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ed52e-1427-4a45-9c46-8cf695834c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:41.890686 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e6dd5-6e93-4993-981c-e98051447c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:41.891357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e6dd5-6e93-4993-981c-e98051447c17 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:41.891644 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e6dd5-6e93-4993-981c-e98051447c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:41.891924 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e6dd5-6e93-4993-981c-e98051447c17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:41.893162 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-1d8ed52e-1427-4a45-9c46-8cf695834c08 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:41.893464 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e6dd5-6e93-4993-981c-e98051447c17 None admin] RBAC: Adding query filter params (role.id=a9602a7e01694084a0f9713d9d6394b1, user.id=7964a1de2d2b450490c433cfebf4f7dd, scope.system=all) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:41.893793 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e6dd5-6e93-4993-981c-e98051447c17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:41.894474 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1d8ed52e-1427-4a45-9c46-8cf695834c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:41.895328 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e6dd5-6e93-4993-981c-e98051447c17 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:41.902723 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 140/281] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Jun 21 05:40:41 2022] GET /identity/v3/role_assignments?user.id=7964a1de2d2b450490c433cfebf4f7dd&scope.system=all&role.id=a9602a7e01694084a0f9713d9d6394b1 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:41.903851 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffeea6-1d3e-4237-a956-01f4bd37afa4 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:41.904145 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffeea6-1d3e-4237-a956-01f4bd37afa4 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:41.904422 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffeea6-1d3e-4237-a956-01f4bd37afa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:41.923324 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-c1ffeea6-1d3e-4237-a956-01f4bd37afa4 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:41.924571 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c1ffeea6-1d3e-4237-a956-01f4bd37afa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:42.018670 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 142/282] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:42.046067 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 141/283] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:42.048511 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ed52e-1427-4a45-9c46-8cf695834c08 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:42.070186 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffeea6-1d3e-4237-a956-01f4bd37afa4 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:42.128255 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:42.198166 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ed52e-1427-4a45-9c46-8cf695834c08 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:42.215712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:42.220025 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffeea6-1d3e-4237-a956-01f4bd37afa4 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:42.243350 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c5a01-1614-4d88-afe6-6ad1c73f423a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:42.244155 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c5a01-1614-4d88-afe6-6ad1c73f423a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:42.244645 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c5a01-1614-4d88-afe6-6ad1c73f423a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:42.244791 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c5a01-1614-4d88-afe6-6ad1c73f423a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:42.257627 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c5a01-1614-4d88-afe6-6ad1c73f423a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:42.265805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-7c0c5a01-1614-4d88-afe6-6ad1c73f423a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:42.265805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:42.265805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:42.265805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:42.265805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:42.265805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:42.265805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:42.265805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:42.265805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:42.265805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:42.265805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:42.265805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:42.265805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:42.265805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:42.265805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:42.265805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:42.266836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:42.266836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:42.266836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:42.266836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:42.266836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:42.266836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:42.266836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:42.266836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:42.266836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:42.266836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:42.266836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:42.266836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:42.266836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:42.266836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:42.266836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:42.266836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:42.268206 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:42.268206 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:42.268206 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:42.268206 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:42.268206 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:42.268206 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:42.268206 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:42.268206 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:42.268206 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:42.268206 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:42.268206 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:42.268206 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:40:42.268867 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 143/284] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:42.273825 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750e094-2e78-415f-8871-673e3d1a372a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:42.274409 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750e094-2e78-415f-8871-673e3d1a372a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:42.274691 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750e094-2e78-415f-8871-673e3d1a372a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:42.274787 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c5a01-1614-4d88-afe6-6ad1c73f423a None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:42.274968 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750e094-2e78-415f-8871-673e3d1a372a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:42.291169 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750e094-2e78-415f-8871-673e3d1a372a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:42.299640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-b750e094-2e78-415f-8871-673e3d1a372a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 05:40:42.299640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:42.299640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:42.299640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:42.299640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:42.299640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:42.299640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:42.299640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:42.299640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:42.299640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:42.299640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:42.299640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:42.299640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:42.299640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:42.299640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:42.299640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:42.300601 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:42.300601 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:42.300601 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:42.300601 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:42.300601 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:42.300601 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:42.300601 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:42.300601 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:42.300601 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:42.300601 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:42.300601 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:42.300601 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:42.300601 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:42.300601 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:42.300601 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:42.300601 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:42.301386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:42.301386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:42.301386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:42.301386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:42.301386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:42.301386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:42.301386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:42.301386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:42.301386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:42.301386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:42.301386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 05:40:42.301386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:40:42.301386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 142/285] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:40:42.309391 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750e094-2e78-415f-8871-673e3d1a372a None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:42.428019 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c5a01-1614-4d88-afe6-6ad1c73f423a None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:42.433257 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750e094-2e78-415f-8871-673e3d1a372a None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:42.448141 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:42.472746 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5272c-cec5-4094-9666-f5f12d5e89fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:42.473414 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5272c-cec5-4094-9666-f5f12d5e89fb None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:42.473696 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5272c-cec5-4094-9666-f5f12d5e89fb None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:42.474010 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5272c-cec5-4094-9666-f5f12d5e89fb None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:42.474766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5272c-cec5-4094-9666-f5f12d5e89fb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:42.475071 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5272c-cec5-4094-9666-f5f12d5e89fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:42.475661 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c51378-0802-4109-9318-337a7b484fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:42.476341 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c51378-0802-4109-9318-337a7b484fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:42.476539 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5272c-cec5-4094-9666-f5f12d5e89fb None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:42.476646 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c51378-0802-4109-9318-337a7b484fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:42.476898 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c51378-0802-4109-9318-337a7b484fa9 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:42.477664 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c51378-0802-4109-9318-337a7b484fa9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:42.478325 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c51378-0802-4109-9318-337a7b484fa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:42.480369 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c51378-0802-4109-9318-337a7b484fa9 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:42.487321 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 143/286] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 21 05:40:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:40:42.492147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 144/287] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 21 05:40:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:40:42.492933 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5272c-cec5-4094-9666-f5f12d5e89fb None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:42.497976 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c51378-0802-4109-9318-337a7b484fa9 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:42.522276 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:42.623331 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5272c-cec5-4094-9666-f5f12d5e89fb None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:42.662787 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f654a-b6ee-4e51-be89-4c88f12ee849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:42.664348 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f654a-b6ee-4e51-be89-4c88f12ee849 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:42.664637 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f654a-b6ee-4e51-be89-4c88f12ee849 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:42.664922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f654a-b6ee-4e51-be89-4c88f12ee849 None admin] PATH_INFO: `/v3/users/bd8ee6be30b047cc9e5e5c2c5e9479fb` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:42.666374 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f654a-b6ee-4e51-be89-4c88f12ee849 None admin] RBAC: Authorizing `identity:get_user(user_id=bd8ee6be30b047cc9e5e5c2c5e9479fb)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:42.667841 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f654a-b6ee-4e51-be89-4c88f12ee849 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:42.669523 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 144/288] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:42 2022] GET /identity/v3/users/bd8ee6be30b047cc9e5e5c2c5e9479fb => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:42.676279 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f654a-b6ee-4e51-be89-4c88f12ee849 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:42.688266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c51378-0802-4109-9318-337a7b484fa9 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:42.726197 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9e970-644a-4b7d-9199-6e7449eeb032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:42.727083 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9e970-644a-4b7d-9199-6e7449eeb032 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:42.727365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9e970-644a-4b7d-9199-6e7449eeb032 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:42.727641 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9e970-644a-4b7d-9199-6e7449eeb032 None admin] PATH_INFO: `/v3/users/0fdf518fa39e4e6b9594b98c225c3816` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:42.728868 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9e970-644a-4b7d-9199-6e7449eeb032 None admin] RBAC: Authorizing `identity:get_user(user_id=0fdf518fa39e4e6b9594b98c225c3816)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:42.730455 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9e970-644a-4b7d-9199-6e7449eeb032 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:42.732801 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 145/289] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:42 2022] GET /identity/v3/users/0fdf518fa39e4e6b9594b98c225c3816 => generated 297 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:40:42.739091 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9e970-644a-4b7d-9199-6e7449eeb032 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:42.791349 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:42.792603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:42.808941 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f654a-b6ee-4e51-be89-4c88f12ee849 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:42.854825 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287f081-d2bd-4d59-8f65-b7642b664614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:42.855712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287f081-d2bd-4d59-8f65-b7642b664614 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:42.856001 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287f081-d2bd-4d59-8f65-b7642b664614 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:42.856281 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287f081-d2bd-4d59-8f65-b7642b664614 None admin] PATH_INFO: `/v3/projects/6b293e7dd1fa40ad886795d229901112` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:42.857831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287f081-d2bd-4d59-8f65-b7642b664614 None admin] RBAC: Authorizing `identity:get_project(project_id=6b293e7dd1fa40ad886795d229901112)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:42.858305 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9e970-644a-4b7d-9199-6e7449eeb032 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:42.859350 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287f081-d2bd-4d59-8f65-b7642b664614 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:42.862253 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 145/290] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:42 2022] GET /identity/v3/projects/6b293e7dd1fa40ad886795d229901112 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:40:42.868800 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287f081-d2bd-4d59-8f65-b7642b664614 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:42.902669 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb41fdc-3100-4b4d-8143-f764c5ef78e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:42.903711 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb41fdc-3100-4b4d-8143-f764c5ef78e8 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:42.904190 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb41fdc-3100-4b4d-8143-f764c5ef78e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:42.904732 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb41fdc-3100-4b4d-8143-f764c5ef78e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:42.997044 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287f081-d2bd-4d59-8f65-b7642b664614 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:43.042458 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b4d88-d4bc-4922-9c0a-291dd03c6030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:43.043284 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b4d88-d4bc-4922-9c0a-291dd03c6030 None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:43.043573 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b4d88-d4bc-4922-9c0a-291dd03c6030 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:43.043856 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b4d88-d4bc-4922-9c0a-291dd03c6030 None admin] PATH_INFO: `/v3/projects/6b293e7dd1fa40ad886795d229901112/users/bd8ee6be30b047cc9e5e5c2c5e9479fb/roles/3e721e6a74074d32bb3d80dad6e9974e` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:43.049955 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b4d88-d4bc-4922-9c0a-291dd03c6030 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b293e7dd1fa40ad886795d229901112, user_id=bd8ee6be30b047cc9e5e5c2c5e9479fb, role_id=3e721e6a74074d32bb3d80dad6e9974e)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:43.049955 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b4d88-d4bc-4922-9c0a-291dd03c6030 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:43.059550 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb41fdc-3100-4b4d-8143-f764c5ef78e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:43.061518 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb41fdc-3100-4b4d-8143-f764c5ef78e8 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:43.073736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 146/291] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 21 05:40:42 2022] PUT /identity/v3/projects/6b293e7dd1fa40ad886795d229901112/users/bd8ee6be30b047cc9e5e5c2c5e9479fb/roles/3e721e6a74074d32bb3d80dad6e9974e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:40:43.120216 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:43.194155 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 146/292] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:40:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:40:43.196208 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b4d88-d4bc-4922-9c0a-291dd03c6030 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:43.242626 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:43.351815 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b4d88-d4bc-4922-9c0a-291dd03c6030 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:43.393114 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dbb987-3eb2-48ec-aa2f-54bab1d92e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:43.394019 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbb987-3eb2-48ec-aa2f-54bab1d92e14 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:43.394310 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbb987-3eb2-48ec-aa2f-54bab1d92e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:43.394590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbb987-3eb2-48ec-aa2f-54bab1d92e14 None admin] PATH_INFO: `/v3/projects/6b293e7dd1fa40ad886795d229901112` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:43.396020 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dbb987-3eb2-48ec-aa2f-54bab1d92e14 None admin] RBAC: Authorizing `identity:get_project(project_id=6b293e7dd1fa40ad886795d229901112)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:43.397654 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dbb987-3eb2-48ec-aa2f-54bab1d92e14 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:43.404096 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 147/293] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:43 2022] GET /identity/v3/projects/6b293e7dd1fa40ad886795d229901112 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:43.405348 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb41fdc-3100-4b4d-8143-f764c5ef78e8 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:43.539900 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb41fdc-3100-4b4d-8143-f764c5ef78e8 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:43.576186 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbe343-d2a3-49b8-9732-2795e262e824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:43.576850 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbe343-d2a3-49b8-9732-2795e262e824 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:43.577135 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbe343-d2a3-49b8-9732-2795e262e824 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:43.577413 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbe343-d2a3-49b8-9732-2795e262e824 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:43.578285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbe343-d2a3-49b8-9732-2795e262e824 None admin] RBAC: Adding query filter params (role.id=a9602a7e01694084a0f9713d9d6394b1, scope.project.id=6b293e7dd1fa40ad886795d229901112, user.id=0fdf518fa39e4e6b9594b98c225c3816) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:43.578598 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbe343-d2a3-49b8-9732-2795e262e824 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:43.580140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbe343-d2a3-49b8-9732-2795e262e824 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:43.586707 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 147/294] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:40:43 2022] GET /identity/v3/role_assignments?user.id=0fdf518fa39e4e6b9594b98c225c3816&scope.project.id=6b293e7dd1fa40ad886795d229901112&role.id=a9602a7e01694084a0f9713d9d6394b1 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:44.437073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d344f-548a-4839-b5a1-d4e3c15f4dba None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:44.437564 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d344f-548a-4839-b5a1-d4e3c15f4dba None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:44.437564 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d344f-548a-4839-b5a1-d4e3c15f4dba None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:44.439231 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 148/295] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:44.444815 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09d9b4-1550-4045-b36a-cc3e649ba34c None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:44.445268 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09d9b4-1550-4045-b36a-cc3e649ba34c None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:44.445468 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09d9b4-1550-4045-b36a-cc3e649ba34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:44.463344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-ac09d9b4-1550-4045-b36a-cc3e649ba34c None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:44.464558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ac09d9b4-1550-4045-b36a-cc3e649ba34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:44.467025 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:44.540269 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ad82f-1b82-4465-b3c2-5909ae1a2cf0 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:44.540586 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ad82f-1b82-4465-b3c2-5909ae1a2cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:44.540837 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ad82f-1b82-4465-b3c2-5909ae1a2cf0 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:44.542468 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 149/296] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:44.547544 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962298a1-702a-4eeb-a7d2-173af5e6d51c None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:44.547835 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962298a1-702a-4eeb-a7d2-173af5e6d51c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:44.548120 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962298a1-702a-4eeb-a7d2-173af5e6d51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:44.548326 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 148/297] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:44.571447 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-962298a1-702a-4eeb-a7d2-173af5e6d51c None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:44.573015 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-962298a1-702a-4eeb-a7d2-173af5e6d51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:44.573559 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09d9b4-1550-4045-b36a-cc3e649ba34c None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:44.670057 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 150/298] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 05:40:44.688903 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962298a1-702a-4eeb-a7d2-173af5e6d51c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:44.703309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09d9b4-1550-4045-b36a-cc3e649ba34c None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:44.705027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:44.753924 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6457c-7bfe-4afa-ae4a-8c333407371d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:44.755351 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6457c-7bfe-4afa-ae4a-8c333407371d None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:44.755749 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6457c-7bfe-4afa-ae4a-8c333407371d None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:44.756033 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6457c-7bfe-4afa-ae4a-8c333407371d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:44.766283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:44.773329 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6457c-7bfe-4afa-ae4a-8c333407371d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:44.781644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-56d6457c-7bfe-4afa-ae4a-8c333407371d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:44.781644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:44.781644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:44.781644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:44.781644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:44.781644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:44.781644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:44.781644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:44.781644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:44.781644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:44.781644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:44.781644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:44.781644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:44.781644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:44.781644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:44.781644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:44.784127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:44.784127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:44.784127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:44.784127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:44.784127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:44.784127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:44.784127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:44.784127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:44.784127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:44.784127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:44.784127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:44.784127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:44.784127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:44.784127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:44.784127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:44.784127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:44.785558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:44.785558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:44.785558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:44.785558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:44.785558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:44.785558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:44.785558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:44.785558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:44.785558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:44.785558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:44.785558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:44.785558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:40:44.785558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 149/299] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:40:44.790557 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6457c-7bfe-4afa-ae4a-8c333407371d None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:44.815749 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962298a1-702a-4eeb-a7d2-173af5e6d51c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:44.864497 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55a97d-491b-485a-b9b9-8c0fe71c0536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:44.865568 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55a97d-491b-485a-b9b9-8c0fe71c0536 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:44.866443 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55a97d-491b-485a-b9b9-8c0fe71c0536 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:44.866443 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55a97d-491b-485a-b9b9-8c0fe71c0536 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:44.885351 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55a97d-491b-485a-b9b9-8c0fe71c0536 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:44.896535 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-ed55a97d-491b-485a-b9b9-8c0fe71c0536 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 05:40:44.896535 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:44.896535 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:44.896535 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:44.896535 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:44.896535 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:44.896535 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:44.896535 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:44.896535 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:44.896535 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:44.896535 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:44.896535 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:44.896535 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:44.896535 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:44.896535 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:44.896535 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:44.898640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:44.898640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:44.898640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:44.898640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:44.898640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:44.898640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:44.898640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:44.898640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:44.898640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:44.898640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:44.898640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:44.898640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:44.898640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:44.898640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:44.898640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:44.898640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:44.900569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:44.900569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:44.900569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:44.900569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:44.900569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:44.900569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:44.900569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:44.900569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:44.900569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:44.900569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:44.900569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 05:40:44.900569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:40:44.900569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 151/300] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:40:44.900569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edaa27-087c-4fd7-9b0d-f03b12385675 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:44.902591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edaa27-087c-4fd7-9b0d-f03b12385675 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:44.902591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edaa27-087c-4fd7-9b0d-f03b12385675 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:44.902591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 152/301] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:44.903919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edaa27-087c-4fd7-9b0d-f03b12385675 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:44.923216 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6457c-7bfe-4afa-ae4a-8c333407371d None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:44.965413 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ee33c-309c-46c8-a26f-bfc2ba6f8c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:44.966162 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ee33c-309c-46c8-a26f-bfc2ba6f8c25 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:44.966329 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ee33c-309c-46c8-a26f-bfc2ba6f8c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:44.966603 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ee33c-309c-46c8-a26f-bfc2ba6f8c25 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:44.967370 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ee33c-309c-46c8-a26f-bfc2ba6f8c25 None admin] RBAC: Adding query filter params (name=member) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:44.967681 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ee33c-309c-46c8-a26f-bfc2ba6f8c25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:44.969080 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ee33c-309c-46c8-a26f-bfc2ba6f8c25 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:44.979933 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 150/302] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 21 05:40:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:44.982275 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b6fda-8579-41f8-9d0b-33420ce0cea8 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:44.984151 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b6fda-8579-41f8-9d0b-33420ce0cea8 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:44.984151 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b6fda-8579-41f8-9d0b-33420ce0cea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:45.005550 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-c82b6fda-8579-41f8-9d0b-33420ce0cea8 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:45.005943 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:45.006785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c82b6fda-8579-41f8-9d0b-33420ce0cea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:45.041926 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edaa27-087c-4fd7-9b0d-f03b12385675 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:45.081051 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:45.088577 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af5914-4e13-4981-974e-88827bb2cbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:45.089391 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af5914-4e13-4981-974e-88827bb2cbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:45.089795 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af5914-4e13-4981-974e-88827bb2cbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:45.090110 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af5914-4e13-4981-974e-88827bb2cbc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:45.090869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af5914-4e13-4981-974e-88827bb2cbc8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:45.091178 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af5914-4e13-4981-974e-88827bb2cbc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:45.092563 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af5914-4e13-4981-974e-88827bb2cbc8 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:45.092901 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 151/303] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:45.093737 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b6fda-8579-41f8-9d0b-33420ce0cea8 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:45.115899 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 153/304] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 21 05:40:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:45.120936 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af5914-4e13-4981-974e-88827bb2cbc8 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:45.238429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b6fda-8579-41f8-9d0b-33420ce0cea8 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:45.246524 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af5914-4e13-4981-974e-88827bb2cbc8 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:45.279427 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e9ddf-1e1c-4688-9741-66d281176c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:45.280289 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e9ddf-1e1c-4688-9741-66d281176c22 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:45.280609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e9ddf-1e1c-4688-9741-66d281176c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:45.281092 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e9ddf-1e1c-4688-9741-66d281176c22 None admin] PATH_INFO: `/v3/users/7964a1de2d2b450490c433cfebf4f7dd` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:45.282258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e9ddf-1e1c-4688-9741-66d281176c22 None admin] RBAC: Authorizing `identity:get_user(user_id=7964a1de2d2b450490c433cfebf4f7dd)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:45.283602 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e9ddf-1e1c-4688-9741-66d281176c22 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:45.283723 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8aa0f-71e0-4127-a987-ac2203b45fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:45.284463 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8aa0f-71e0-4127-a987-ac2203b45fac None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:45.284742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8aa0f-71e0-4127-a987-ac2203b45fac None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:45.285017 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8aa0f-71e0-4127-a987-ac2203b45fac None admin] PATH_INFO: `/v3/domains/default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:45.290422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 152/305] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:45 2022] GET /identity/v3/users/7964a1de2d2b450490c433cfebf4f7dd => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:45.290422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e9ddf-1e1c-4688-9741-66d281176c22 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:45.291350 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8aa0f-71e0-4127-a987-ac2203b45fac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:45.294102 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8aa0f-71e0-4127-a987-ac2203b45fac None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:45.296418 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 154/306] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:40:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:45.296418 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8aa0f-71e0-4127-a987-ac2203b45fac None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:45.305717 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:45.358786 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:45.403215 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e9ddf-1e1c-4688-9741-66d281176c22 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:45.413865 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8aa0f-71e0-4127-a987-ac2203b45fac None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:45.438378 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204fa7d-559d-455b-9074-c072b958fe7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:45.440099 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204fa7d-559d-455b-9074-c072b958fe7c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:45.440388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204fa7d-559d-455b-9074-c072b958fe7c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:45.440664 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204fa7d-559d-455b-9074-c072b958fe7c None admin] PATH_INFO: `/v3/users/e878679eef484c5cb8e6329e360c4341` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:45.450358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12afef04-d783-42fa-a979-37f292d14938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:45.451225 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afef04-d783-42fa-a979-37f292d14938 None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:45.451510 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afef04-d783-42fa-a979-37f292d14938 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:45.451788 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afef04-d783-42fa-a979-37f292d14938 None admin] PATH_INFO: `/v3/system/users/7964a1de2d2b450490c433cfebf4f7dd/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:45.453317 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12afef04-d783-42fa-a979-37f292d14938 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7964a1de2d2b450490c433cfebf4f7dd, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:45.454016 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204fa7d-559d-455b-9074-c072b958fe7c None admin] RBAC: Authorizing `identity:get_user(user_id=e878679eef484c5cb8e6329e360c4341)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:45.454845 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12afef04-d783-42fa-a979-37f292d14938 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:45.455495 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204fa7d-559d-455b-9074-c072b958fe7c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:45.458086 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 153/307] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:45 2022] GET /identity/v3/users/e878679eef484c5cb8e6329e360c4341 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:45.458086 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204fa7d-559d-455b-9074-c072b958fe7c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:45.466720 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 155/308] 10.222.0.18 () {58 vars in 1334 bytes} [Tue Jun 21 05:40:45 2022] PUT /identity/v3/system/users/7964a1de2d2b450490c433cfebf4f7dd/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:40:45.468052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b711c-d451-4242-87b5-d68e88b55252 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:45.468340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b711c-d451-4242-87b5-d68e88b55252 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:45.468616 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b711c-d451-4242-87b5-d68e88b55252 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:45.473988 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 156/309] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:45.473988 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b711c-d451-4242-87b5-d68e88b55252 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:45.548029 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:45.599478 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b711c-d451-4242-87b5-d68e88b55252 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:45.622924 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204fa7d-559d-455b-9074-c072b958fe7c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:45.644285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc57c3e-cdb1-4093-a23f-07d8363d01bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:45.645378 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc57c3e-cdb1-4093-a23f-07d8363d01bf None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:45.645378 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc57c3e-cdb1-4093-a23f-07d8363d01bf None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:45.645543 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc57c3e-cdb1-4093-a23f-07d8363d01bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:45.646796 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc57c3e-cdb1-4093-a23f-07d8363d01bf None admin] RBAC: Adding query filter params (role.id=3e721e6a74074d32bb3d80dad6e9974e, user.id=e878679eef484c5cb8e6329e360c4341, scope.system=all) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:45.646796 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc57c3e-cdb1-4093-a23f-07d8363d01bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:45.649983 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc57c3e-cdb1-4093-a23f-07d8363d01bf None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:45.655680 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:45.656780 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 157/310] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Jun 21 05:40:45 2022] GET /identity/v3/role_assignments?user.id=e878679eef484c5cb8e6329e360c4341&scope.system=all&role.id=3e721e6a74074d32bb3d80dad6e9974e => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:45.658881 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5cd9dd-2882-4068-b40f-b7337f0f2585 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:45.659203 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5cd9dd-2882-4068-b40f-b7337f0f2585 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:45.659523 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5cd9dd-2882-4068-b40f-b7337f0f2585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:45.687706 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197c60f-02e9-45e1-99fd-aedb93da49c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:45.688448 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197c60f-02e9-45e1-99fd-aedb93da49c1 None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:45.688738 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197c60f-02e9-45e1-99fd-aedb93da49c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:45.689054 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197c60f-02e9-45e1-99fd-aedb93da49c1 None admin] PATH_INFO: `/v3/groups` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:45.689373 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-fa5cd9dd-2882-4068-b40f-b7337f0f2585 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:45.689771 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197c60f-02e9-45e1-99fd-aedb93da49c1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:45.690758 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-fa5cd9dd-2882-4068-b40f-b7337f0f2585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:45.691350 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197c60f-02e9-45e1-99fd-aedb93da49c1 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:45.711265 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 154/311] 10.222.0.18 () {60 vars in 1134 bytes} [Tue Jun 21 05:40:45 2022] POST /identity/v3/groups => generated 229 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:40:45.786144 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 158/312] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:45.806673 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197c60f-02e9-45e1-99fd-aedb93da49c1 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:45.937055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197c60f-02e9-45e1-99fd-aedb93da49c1 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:45.983545 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117fef7-fbeb-489c-998d-141ae849a393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:45.984356 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117fef7-fbeb-489c-998d-141ae849a393 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:45.984637 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117fef7-fbeb-489c-998d-141ae849a393 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:45.984914 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117fef7-fbeb-489c-998d-141ae849a393 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:45.998234 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117fef7-fbeb-489c-998d-141ae849a393 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:46.006153 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-6117fef7-fbeb-489c-998d-141ae849a393 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 05:40:46.006153 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:46.006153 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:46.006153 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:46.006153 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:46.006153 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:46.006153 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:46.006153 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:46.006153 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:46.006153 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:46.006153 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:46.006153 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:46.006153 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:46.006153 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:46.006153 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:46.006153 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:46.007097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:46.007097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:46.007097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:46.007097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:46.007097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:46.007097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:46.007097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:46.007097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:46.007097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:46.007097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:46.007097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:46.007097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:46.007097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:46.007097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:46.007097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:46.007097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:46.007884 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:46.007884 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:46.007884 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:46.007884 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:46.007884 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:46.007884 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:46.007884 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:46.007884 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:46.007884 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:46.007884 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:46.007884 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 05:40:46.007884 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:40:46.007884 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 155/313] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:46.013581 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5cd9dd-2882-4068-b40f-b7337f0f2585 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:46.081055 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:46.134920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5cd9dd-2882-4068-b40f-b7337f0f2585 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:46.175955 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247196e4-598f-4444-a902-1e36af3a798b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:46.176630 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247196e4-598f-4444-a902-1e36af3a798b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:46.176915 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247196e4-598f-4444-a902-1e36af3a798b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:46.177188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247196e4-598f-4444-a902-1e36af3a798b None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:46.177959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247196e4-598f-4444-a902-1e36af3a798b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:46.178283 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247196e4-598f-4444-a902-1e36af3a798b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:46.179664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247196e4-598f-4444-a902-1e36af3a798b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:46.188705 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 159/314] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 21 05:40:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:46.194610 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117fef7-fbeb-489c-998d-141ae849a393 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:46.236177 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:46.310450 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117fef7-fbeb-489c-998d-141ae849a393 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:46.350270 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f3e2f-eb49-4cc7-9bd8-67193409530e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:46.351473 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f3e2f-eb49-4cc7-9bd8-67193409530e None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:46.351984 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f3e2f-eb49-4cc7-9bd8-67193409530e None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:46.352472 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f3e2f-eb49-4cc7-9bd8-67193409530e None admin] PATH_INFO: `/v3/users/bd8ee6be30b047cc9e5e5c2c5e9479fb` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:46.353886 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f3e2f-eb49-4cc7-9bd8-67193409530e None admin] RBAC: Authorizing `identity:get_user(user_id=bd8ee6be30b047cc9e5e5c2c5e9479fb)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:46.355573 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f3e2f-eb49-4cc7-9bd8-67193409530e None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:46.357697 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 156/315] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:46 2022] GET /identity/v3/users/bd8ee6be30b047cc9e5e5c2c5e9479fb => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:46.370048 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247196e4-598f-4444-a902-1e36af3a798b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:46.482122 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247196e4-598f-4444-a902-1e36af3a798b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:46.508004 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:46.520820 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb91f3-a59d-46d3-bb73-aebc630365cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:46.521681 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb91f3-a59d-46d3-bb73-aebc630365cd None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:46.522142 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb91f3-a59d-46d3-bb73-aebc630365cd None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:46.522565 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb91f3-a59d-46d3-bb73-aebc630365cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:46.596605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb91f3-a59d-46d3-bb73-aebc630365cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:46.598379 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb91f3-a59d-46d3-bb73-aebc630365cd None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:46.712795 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 160/316] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:40:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:40:46.714425 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f3e2f-eb49-4cc7-9bd8-67193409530e None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:46.820717 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f3e2f-eb49-4cc7-9bd8-67193409530e None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:46.823061 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:46.855156 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf44817-e487-411a-8137-8ad71799df0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:46.856016 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf44817-e487-411a-8137-8ad71799df0b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:46.856293 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf44817-e487-411a-8137-8ad71799df0b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:46.856562 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf44817-e487-411a-8137-8ad71799df0b None admin] PATH_INFO: `/v3/projects/6b293e7dd1fa40ad886795d229901112` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:46.858043 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf44817-e487-411a-8137-8ad71799df0b None admin] RBAC: Authorizing `identity:get_project(project_id=6b293e7dd1fa40ad886795d229901112)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:46.859488 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf44817-e487-411a-8137-8ad71799df0b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:46.862024 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 157/317] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:46 2022] GET /identity/v3/projects/6b293e7dd1fa40ad886795d229901112 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:46.867553 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb91f3-a59d-46d3-bb73-aebc630365cd None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:46.895844 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:46.976145 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb91f3-a59d-46d3-bb73-aebc630365cd None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:47.016289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122acf7-be48-4865-8bb6-df57ea033174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:47.017287 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122acf7-be48-4865-8bb6-df57ea033174 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:47.017729 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122acf7-be48-4865-8bb6-df57ea033174 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:47.018186 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122acf7-be48-4865-8bb6-df57ea033174 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:47.019199 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122acf7-be48-4865-8bb6-df57ea033174 None admin] RBAC: Adding query filter params (role.id=3e721e6a74074d32bb3d80dad6e9974e, scope.project.id=6b293e7dd1fa40ad886795d229901112, user.id=bd8ee6be30b047cc9e5e5c2c5e9479fb) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:47.019694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122acf7-be48-4865-8bb6-df57ea033174 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:47.021355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122acf7-be48-4865-8bb6-df57ea033174 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:47.034070 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 161/318] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:40:46 2022] GET /identity/v3/role_assignments?user.id=bd8ee6be30b047cc9e5e5c2c5e9479fb&scope.project.id=6b293e7dd1fa40ad886795d229901112&role.id=3e721e6a74074d32bb3d80dad6e9974e => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:47.597369 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd6d50-7204-4cb6-b4dd-93676a1c346d None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:47.597712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd6d50-7204-4cb6-b4dd-93676a1c346d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:47.597955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd6d50-7204-4cb6-b4dd-93676a1c346d None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:47.599389 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 158/319] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:47.604429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0a686-dcef-4f77-bca3-23eea079ed64 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:47.604857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0a686-dcef-4f77-bca3-23eea079ed64 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:47.605014 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0a686-dcef-4f77-bca3-23eea079ed64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:47.621863 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-d8a0a686-dcef-4f77-bca3-23eea079ed64 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:47.623087 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d8a0a686-dcef-4f77-bca3-23eea079ed64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:47.691636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 162/320] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:47.715214 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd6d50-7204-4cb6-b4dd-93676a1c346d None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:47.813247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f2180-ef61-43e2-b62c-281b57051330 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:47.813542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f2180-ef61-43e2-b62c-281b57051330 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:47.813840 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f2180-ef61-43e2-b62c-281b57051330 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:47.815278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 163/321] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 05:40:47.820147 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d44b7-8d98-432c-9cff-112fd4860347 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:47.820428 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d44b7-8d98-432c-9cff-112fd4860347 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:47.820700 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d44b7-8d98-432c-9cff-112fd4860347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:47.821522 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd6d50-7204-4cb6-b4dd-93676a1c346d None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:47.837316 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-db0d44b7-8d98-432c-9cff-112fd4860347 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:47.838533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-db0d44b7-8d98-432c-9cff-112fd4860347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:47.852924 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:47.859600 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcc699-be69-4d82-b1bd-700e9b757efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:47.860398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcc699-be69-4d82-b1bd-700e9b757efa None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:47.860710 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcc699-be69-4d82-b1bd-700e9b757efa None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:47.860991 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcc699-be69-4d82-b1bd-700e9b757efa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:47.871632 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbcc699-be69-4d82-b1bd-700e9b757efa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:47.879882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-2dbcc699-be69-4d82-b1bd-700e9b757efa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:47.879882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:47.879882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:47.879882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:47.879882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:47.879882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:47.879882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:47.879882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:47.879882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:47.879882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:47.879882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:47.879882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:47.879882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:47.879882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:47.879882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:47.879882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:47.880759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:47.880759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:47.880759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:47.880759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:47.880759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:47.880759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:47.880759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:47.880759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:47.880759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:47.880759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:47.880759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:47.880759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:47.880759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:47.880759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:47.880759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:47.880759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:47.886495 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:47.886495 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:47.886495 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:47.886495 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:47.886495 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:47.886495 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:47.886495 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:47.886495 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:47.886495 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:47.886495 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:47.886495 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:47.886495 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:40:47.886495 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 159/322] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:47.887317 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcc699-be69-4d82-b1bd-700e9b757efa None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:47.915845 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 164/323] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 05:40:47.919402 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:47.939444 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d44b7-8d98-432c-9cff-112fd4860347 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:47.993732 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcc699-be69-4d82-b1bd-700e9b757efa None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:48.027130 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71beb486-0801-4e9c-b947-a1d894d1bb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:48.027880 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71beb486-0801-4e9c-b947-a1d894d1bb44 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:48.028171 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71beb486-0801-4e9c-b947-a1d894d1bb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:48.028450 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71beb486-0801-4e9c-b947-a1d894d1bb44 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:48.029198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71beb486-0801-4e9c-b947-a1d894d1bb44 None admin] RBAC: Adding query filter params (name=member) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:48.029508 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71beb486-0801-4e9c-b947-a1d894d1bb44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:48.030930 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71beb486-0801-4e9c-b947-a1d894d1bb44 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:48.037392 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d44b7-8d98-432c-9cff-112fd4860347 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:48.039113 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 160/324] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 21 05:40:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:48.040400 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9c989-e886-455f-b1a2-3c2ec0b87b9b None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:48.040697 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9c989-e886-455f-b1a2-3c2ec0b87b9b None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:48.040980 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9c989-e886-455f-b1a2-3c2ec0b87b9b None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:48.042238 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 161/325] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:48.047112 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9c989-e886-455f-b1a2-3c2ec0b87b9b None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:48.075730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c6de4-c70f-4bca-a7aa-cb5998cb3170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:48.076518 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c6de4-c70f-4bca-a7aa-cb5998cb3170 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:48.076800 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c6de4-c70f-4bca-a7aa-cb5998cb3170 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:48.077076 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c6de4-c70f-4bca-a7aa-cb5998cb3170 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:48.087928 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c6de4-c70f-4bca-a7aa-cb5998cb3170 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:48.095615 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-b94c6de4-c70f-4bca-a7aa-cb5998cb3170 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 05:40:48.095615 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:48.095615 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:48.095615 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:48.095615 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:48.095615 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:48.095615 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:48.095615 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:48.095615 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:48.095615 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:48.095615 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:48.095615 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:48.095615 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:48.095615 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:48.095615 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:48.095615 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:48.096617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:48.096617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:48.096617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:48.096617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:48.096617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:48.096617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:48.096617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:48.096617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:48.096617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:48.096617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:48.096617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:48.096617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:48.096617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:48.096617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:48.096617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:48.096617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:48.097404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:48.097404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:48.097404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:48.097404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:48.097404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:48.097404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:48.097404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:48.097404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:48.097404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:48.097404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:48.097404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 05:40:48.097404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:40:48.097404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 165/326] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:40:48.098396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe3399-4908-4019-ac24-9f64d7a2747f None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:48.098541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe3399-4908-4019-ac24-9f64d7a2747f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:48.098812 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe3399-4908-4019-ac24-9f64d7a2747f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:48.115444 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-ccbe3399-4908-4019-ac24-9f64d7a2747f None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:48.116630 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ccbe3399-4908-4019-ac24-9f64d7a2747f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:48.118774 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:48.150064 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:48.158140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9c989-e886-455f-b1a2-3c2ec0b87b9b None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:48.185684 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 166/327] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:48.186574 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe3399-4908-4019-ac24-9f64d7a2747f None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:48.192697 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0652ad-cf1d-4c36-b2d2-838c877c072f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:48.193570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0652ad-cf1d-4c36-b2d2-838c877c072f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:48.193852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0652ad-cf1d-4c36-b2d2-838c877c072f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:48.194158 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0652ad-cf1d-4c36-b2d2-838c877c072f None admin] PATH_INFO: `/v3/users/7964a1de2d2b450490c433cfebf4f7dd` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:48.195332 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0652ad-cf1d-4c36-b2d2-838c877c072f None admin] RBAC: Authorizing `identity:get_user(user_id=7964a1de2d2b450490c433cfebf4f7dd)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:48.196772 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0652ad-cf1d-4c36-b2d2-838c877c072f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:48.203012 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 162/328] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:48 2022] GET /identity/v3/users/7964a1de2d2b450490c433cfebf4f7dd => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:48.203790 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0652ad-cf1d-4c36-b2d2-838c877c072f None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:48.291469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe3399-4908-4019-ac24-9f64d7a2747f None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:48.301531 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0652ad-cf1d-4c36-b2d2-838c877c072f None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:48.325076 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dca231-11ba-4397-bd51-4f568260b824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:48.326047 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dca231-11ba-4397-bd51-4f568260b824 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:48.326402 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dca231-11ba-4397-bd51-4f568260b824 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:48.326689 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dca231-11ba-4397-bd51-4f568260b824 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:48.327440 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dca231-11ba-4397-bd51-4f568260b824 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:48.327751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dca231-11ba-4397-bd51-4f568260b824 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:48.329149 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dca231-11ba-4397-bd51-4f568260b824 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:48.334644 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:48.336991 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524fa600-e9f4-4aba-987a-80319f208f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:48.337677 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fa600-e9f4-4aba-987a-80319f208f14 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:48.337990 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fa600-e9f4-4aba-987a-80319f208f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:48.338275 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fa600-e9f4-4aba-987a-80319f208f14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:48.339112 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524fa600-e9f4-4aba-987a-80319f208f14 None admin] RBAC: Adding query filter params (role.id=a9602a7e01694084a0f9713d9d6394b1, user.id=7964a1de2d2b450490c433cfebf4f7dd, scope.system=all) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:48.339426 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524fa600-e9f4-4aba-987a-80319f208f14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:48.340842 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524fa600-e9f4-4aba-987a-80319f208f14 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:48.342986 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 167/329] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 21 05:40:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:48.343879 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dca231-11ba-4397-bd51-4f568260b824 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:48.353347 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 163/330] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Jun 21 05:40:48 2022] GET /identity/v3/role_assignments?user.id=7964a1de2d2b450490c433cfebf4f7dd&scope.system=all&role.id=a9602a7e01694084a0f9713d9d6394b1 => generated 510 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:40:48.354828 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524fa600-e9f4-4aba-987a-80319f208f14 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:48.378628 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:48.458555 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dca231-11ba-4397-bd51-4f568260b824 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:48.469398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524fa600-e9f4-4aba-987a-80319f208f14 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:48.496678 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee4e8b-ea34-4475-93dc-eca1cba8a9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:48.497471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee4e8b-ea34-4475-93dc-eca1cba8a9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:48.497750 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee4e8b-ea34-4475-93dc-eca1cba8a9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:48.498059 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee4e8b-ea34-4475-93dc-eca1cba8a9b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:48.499230 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee4e8b-ea34-4475-93dc-eca1cba8a9b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:48.500691 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee4e8b-ea34-4475-93dc-eca1cba8a9b2 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:48.502545 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 168/331] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:40:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:48.508531 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee4e8b-ea34-4475-93dc-eca1cba8a9b2 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:48.511570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e50ffc-172d-4667-b4f2-db7e60e3fa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:48.511858 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e50ffc-172d-4667-b4f2-db7e60e3fa11 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:48.512142 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e50ffc-172d-4667-b4f2-db7e60e3fa11 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:48.512425 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e50ffc-172d-4667-b4f2-db7e60e3fa11 None admin] PATH_INFO: `/v3/users/e878679eef484c5cb8e6329e360c4341` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:48.514171 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e50ffc-172d-4667-b4f2-db7e60e3fa11 None admin] RBAC: Authorizing `identity:get_user(user_id=e878679eef484c5cb8e6329e360c4341)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:48.515609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e50ffc-172d-4667-b4f2-db7e60e3fa11 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:48.517994 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 164/332] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:48 2022] GET /identity/v3/users/e878679eef484c5cb8e6329e360c4341 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:48.523514 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e50ffc-172d-4667-b4f2-db7e60e3fa11 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:48.581529 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:48.615142 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee4e8b-ea34-4475-93dc-eca1cba8a9b2 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:48.621004 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:48.633865 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e50ffc-172d-4667-b4f2-db7e60e3fa11 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:48.648510 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d11bd6-fe5c-4f85-9a7e-cc5692c20634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:48.649178 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d11bd6-fe5c-4f85-9a7e-cc5692c20634 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:48.649464 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d11bd6-fe5c-4f85-9a7e-cc5692c20634 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:48.649749 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d11bd6-fe5c-4f85-9a7e-cc5692c20634 None admin] PATH_INFO: `/v3/groups` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:48.650472 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d11bd6-fe5c-4f85-9a7e-cc5692c20634 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:48.651917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d11bd6-fe5c-4f85-9a7e-cc5692c20634 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:48.665739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 169/333] 10.222.0.18 () {60 vars in 1134 bytes} [Tue Jun 21 05:40:48 2022] POST /identity/v3/groups => generated 226 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 05:40:48.667328 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0fd54-4d6e-401d-8e2b-c1e53bbb5ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:48.668261 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0fd54-4d6e-401d-8e2b-c1e53bbb5ca9 None admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:48.668549 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0fd54-4d6e-401d-8e2b-c1e53bbb5ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:48.668835 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0fd54-4d6e-401d-8e2b-c1e53bbb5ca9 None admin] PATH_INFO: `/v3/system/users/e878679eef484c5cb8e6329e360c4341/roles/3e721e6a74074d32bb3d80dad6e9974e` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:48.670431 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0fd54-4d6e-401d-8e2b-c1e53bbb5ca9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e878679eef484c5cb8e6329e360c4341, role_id=3e721e6a74074d32bb3d80dad6e9974e)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:48.671845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0fd54-4d6e-401d-8e2b-c1e53bbb5ca9 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:48.681017 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 165/334] 10.222.0.18 () {58 vars in 1334 bytes} [Tue Jun 21 05:40:48 2022] PUT /identity/v3/system/users/e878679eef484c5cb8e6329e360c4341/roles/3e721e6a74074d32bb3d80dad6e9974e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 05:40:51.057383 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42927e2a-a0db-494e-b230-bea065ef5f18 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:51.058517 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42927e2a-a0db-494e-b230-bea065ef5f18 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:51.059027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42927e2a-a0db-494e-b230-bea065ef5f18 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:51.060990 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 170/335] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:51.066153 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf471a-3110-4ece-acf7-ef8976af6d16 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:51.066649 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf471a-3110-4ece-acf7-ef8976af6d16 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:51.066732 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf471a-3110-4ece-acf7-ef8976af6d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:51.091150 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-b3cf471a-3110-4ece-acf7-ef8976af6d16 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:51.092365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b3cf471a-3110-4ece-acf7-ef8976af6d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:51.109236 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0772d-b0e6-48ae-bcea-8d480a391533 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:51.109874 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0772d-b0e6-48ae-bcea-8d480a391533 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:51.110403 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0772d-b0e6-48ae-bcea-8d480a391533 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:51.120496 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 171/336] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:51 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:51.128363 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415e9ed-0a33-474d-ae58-b6277c5e2a72 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:51.128999 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415e9ed-0a33-474d-ae58-b6277c5e2a72 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:51.129522 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415e9ed-0a33-474d-ae58-b6277c5e2a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:51.160340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-f415e9ed-0a33-474d-ae58-b6277c5e2a72 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:51.160800 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f415e9ed-0a33-474d-ae58-b6277c5e2a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:51.238751 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 166/337] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:51.271370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 172/338] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:51.299137 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf471a-3110-4ece-acf7-ef8976af6d16 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:51.332266 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415e9ed-0a33-474d-ae58-b6277c5e2a72 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:51.470869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:51.517343 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:51.556118 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf471a-3110-4ece-acf7-ef8976af6d16 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:51.564517 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415e9ed-0a33-474d-ae58-b6277c5e2a72 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:51.604634 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cbb6a-4e52-4b67-a29a-aae9c1cf79b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:51.605357 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cbb6a-4e52-4b67-a29a-aae9c1cf79b2 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:51.605648 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cbb6a-4e52-4b67-a29a-aae9c1cf79b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:51.605965 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cbb6a-4e52-4b67-a29a-aae9c1cf79b2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:51.618916 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516cbb6a-4e52-4b67-a29a-aae9c1cf79b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:51.627894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-516cbb6a-4e52-4b67-a29a-aae9c1cf79b2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 05:40:51.627894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:51.627894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:51.627894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:51.627894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:51.627894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:51.627894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:51.627894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:51.627894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:51.627894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:51.627894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:51.627894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:51.627894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:51.627894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:51.627894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:51.627894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:51.628845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:51.628845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:51.628845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:51.628845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:51.628845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:51.628845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:51.628845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:51.628845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:51.628845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:51.628845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:51.628845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:51.628845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:51.628845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:51.628845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:51.628845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:51.628845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:51.629692 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:51.629692 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:51.629692 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:51.629692 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:51.629692 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:51.629692 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:51.629692 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:51.629692 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:51.629692 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:51.629692 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:51.629692 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 05:40:51.629692 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:40:51.630389 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 167/339] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:51.637071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cbb6a-4e52-4b67-a29a-aae9c1cf79b2 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:51.658660 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6945a-b701-4118-855c-1b8b2d8c68c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:51.659478 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6945a-b701-4118-855c-1b8b2d8c68c7 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:51.659759 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6945a-b701-4118-855c-1b8b2d8c68c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:51.660036 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6945a-b701-4118-855c-1b8b2d8c68c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:51.677869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6945a-b701-4118-855c-1b8b2d8c68c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:51.685713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-2be6945a-b701-4118-855c-1b8b2d8c68c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:51.685713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:51.685713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:51.685713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:51.685713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:51.685713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:51.685713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:51.685713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:51.685713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:51.685713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:51.685713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:51.685713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:51.685713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:51.685713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:51.685713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:51.685713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:51.686876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:51.686876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:51.686876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:51.686876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:51.686876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:51.686876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:51.686876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:51.686876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:51.686876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:51.686876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:51.686876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:51.686876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:51.686876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:51.686876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:51.686876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:51.686876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:51.688547 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:51.688547 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:51.688547 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:51.688547 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:51.688547 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:51.688547 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:51.688547 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:51.688547 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:51.688547 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:51.688547 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:51.688547 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:51.688547 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:40:51.699284 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 173/340] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:40:51.707498 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6945a-b701-4118-855c-1b8b2d8c68c7 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:51.762406 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cbb6a-4e52-4b67-a29a-aae9c1cf79b2 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:51.800689 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2823661-b957-43a0-9f4c-9930eabf097b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:51.801399 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2823661-b957-43a0-9f4c-9930eabf097b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:51.801688 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2823661-b957-43a0-9f4c-9930eabf097b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:51.801999 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2823661-b957-43a0-9f4c-9930eabf097b None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:51.802831 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2823661-b957-43a0-9f4c-9930eabf097b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:51.803145 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2823661-b957-43a0-9f4c-9930eabf097b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:51.804541 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2823661-b957-43a0-9f4c-9930eabf097b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:51.814455 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 168/341] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 21 05:40:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:51.820006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2823661-b957-43a0-9f4c-9930eabf097b None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:51.824455 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:51.918300 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6945a-b701-4118-855c-1b8b2d8c68c7 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:51.931237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2823661-b957-43a0-9f4c-9930eabf097b None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:51.950395 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:51.969308 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d353e-8a96-4ab9-b0b4-7f174f97ad6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:51.970255 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d353e-8a96-4ab9-b0b4-7f174f97ad6c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:51.970538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d353e-8a96-4ab9-b0b4-7f174f97ad6c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:51.970817 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d353e-8a96-4ab9-b0b4-7f174f97ad6c None admin] PATH_INFO: `/v3/users/e878679eef484c5cb8e6329e360c4341` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:51.972127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d353e-8a96-4ab9-b0b4-7f174f97ad6c None admin] RBAC: Authorizing `identity:get_user(user_id=e878679eef484c5cb8e6329e360c4341)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:51.973504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d353e-8a96-4ab9-b0b4-7f174f97ad6c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:51.975533 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 169/342] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:40:51 2022] GET /identity/v3/users/e878679eef484c5cb8e6329e360c4341 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:40:51.976813 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fdea7-0695-4239-b825-72230fb2f6b7 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:51.977112 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fdea7-0695-4239-b825-72230fb2f6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:51.977396 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fdea7-0695-4239-b825-72230fb2f6b7 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:51.978987 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 170/343] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:51.982315 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fdea7-0695-4239-b825-72230fb2f6b7 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:51.985962 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2c6b3-f5f0-4e8d-ba59-e90083b65de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:51.986759 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2c6b3-f5f0-4e8d-ba59-e90083b65de0 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:51.987047 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2c6b3-f5f0-4e8d-ba59-e90083b65de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:51.987321 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2c6b3-f5f0-4e8d-ba59-e90083b65de0 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:51.988076 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2c6b3-f5f0-4e8d-ba59-e90083b65de0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:51.988382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2c6b3-f5f0-4e8d-ba59-e90083b65de0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:51.989767 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2c6b3-f5f0-4e8d-ba59-e90083b65de0 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:52.008226 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 174/344] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 21 05:40:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:52.009511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec8b00-27af-4ecc-a8db-cdde0db7b6d2 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:52.009892 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec8b00-27af-4ecc-a8db-cdde0db7b6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:52.010194 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec8b00-27af-4ecc-a8db-cdde0db7b6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:52.040535 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-78ec8b00-27af-4ecc-a8db-cdde0db7b6d2 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:52.041801 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-78ec8b00-27af-4ecc-a8db-cdde0db7b6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:52.061064 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:52.097445 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fdea7-0695-4239-b825-72230fb2f6b7 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:52.135490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737ae6a-ae53-4289-b0eb-fbaa9743f935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:52.136154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737ae6a-ae53-4289-b0eb-fbaa9743f935 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:52.136443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737ae6a-ae53-4289-b0eb-fbaa9743f935 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:52.136727 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737ae6a-ae53-4289-b0eb-fbaa9743f935 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:52.137572 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737ae6a-ae53-4289-b0eb-fbaa9743f935 None admin] RBAC: Adding query filter params (role.id=3e721e6a74074d32bb3d80dad6e9974e, user.id=e878679eef484c5cb8e6329e360c4341, scope.system=all) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:52.137886 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737ae6a-ae53-4289-b0eb-fbaa9743f935 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:52.139359 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737ae6a-ae53-4289-b0eb-fbaa9743f935 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:52.153044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 171/346] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Jun 21 05:40:51 2022] GET /identity/v3/role_assignments?user.id=e878679eef484c5cb8e6329e360c4341&scope.system=all&role.id=3e721e6a74074d32bb3d80dad6e9974e => generated 510 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:40:52.153988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737ae6a-ae53-4289-b0eb-fbaa9743f935 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:52.154197 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 175/346] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:52.155699 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32dc89-ce5d-45e1-9e80-67d16cc5b3dd None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:52.155989 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32dc89-ce5d-45e1-9e80-67d16cc5b3dd None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:52.156271 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32dc89-ce5d-45e1-9e80-67d16cc5b3dd None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:52.158042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 176/347] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:52.172078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151fc54-358d-45cf-8fac-d12fa345a99c None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:52.172405 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151fc54-358d-45cf-8fac-d12fa345a99c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:52.172690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151fc54-358d-45cf-8fac-d12fa345a99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:52.198855 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-a151fc54-358d-45cf-8fac-d12fa345a99c None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:52.200099 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a151fc54-358d-45cf-8fac-d12fa345a99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:52.270627 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737ae6a-ae53-4289-b0eb-fbaa9743f935 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:52.301333 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 177/348] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 05:40:52.302337 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151fc54-358d-45cf-8fac-d12fa345a99c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:52.304374 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:52.311182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00984026-8130-4942-9515-079af15a9201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:52.311844 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00984026-8130-4942-9515-079af15a9201 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:52.312133 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00984026-8130-4942-9515-079af15a9201 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:52.312415 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00984026-8130-4942-9515-079af15a9201 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:52.371296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:52.394506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00984026-8130-4942-9515-079af15a9201 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:52.396034 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00984026-8130-4942-9515-079af15a9201 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:52.454877 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151fc54-358d-45cf-8fac-d12fa345a99c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:52.509182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 172/349] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:40:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:40:52.510066 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00984026-8130-4942-9515-079af15a9201 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:52.514787 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39d22b-569e-459b-8439-b3709cf5bfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:52.515589 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39d22b-569e-459b-8439-b3709cf5bfe4 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:52.515868 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39d22b-569e-459b-8439-b3709cf5bfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:52.516137 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39d22b-569e-459b-8439-b3709cf5bfe4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:52.534409 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39d22b-569e-459b-8439-b3709cf5bfe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:52.542663 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:52.544372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-5c39d22b-569e-459b-8439-b3709cf5bfe4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:52.544372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:52.544372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:52.544372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:52.544372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:52.544372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:52.544372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:52.544372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:52.544372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:52.544372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:52.544372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:52.544372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:52.544372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:52.544372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:52.544372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:52.544372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:52.545353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:52.545353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:52.545353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:52.545353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:52.545353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:52.545353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:52.545353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:52.545353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:52.545353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:52.545353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:52.545353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:52.545353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:52.545353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:52.545353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:52.545353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:52.545353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:52.546211 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:52.546211 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:52.546211 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:52.546211 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:52.546211 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:52.546211 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:52.546211 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:52.546211 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:52.546211 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:52.546211 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:52.546211 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:52.546211 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:40:52.551502 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 178/350] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:52.552605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39d22b-569e-459b-8439-b3709cf5bfe4 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:52.636775 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00984026-8130-4942-9515-079af15a9201 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:52.686664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:52.690646 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39d22b-569e-459b-8439-b3709cf5bfe4 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:52.692402 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae9990-b903-4f4b-b4d7-5f55fe589707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:52.693232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae9990-b903-4f4b-b4d7-5f55fe589707 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:52.693680 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae9990-b903-4f4b-b4d7-5f55fe589707 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:52.694038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae9990-b903-4f4b-b4d7-5f55fe589707 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:52.718557 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae9990-b903-4f4b-b4d7-5f55fe589707 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:52.728071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-27ae9990-b903-4f4b-b4d7-5f55fe589707 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 05:40:52.728071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:52.728071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:52.728071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:52.728071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:52.728071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:52.728071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:52.728071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:52.728071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:52.728071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:52.728071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:52.728071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:52.728071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:52.728071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:52.728071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:52.728071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:52.729200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:52.729200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:52.729200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:52.729200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:52.729200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:52.729200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:52.729200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:52.729200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:52.729200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:52.729200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:52.729200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:52.729200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:52.729200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:52.729200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:52.729200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:52.729200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:52.730219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:52.730219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:52.730219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:52.730219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:52.730219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:52.730219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:52.730219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:52.730219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:52.730219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:52.730219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:52.730219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 05:40:52.730219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:40:52.730219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 173/351] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 21 05:40:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:52.737339 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9147e-1733-45a0-8a90-740009233fac None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:52.737339 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9147e-1733-45a0-8a90-740009233fac None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:52.737339 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9147e-1733-45a0-8a90-740009233fac None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:52.737339 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 174/352] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:52.737339 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9147e-1733-45a0-8a90-740009233fac None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:52.741325 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff84e9-a7fd-4e1b-a4c2-794d69edcc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:52.743087 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff84e9-a7fd-4e1b-a4c2-794d69edcc7e None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:52.743087 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff84e9-a7fd-4e1b-a4c2-794d69edcc7e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:52.743087 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff84e9-a7fd-4e1b-a4c2-794d69edcc7e None admin] PATH_INFO: `/v3/projects/f8f1415161a745f387f7c6563159c122` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:52.746058 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff84e9-a7fd-4e1b-a4c2-794d69edcc7e None admin] RBAC: Authorizing `identity:get_project(project_id=f8f1415161a745f387f7c6563159c122)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:52.747475 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff84e9-a7fd-4e1b-a4c2-794d69edcc7e None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:52.749509 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 179/353] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:52 2022] GET /identity/v3/projects/f8f1415161a745f387f7c6563159c122 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:52.750313 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff84e9-a7fd-4e1b-a4c2-794d69edcc7e None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:52.880653 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:52.891623 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9147e-1733-45a0-8a90-740009233fac None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:52.906830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff84e9-a7fd-4e1b-a4c2-794d69edcc7e None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:52.943138 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0782b-fbbb-49a5-8c7a-db6585cacbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:52.943826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0782b-fbbb-49a5-8c7a-db6585cacbb9 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:52.944115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0782b-fbbb-49a5-8c7a-db6585cacbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:52.944401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0782b-fbbb-49a5-8c7a-db6585cacbb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:52.945157 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0782b-fbbb-49a5-8c7a-db6585cacbb9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:52.945471 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0782b-fbbb-49a5-8c7a-db6585cacbb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:52.946902 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0782b-fbbb-49a5-8c7a-db6585cacbb9 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:52.957636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 175/354] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 21 05:40:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:52.958859 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d6071-e9b9-473a-84f8-f3850b8c4ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:52.959785 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d6071-e9b9-473a-84f8-f3850b8c4ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:52.960139 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd95fe-de95-467f-a181-726aed620c8d None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:52.960436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd95fe-de95-467f-a181-726aed620c8d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:52.960718 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd95fe-de95-467f-a181-726aed620c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:52.960819 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d6071-e9b9-473a-84f8-f3850b8c4ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:52.961288 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d6071-e9b9-473a-84f8-f3850b8c4ef9 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:52.962270 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d6071-e9b9-473a-84f8-f3850b8c4ef9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:52.962888 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d6071-e9b9-473a-84f8-f3850b8c4ef9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:52.964711 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d6071-e9b9-473a-84f8-f3850b8c4ef9 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:52.975428 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 180/355] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:40:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:52.976267 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d6071-e9b9-473a-84f8-f3850b8c4ef9 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:52.982757 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-ecdd95fe-de95-467f-a181-726aed620c8d None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:52.984040 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ecdd95fe-de95-467f-a181-726aed620c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:53.018655 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:53.086790 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 176/356] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:53.087656 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd95fe-de95-467f-a181-726aed620c8d None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:53.123258 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d6071-e9b9-473a-84f8-f3850b8c4ef9 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:53.163640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c1252-1f7f-4113-b5e2-d2acac6ed0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:53.165378 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c1252-1f7f-4113-b5e2-d2acac6ed0ec None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:53.165661 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c1252-1f7f-4113-b5e2-d2acac6ed0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:53.165967 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c1252-1f7f-4113-b5e2-d2acac6ed0ec None admin] PATH_INFO: `/v3/groups/b6b809c32f744ed78c642d920f86998e` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:53.173669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c1252-1f7f-4113-b5e2-d2acac6ed0ec None admin] RBAC: Authorizing `identity:get_group(group_id=b6b809c32f744ed78c642d920f86998e)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:53.175354 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c1252-1f7f-4113-b5e2-d2acac6ed0ec None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:53.177222 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 181/357] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jun 21 05:40:52 2022] GET /identity/v3/groups/b6b809c32f744ed78c642d920f86998e => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:53.179193 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c1252-1f7f-4113-b5e2-d2acac6ed0ec None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:53.210283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:53.239431 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd95fe-de95-467f-a181-726aed620c8d None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:53.291029 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39bcbc-25fb-47bc-a74f-5279d1ba5161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:53.291029 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39bcbc-25fb-47bc-a74f-5279d1ba5161 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:53.291029 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39bcbc-25fb-47bc-a74f-5279d1ba5161 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:53.295297 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39bcbc-25fb-47bc-a74f-5279d1ba5161 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:53.328313 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:53.335312 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c1252-1f7f-4113-b5e2-d2acac6ed0ec None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:53.383551 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f95ad-5e6c-4e55-8da6-dc7d23b2cd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:53.384471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f95ad-5e6c-4e55-8da6-dc7d23b2cd41 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:53.384758 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f95ad-5e6c-4e55-8da6-dc7d23b2cd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:53.385035 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f95ad-5e6c-4e55-8da6-dc7d23b2cd41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:53.406361 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39bcbc-25fb-47bc-a74f-5279d1ba5161 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:53.409657 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39bcbc-25fb-47bc-a74f-5279d1ba5161 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:53.475367 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f95ad-5e6c-4e55-8da6-dc7d23b2cd41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:53.477326 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f95ad-5e6c-4e55-8da6-dc7d23b2cd41 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:53.529303 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:53.554896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 177/358] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:40:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:40:53.562111 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39bcbc-25fb-47bc-a74f-5279d1ba5161 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:53.623445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:53.636146 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 182/359] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:40:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:40:53.637091 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f95ad-5e6c-4e55-8da6-dc7d23b2cd41 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:53.709058 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39bcbc-25fb-47bc-a74f-5279d1ba5161 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:53.749652 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9059960-892d-4abd-b143-64f35731ac3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:53.750517 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9059960-892d-4abd-b143-64f35731ac3c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:53.750807 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9059960-892d-4abd-b143-64f35731ac3c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:53.751660 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9059960-892d-4abd-b143-64f35731ac3c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:53.766462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9059960-892d-4abd-b143-64f35731ac3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:53.769591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f95ad-5e6c-4e55-8da6-dc7d23b2cd41 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:53.775988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-b9059960-892d-4abd-b143-64f35731ac3c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 05:40:53.775988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:53.775988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:53.775988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:53.775988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:53.775988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:53.775988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:53.775988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:53.775988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:53.775988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:53.775988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:53.775988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:53.775988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:53.775988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:53.775988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:53.775988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:53.776929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:53.776929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:53.776929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:53.776929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:53.776929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:53.776929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:53.776929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:53.776929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:53.776929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:53.776929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:53.776929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:53.776929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:53.776929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:53.776929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:53.776929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:53.776929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:53.777721 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:53.777721 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:53.777721 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:53.777721 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:53.777721 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:53.777721 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:53.777721 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:53.777721 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:53.777721 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:53.777721 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:53.777721 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 05:40:53.777721 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:40:53.777721 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 178/360] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 21 05:40:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:53.778980 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad10c05-e82a-46f3-884f-6b5031e41530 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:53.779095 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad10c05-e82a-46f3-884f-6b5031e41530 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:53.779862 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad10c05-e82a-46f3-884f-6b5031e41530 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:53.781781 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 179/361] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:53.781781 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad10c05-e82a-46f3-884f-6b5031e41530 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:53.812691 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec113295-aa85-440f-85ba-7a5aafd2740f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:53.814250 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec113295-aa85-440f-85ba-7a5aafd2740f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:53.814536 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec113295-aa85-440f-85ba-7a5aafd2740f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:53.814811 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec113295-aa85-440f-85ba-7a5aafd2740f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:53.815818 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec113295-aa85-440f-85ba-7a5aafd2740f None admin] RBAC: Adding query filter params (group.id=b6b809c32f744ed78c642d920f86998e, role.id=a9602a7e01694084a0f9713d9d6394b1, scope.project.id=f8f1415161a745f387f7c6563159c122) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:53.816133 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec113295-aa85-440f-85ba-7a5aafd2740f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:53.817599 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec113295-aa85-440f-85ba-7a5aafd2740f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:53.823715 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 183/362] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jun 21 05:40:53 2022] GET /identity/v3/role_assignments?group.id=b6b809c32f744ed78c642d920f86998e&scope.project.id=f8f1415161a745f387f7c6563159c122&role.id=a9602a7e01694084a0f9713d9d6394b1 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:53.824519 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec113295-aa85-440f-85ba-7a5aafd2740f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:53.836576 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:53.924078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:53.951798 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad10c05-e82a-46f3-884f-6b5031e41530 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:53.988477 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec113295-aa85-440f-85ba-7a5aafd2740f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:54.018970 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1bd42-5997-41f1-975a-886336ecd535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:54.020121 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1bd42-5997-41f1-975a-886336ecd535 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:54.020420 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1bd42-5997-41f1-975a-886336ecd535 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:54.020705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1bd42-5997-41f1-975a-886336ecd535 None admin] PATH_INFO: `/v3/projects/6b293e7dd1fa40ad886795d229901112` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:54.022756 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1bd42-5997-41f1-975a-886336ecd535 None admin] RBAC: Authorizing `identity:get_project(project_id=6b293e7dd1fa40ad886795d229901112)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:54.024772 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1bd42-5997-41f1-975a-886336ecd535 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:54.026925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 180/363] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:53 2022] GET /identity/v3/projects/6b293e7dd1fa40ad886795d229901112 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:54.028491 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1bd42-5997-41f1-975a-886336ecd535 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:54.033645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60793306-1fba-4a69-ab85-4018a46847d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:54.034550 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60793306-1fba-4a69-ab85-4018a46847d7 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:54.034831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60793306-1fba-4a69-ab85-4018a46847d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:54.035124 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60793306-1fba-4a69-ab85-4018a46847d7 None admin] PATH_INFO: `/v3/projects/f8f1415161a745f387f7c6563159c122` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:54.036551 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60793306-1fba-4a69-ab85-4018a46847d7 None admin] RBAC: Authorizing `identity:get_project(project_id=f8f1415161a745f387f7c6563159c122)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:54.039663 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60793306-1fba-4a69-ab85-4018a46847d7 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:54.044319 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 184/364] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:53 2022] GET /identity/v3/projects/f8f1415161a745f387f7c6563159c122 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:54.045920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0ca05-512e-4ca9-a3a2-3caa47cadf96 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:54.050419 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0ca05-512e-4ca9-a3a2-3caa47cadf96 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:54.050703 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0ca05-512e-4ca9-a3a2-3caa47cadf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:54.075299 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-3ae0ca05-512e-4ca9-a3a2-3caa47cadf96 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:54.076669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3ae0ca05-512e-4ca9-a3a2-3caa47cadf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:54.168880 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 185/365] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:54.170676 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0ca05-512e-4ca9-a3a2-3caa47cadf96 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:54.192995 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1bd42-5997-41f1-975a-886336ecd535 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:54.210996 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:54.244740 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:54.248146 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab435df-201c-4518-b97a-9ac2ef847aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:54.249419 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab435df-201c-4518-b97a-9ac2ef847aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:54.250307 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab435df-201c-4518-b97a-9ac2ef847aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:54.250803 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab435df-201c-4518-b97a-9ac2ef847aa5 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:54.251786 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab435df-201c-4518-b97a-9ac2ef847aa5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:54.252479 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab435df-201c-4518-b97a-9ac2ef847aa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:54.253891 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab435df-201c-4518-b97a-9ac2ef847aa5 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:54.264577 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 181/366] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:40:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:54.264927 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab435df-201c-4518-b97a-9ac2ef847aa5 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:54.314263 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0ca05-512e-4ca9-a3a2-3caa47cadf96 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:54.359719 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fede7-47c4-4528-a1d7-5d13272f53ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:54.361072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fede7-47c4-4528-a1d7-5d13272f53ba None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:54.361608 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fede7-47c4-4528-a1d7-5d13272f53ba None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:54.362062 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fede7-47c4-4528-a1d7-5d13272f53ba None admin] PATH_INFO: `/v3/groups/b6b809c32f744ed78c642d920f86998e` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:54.364027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fede7-47c4-4528-a1d7-5d13272f53ba None admin] RBAC: Authorizing `identity:get_group(group_id=b6b809c32f744ed78c642d920f86998e)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:54.365506 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fede7-47c4-4528-a1d7-5d13272f53ba None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:54.370960 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 186/367] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jun 21 05:40:54 2022] GET /identity/v3/groups/b6b809c32f744ed78c642d920f86998e => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:54.371701 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fede7-47c4-4528-a1d7-5d13272f53ba None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:54.413203 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab435df-201c-4518-b97a-9ac2ef847aa5 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:54.460406 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0422d7-5cf1-428d-97a2-98f16b1e17bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:54.461268 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0422d7-5cf1-428d-97a2-98f16b1e17bc None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:54.461552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0422d7-5cf1-428d-97a2-98f16b1e17bc None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:54.461830 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0422d7-5cf1-428d-97a2-98f16b1e17bc None admin] PATH_INFO: `/v3/groups/b6b809c32f744ed78c642d920f86998e` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:54.463097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0422d7-5cf1-428d-97a2-98f16b1e17bc None admin] RBAC: Authorizing `identity:get_group(group_id=b6b809c32f744ed78c642d920f86998e)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:54.464551 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0422d7-5cf1-428d-97a2-98f16b1e17bc None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:54.466439 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 182/368] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jun 21 05:40:54 2022] GET /identity/v3/groups/b6b809c32f744ed78c642d920f86998e => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:54.467037 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0422d7-5cf1-428d-97a2-98f16b1e17bc None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:54.517523 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fede7-47c4-4528-a1d7-5d13272f53ba None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:54.525737 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:54.559459 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:54.580365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec0f8b-8020-4e1c-8811-de74e739a94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:54.581074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec0f8b-8020-4e1c-8811-de74e739a94c None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:54.581485 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec0f8b-8020-4e1c-8811-de74e739a94c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:54.581819 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec0f8b-8020-4e1c-8811-de74e739a94c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:54.595271 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec0f8b-8020-4e1c-8811-de74e739a94c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:54.603296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-80ec0f8b-8020-4e1c-8811-de74e739a94c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:40:54.603296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:54.603296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:54.603296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:54.603296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:54.603296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:54.603296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:54.603296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:54.603296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:54.603296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:54.603296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:54.603296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:54.603296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:54.603296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:54.603296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:54.603296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:54.605037 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:54.605037 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:54.605037 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:54.605037 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:54.605037 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:54.605037 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:54.605037 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:54.605037 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:54.605037 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:54.605037 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:54.605037 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:54.605037 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:54.605037 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:54.605037 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:54.605037 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:54.605037 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:54.606935 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:54.606935 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:54.606935 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:54.606935 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:54.606935 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:54.606935 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:54.606935 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:54.606935 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:54.606935 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:54.606935 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:54.606935 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:40:54.606935 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:40:54.606935 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 187/369] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:40:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:54.606935 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec0f8b-8020-4e1c-8811-de74e739a94c None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:54.635103 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0422d7-5cf1-428d-97a2-98f16b1e17bc None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:54.679418 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d26d3-5f62-4844-b3ef-49d5a9db1331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:54.680334 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d26d3-5f62-4844-b3ef-49d5a9db1331 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:54.680621 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d26d3-5f62-4844-b3ef-49d5a9db1331 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:54.680900 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d26d3-5f62-4844-b3ef-49d5a9db1331 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:54.767672 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec0f8b-8020-4e1c-8811-de74e739a94c None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:54.776135 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d26d3-5f62-4844-b3ef-49d5a9db1331 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:54.778166 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d26d3-5f62-4844-b3ef-49d5a9db1331 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:54.815560 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78d71e-ca77-424f-a06a-4efde968a276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:54.815560 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78d71e-ca77-424f-a06a-4efde968a276 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:54.815560 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78d71e-ca77-424f-a06a-4efde968a276 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:54.815906 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78d71e-ca77-424f-a06a-4efde968a276 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:54.816589 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78d71e-ca77-424f-a06a-4efde968a276 None admin] RBAC: Adding query filter params (group.id=b6b809c32f744ed78c642d920f86998e, role.id=a9602a7e01694084a0f9713d9d6394b1, scope.project.id=6b293e7dd1fa40ad886795d229901112) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:54.816905 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78d71e-ca77-424f-a06a-4efde968a276 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:54.820748 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78d71e-ca77-424f-a06a-4efde968a276 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:54.826551 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 188/370] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jun 21 05:40:54 2022] GET /identity/v3/role_assignments?group.id=b6b809c32f744ed78c642d920f86998e&scope.project.id=6b293e7dd1fa40ad886795d229901112&role.id=a9602a7e01694084a0f9713d9d6394b1 => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:54.827698 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78d71e-ca77-424f-a06a-4efde968a276 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:54.832764 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:54.909786 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:54.918976 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 183/371] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:40:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:40:54.919902 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d26d3-5f62-4844-b3ef-49d5a9db1331 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:54.993073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78d71e-ca77-424f-a06a-4efde968a276 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:55.042822 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f007e-46bc-4b0e-967c-48be5446d0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:55.043484 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f007e-46bc-4b0e-967c-48be5446d0ef None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:55.043777 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f007e-46bc-4b0e-967c-48be5446d0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:55.044167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f007e-46bc-4b0e-967c-48be5446d0ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:55.045039 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f007e-46bc-4b0e-967c-48be5446d0ef None admin] RBAC: Adding query filter params (group.id=b6b809c32f744ed78c642d920f86998e, role.id=ad23f352111e42de99e9d92fbfe2e1f4, scope.project.id=f8f1415161a745f387f7c6563159c122) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:55.045359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f007e-46bc-4b0e-967c-48be5446d0ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:55.046894 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f007e-46bc-4b0e-967c-48be5446d0ef None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:55.056294 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 189/372] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jun 21 05:40:54 2022] GET /identity/v3/role_assignments?group.id=b6b809c32f744ed78c642d920f86998e&scope.project.id=f8f1415161a745f387f7c6563159c122&role.id=ad23f352111e42de99e9d92fbfe2e1f4 => generated 260 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:55.057146 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f007e-46bc-4b0e-967c-48be5446d0ef None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:55.065802 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d26d3-5f62-4844-b3ef-49d5a9db1331 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:55.130215 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06821f-6ebd-40fd-861f-393ea2811b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:55.130909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06821f-6ebd-40fd-861f-393ea2811b1d None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:55.131238 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06821f-6ebd-40fd-861f-393ea2811b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:55.131520 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06821f-6ebd-40fd-861f-393ea2811b1d None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:55.132321 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06821f-6ebd-40fd-861f-393ea2811b1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:55.132633 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06821f-6ebd-40fd-861f-393ea2811b1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:55.134106 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06821f-6ebd-40fd-861f-393ea2811b1d None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:55.157067 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 184/373] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:55.164053 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06821f-6ebd-40fd-861f-393ea2811b1d None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:55.167519 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:55.276777 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f007e-46bc-4b0e-967c-48be5446d0ef None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:55.314324 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:55.338879 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846c7a6-383e-46ad-9ae9-037f38d5feec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:55.340997 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846c7a6-383e-46ad-9ae9-037f38d5feec None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:55.340997 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846c7a6-383e-46ad-9ae9-037f38d5feec None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:55.340997 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846c7a6-383e-46ad-9ae9-037f38d5feec None admin] PATH_INFO: `/v3/projects/6b293e7dd1fa40ad886795d229901112` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:55.342829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846c7a6-383e-46ad-9ae9-037f38d5feec None admin] RBAC: Authorizing `identity:get_project(project_id=6b293e7dd1fa40ad886795d229901112)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:55.344427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846c7a6-383e-46ad-9ae9-037f38d5feec None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:55.348094 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 190/374] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:55 2022] GET /identity/v3/projects/6b293e7dd1fa40ad886795d229901112 => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:55.354002 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846c7a6-383e-46ad-9ae9-037f38d5feec None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:55.366240 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06821f-6ebd-40fd-861f-393ea2811b1d None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:55.419593 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8d4ea-674d-4356-9ba0-c9a8c4a4965c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:55.420682 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8d4ea-674d-4356-9ba0-c9a8c4a4965c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:55.421324 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8d4ea-674d-4356-9ba0-c9a8c4a4965c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:55.421820 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8d4ea-674d-4356-9ba0-c9a8c4a4965c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:55.484542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846c7a6-383e-46ad-9ae9-037f38d5feec None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:55.534640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8d4ea-674d-4356-9ba0-c9a8c4a4965c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:55.536480 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8d4ea-674d-4356-9ba0-c9a8c4a4965c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:55.538789 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:55.539206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99febfcf-a05c-476e-b390-5a89ebdab7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:55.540089 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99febfcf-a05c-476e-b390-5a89ebdab7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:55.540362 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99febfcf-a05c-476e-b390-5a89ebdab7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:55.540642 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99febfcf-a05c-476e-b390-5a89ebdab7c6 None admin] PATH_INFO: `/v3/groups/b6b809c32f744ed78c642d920f86998e` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:55.542397 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99febfcf-a05c-476e-b390-5a89ebdab7c6 None admin] RBAC: Authorizing `identity:get_group(group_id=b6b809c32f744ed78c642d920f86998e)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:55.549917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99febfcf-a05c-476e-b390-5a89ebdab7c6 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:55.554170 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 191/375] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jun 21 05:40:55 2022] GET /identity/v3/groups/b6b809c32f744ed78c642d920f86998e => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:55.560645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99febfcf-a05c-476e-b390-5a89ebdab7c6 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:55.687699 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:55.725769 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 185/376] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:40:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:40:55.733339 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8d4ea-674d-4356-9ba0-c9a8c4a4965c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:55.802428 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99febfcf-a05c-476e-b390-5a89ebdab7c6 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:55.865278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24511aff-1b34-4ee3-895b-d599caef9501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:55.865961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24511aff-1b34-4ee3-895b-d599caef9501 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:55.866243 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24511aff-1b34-4ee3-895b-d599caef9501 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:55.866520 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24511aff-1b34-4ee3-895b-d599caef9501 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:55.867783 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24511aff-1b34-4ee3-895b-d599caef9501 None admin] RBAC: Adding query filter params (group.id=b6b809c32f744ed78c642d920f86998e, role.id=ad23f352111e42de99e9d92fbfe2e1f4, scope.project.id=6b293e7dd1fa40ad886795d229901112) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:55.868093 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24511aff-1b34-4ee3-895b-d599caef9501 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:55.870389 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24511aff-1b34-4ee3-895b-d599caef9501 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:55.878715 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 192/377] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jun 21 05:40:55 2022] GET /identity/v3/role_assignments?group.id=b6b809c32f744ed78c642d920f86998e&scope.project.id=6b293e7dd1fa40ad886795d229901112&role.id=ad23f352111e42de99e9d92fbfe2e1f4 => generated 260 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:55.951966 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8d4ea-674d-4356-9ba0-c9a8c4a4965c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:55.953682 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:56.012340 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf3708-a1fc-4196-a54e-fcd45a1de162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:56.013670 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf3708-a1fc-4196-a54e-fcd45a1de162 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:56.014350 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf3708-a1fc-4196-a54e-fcd45a1de162 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:56.014922 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf3708-a1fc-4196-a54e-fcd45a1de162 None admin] PATH_INFO: `/v3/projects/fcf1eaa475624717b45bb4aefba5ae51` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:56.018904 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf3708-a1fc-4196-a54e-fcd45a1de162 None admin] RBAC: Authorizing `identity:get_project(project_id=fcf1eaa475624717b45bb4aefba5ae51)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:56.020442 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf3708-a1fc-4196-a54e-fcd45a1de162 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:56.022365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 186/378] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:55 2022] GET /identity/v3/projects/fcf1eaa475624717b45bb4aefba5ae51 => generated 344 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:40:56.028256 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24511aff-1b34-4ee3-895b-d599caef9501 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:56.166014 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8efa3a-bc08-44a3-a073-cf02cea82aa0 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:56.166479 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8efa3a-bc08-44a3-a073-cf02cea82aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:56.166770 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8efa3a-bc08-44a3-a073-cf02cea82aa0 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:56.172064 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 187/379] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:56.174115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d0a26-da4a-4f74-840d-2d81d82f0782 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:56.174409 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d0a26-da4a-4f74-840d-2d81d82f0782 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:56.174692 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d0a26-da4a-4f74-840d-2d81d82f0782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:56.195987 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24511aff-1b34-4ee3-895b-d599caef9501 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:56.210105 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-9b4d0a26-da4a-4f74-840d-2d81d82f0782 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:56.213340 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9b4d0a26-da4a-4f74-840d-2d81d82f0782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:56.222428 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:56.278696 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6838252-1e40-4975-ab57-1ac44b260ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:56.280325 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6838252-1e40-4975-ab57-1ac44b260ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:56.280781 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6838252-1e40-4975-ab57-1ac44b260ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:56.281247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6838252-1e40-4975-ab57-1ac44b260ae5 None admin] PATH_INFO: `/v3/groups/e84a2ce06ad24262ae2b7a4c2d965875` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:56.292179 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6838252-1e40-4975-ab57-1ac44b260ae5 None admin] RBAC: Authorizing `identity:get_group(group_id=e84a2ce06ad24262ae2b7a4c2d965875)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:56.294919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6838252-1e40-4975-ab57-1ac44b260ae5 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:56.301482 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 193/380] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jun 21 05:40:56 2022] GET /identity/v3/groups/e84a2ce06ad24262ae2b7a4c2d965875 => generated 229 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:56.307349 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6838252-1e40-4975-ab57-1ac44b260ae5 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:56.337521 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 188/381] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:56.364817 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d0a26-da4a-4f74-840d-2d81d82f0782 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:56.476838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:56.481601 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d0a26-da4a-4f74-840d-2d81d82f0782 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:56.521819 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0722f-bb85-4a39-89f8-5b16e516c72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:56.522686 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0722f-bb85-4a39-89f8-5b16e516c72f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:56.522975 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0722f-bb85-4a39-89f8-5b16e516c72f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:56.523257 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0722f-bb85-4a39-89f8-5b16e516c72f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:56.538045 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6838252-1e40-4975-ab57-1ac44b260ae5 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:56.555398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0722f-bb85-4a39-89f8-5b16e516c72f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:56.570634 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-83f0722f-bb85-4a39-89f8-5b16e516c72f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:56.570634 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:56.570634 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:56.570634 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:56.570634 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:56.570634 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:56.570634 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:56.570634 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:56.570634 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:56.570634 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:56.570634 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:56.570634 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:56.570634 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:56.570634 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:56.570634 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:56.570634 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:56.571592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:56.571592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:56.571592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:56.571592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:56.571592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:56.571592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:56.571592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:56.571592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:56.571592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:56.571592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:56.571592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:56.571592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:56.571592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:56.571592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:56.571592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:56.571592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:56.572411 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:56.572411 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:56.572411 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:56.572411 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:56.572411 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:56.572411 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:56.572411 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:56.572411 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:56.572411 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:56.572411 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:56.572411 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:56.572411 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:40:56.573375 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 189/382] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:40:56.580950 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0722f-bb85-4a39-89f8-5b16e516c72f None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:56.585988 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b112a-2766-40b2-87c4-c33421715286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:56.585988 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b112a-2766-40b2-87c4-c33421715286 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:56.585988 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b112a-2766-40b2-87c4-c33421715286 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:56.585988 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b112a-2766-40b2-87c4-c33421715286 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:56.586653 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b112a-2766-40b2-87c4-c33421715286 None admin] RBAC: Adding query filter params (group.id=e84a2ce06ad24262ae2b7a4c2d965875, role.id=24aa6040c86049f996560e477e83886f, scope.project.id=fcf1eaa475624717b45bb4aefba5ae51) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:56.586653 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b112a-2766-40b2-87c4-c33421715286 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:56.588160 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b112a-2766-40b2-87c4-c33421715286 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:56.602084 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 194/383] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jun 21 05:40:56 2022] GET /identity/v3/role_assignments?group.id=e84a2ce06ad24262ae2b7a4c2d965875&scope.project.id=fcf1eaa475624717b45bb4aefba5ae51&role.id=24aa6040c86049f996560e477e83886f => generated 260 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:56.785285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0722f-bb85-4a39-89f8-5b16e516c72f None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:56.836049 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42684d-f57b-411b-8670-1d347a93e600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:56.836741 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42684d-f57b-411b-8670-1d347a93e600 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:56.837035 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42684d-f57b-411b-8670-1d347a93e600 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:56.837317 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42684d-f57b-411b-8670-1d347a93e600 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:56.838113 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42684d-f57b-411b-8670-1d347a93e600 None admin] RBAC: Adding query filter params (name=member) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:56.838426 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42684d-f57b-411b-8670-1d347a93e600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:56.839831 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42684d-f57b-411b-8670-1d347a93e600 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:56.854237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 190/384] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 21 05:40:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:40:56.860195 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b112a-2766-40b2-87c4-c33421715286 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:56.923799 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:56.997475 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b112a-2766-40b2-87c4-c33421715286 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:57.035726 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e96e2f-261f-4134-9752-5fbeefb65f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:57.036870 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e96e2f-261f-4134-9752-5fbeefb65f2b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:57.037153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e96e2f-261f-4134-9752-5fbeefb65f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:57.037428 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e96e2f-261f-4134-9752-5fbeefb65f2b None admin] PATH_INFO: `/v3/groups/b6b809c32f744ed78c642d920f86998e` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:57.038784 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e96e2f-261f-4134-9752-5fbeefb65f2b None admin] RBAC: Authorizing `identity:get_group(group_id=b6b809c32f744ed78c642d920f86998e)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:57.041012 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e96e2f-261f-4134-9752-5fbeefb65f2b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:57.049802 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 195/385] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jun 21 05:40:56 2022] GET /identity/v3/groups/b6b809c32f744ed78c642d920f86998e => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:57.051212 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42684d-f57b-411b-8670-1d347a93e600 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:57.100880 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:57.228421 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42684d-f57b-411b-8670-1d347a93e600 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:57.281093 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90077fd7-df9f-463e-bd54-fd18e35b8e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:57.282007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90077fd7-df9f-463e-bd54-fd18e35b8e9c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:57.282881 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90077fd7-df9f-463e-bd54-fd18e35b8e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:57.283147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90077fd7-df9f-463e-bd54-fd18e35b8e9c None admin] PATH_INFO: `/v3/projects/f8f1415161a745f387f7c6563159c122` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:57.284482 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90077fd7-df9f-463e-bd54-fd18e35b8e9c None admin] RBAC: Authorizing `identity:get_project(project_id=f8f1415161a745f387f7c6563159c122)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:57.286022 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90077fd7-df9f-463e-bd54-fd18e35b8e9c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:57.287795 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 191/386] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:57 2022] GET /identity/v3/projects/f8f1415161a745f387f7c6563159c122 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:57.295453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e96e2f-261f-4134-9752-5fbeefb65f2b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:57.422270 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e96e2f-261f-4134-9752-5fbeefb65f2b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:57.424589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c21f01-7697-46b0-95e7-e809dd9a9ec2 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:57.424891 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c21f01-7697-46b0-95e7-e809dd9a9ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:57.425175 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c21f01-7697-46b0-95e7-e809dd9a9ec2 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:57.426886 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 192/387] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:57.432405 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632f7a4-ce03-4340-87f7-5bbf647bc5d6 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:57.432699 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632f7a4-ce03-4340-87f7-5bbf647bc5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:57.432987 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632f7a4-ce03-4340-87f7-5bbf647bc5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:57.438881 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:57.455507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-9632f7a4-ce03-4340-87f7-5bbf647bc5d6 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:57.457799 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9632f7a4-ce03-4340-87f7-5bbf647bc5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:57.471931 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19b2d0-fe21-4d38-a4f5-0125e34baa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:57.473395 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19b2d0-fe21-4d38-a4f5-0125e34baa56 None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:57.473842 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19b2d0-fe21-4d38-a4f5-0125e34baa56 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:57.474284 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19b2d0-fe21-4d38-a4f5-0125e34baa56 None admin] PATH_INFO: `/v3/projects/f8f1415161a745f387f7c6563159c122/groups/b6b809c32f744ed78c642d920f86998e/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:57.483033 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19b2d0-fe21-4d38-a4f5-0125e34baa56 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8f1415161a745f387f7c6563159c122, group_id=b6b809c32f744ed78c642d920f86998e, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:57.486217 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19b2d0-fe21-4d38-a4f5-0125e34baa56 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:57.509428 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 196/388] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Jun 21 05:40:57 2022] PUT /identity/v3/projects/f8f1415161a745f387f7c6563159c122/groups/b6b809c32f744ed78c642d920f86998e/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:40:57.509428 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081a5d4-f39d-41b5-adb0-f2d98f499ffe None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:57.509428 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081a5d4-f39d-41b5-adb0-f2d98f499ffe None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:57.509428 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081a5d4-f39d-41b5-adb0-f2d98f499ffe None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:57.509428 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 197/389] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:57.515521 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300384eb-3116-417f-899d-8f7c17d7f4a4 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:57.515824 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300384eb-3116-417f-899d-8f7c17d7f4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:57.516102 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300384eb-3116-417f-899d-8f7c17d7f4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:57.559696 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-300384eb-3116-417f-899d-8f7c17d7f4a4 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:57.560866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-300384eb-3116-417f-899d-8f7c17d7f4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:57.588590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 193/390] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 05:40:57.623877 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632f7a4-ce03-4340-87f7-5bbf647bc5d6 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:57.669826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:57.675161 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 198/391] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:57.711667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300384eb-3116-417f-899d-8f7c17d7f4a4 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:57.785067 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632f7a4-ce03-4340-87f7-5bbf647bc5d6 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:57.822183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac7c7e-07c9-4611-9f83-195e7fa83c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:57.822917 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac7c7e-07c9-4611-9f83-195e7fa83c8f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:57.823199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac7c7e-07c9-4611-9f83-195e7fa83c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:57.823532 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac7c7e-07c9-4611-9f83-195e7fa83c8f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:57.834071 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:57.836136 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac7c7e-07c9-4611-9f83-195e7fa83c8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:57.839127 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300384eb-3116-417f-899d-8f7c17d7f4a4 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:57.844390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-27ac7c7e-07c9-4611-9f83-195e7fa83c8f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 05:40:57.844390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:57.844390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:57.844390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:57.844390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:57.844390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:57.844390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:57.844390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:57.844390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:57.844390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:57.844390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:57.844390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:57.844390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:57.844390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:57.844390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:57.844390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:57.845889 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:57.845889 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:57.845889 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:57.845889 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:57.845889 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:57.845889 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:57.845889 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:57.845889 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:57.845889 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:57.845889 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:57.845889 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:57.845889 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:57.845889 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:57.845889 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:57.845889 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:57.845889 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:57.846966 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:57.846966 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:57.846966 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:57.846966 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:57.846966 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:57.846966 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:57.846966 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:57.846966 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:57.846966 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:57.846966 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:57.846966 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 05:40:57.846966 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:40:57.846966 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 194/392] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 21 05:40:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:40:57.857133 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac7c7e-07c9-4611-9f83-195e7fa83c8f None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:57.881652 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b62ff-6b9d-44a8-8e98-aaf4c56a09d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:57.883014 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b62ff-6b9d-44a8-8e98-aaf4c56a09d9 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:57.883519 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b62ff-6b9d-44a8-8e98-aaf4c56a09d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:57.884228 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b62ff-6b9d-44a8-8e98-aaf4c56a09d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:57.896611 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b62ff-6b9d-44a8-8e98-aaf4c56a09d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:57.905437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-680b62ff-6b9d-44a8-8e98-aaf4c56a09d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:57.905437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:57.905437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:57.905437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:57.905437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:57.905437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:57.905437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:57.905437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:57.905437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:57.905437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:57.905437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:57.905437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:57.905437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:57.905437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:57.905437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:57.905437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:57.906407 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:57.906407 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:57.906407 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:57.906407 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:57.906407 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:57.906407 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:57.906407 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:57.906407 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:57.906407 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:57.906407 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:57.906407 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:57.906407 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:57.906407 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:57.906407 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:57.906407 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:57.906407 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:57.907845 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:57.907845 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:57.907845 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:57.907845 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:57.907845 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:57.907845 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:57.907845 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:57.907845 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:57.907845 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:57.907845 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:57.907845 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:40:57.907845 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:40:57.914048 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 199/393] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:57.917116 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b62ff-6b9d-44a8-8e98-aaf4c56a09d9 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:58.007454 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:58.045185 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b62ff-6b9d-44a8-8e98-aaf4c56a09d9 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:58.045399 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac7c7e-07c9-4611-9f83-195e7fa83c8f None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:58.084768 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584ab7a-25d2-4055-a105-0565983c632e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:58.085886 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584ab7a-25d2-4055-a105-0565983c632e None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:58.086428 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584ab7a-25d2-4055-a105-0565983c632e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:58.086960 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584ab7a-25d2-4055-a105-0565983c632e None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:58.088032 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584ab7a-25d2-4055-a105-0565983c632e None admin] RBAC: Adding query filter params (name=member) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:58.088542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584ab7a-25d2-4055-a105-0565983c632e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:58.090712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584ab7a-25d2-4055-a105-0565983c632e None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:58.111384 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebe866-044f-424f-a862-c11660b8c671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:58.111729 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebe866-044f-424f-a862-c11660b8c671 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:58.111995 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebe866-044f-424f-a862-c11660b8c671 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:58.112272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebe866-044f-424f-a862-c11660b8c671 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:58.113055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ebe866-044f-424f-a862-c11660b8c671 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:58.113367 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ebe866-044f-424f-a862-c11660b8c671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:58.114978 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ebe866-044f-424f-a862-c11660b8c671 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:58.120739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 200/394] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 21 05:40:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:40:58.122505 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584ab7a-25d2-4055-a105-0565983c632e None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:58.129889 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 195/395] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:40:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:58.139079 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebe866-044f-424f-a862-c11660b8c671 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:58.166413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:58.264388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebe866-044f-424f-a862-c11660b8c671 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:58.303036 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584ab7a-25d2-4055-a105-0565983c632e None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:58.340569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf17aa-8630-425c-b92a-9601967cb638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:58.341351 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf17aa-8630-425c-b92a-9601967cb638 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:58.341629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf17aa-8630-425c-b92a-9601967cb638 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:58.341900 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf17aa-8630-425c-b92a-9601967cb638 None admin] PATH_INFO: `/v3/groups/b6b809c32f744ed78c642d920f86998e` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:58.343566 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf17aa-8630-425c-b92a-9601967cb638 None admin] RBAC: Authorizing `identity:get_group(group_id=b6b809c32f744ed78c642d920f86998e)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:58.345611 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf17aa-8630-425c-b92a-9601967cb638 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:58.347778 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 201/396] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jun 21 05:40:58 2022] GET /identity/v3/groups/b6b809c32f744ed78c642d920f86998e => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:40:58.359576 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf17aa-8630-425c-b92a-9601967cb638 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:58.378804 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6fda95-523f-4c00-81c8-bbeeba076b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:58.379702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fda95-523f-4c00-81c8-bbeeba076b48 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:58.379993 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fda95-523f-4c00-81c8-bbeeba076b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:58.380283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fda95-523f-4c00-81c8-bbeeba076b48 None admin] PATH_INFO: `/v3/groups/b6b809c32f744ed78c642d920f86998e` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:58.381754 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6fda95-523f-4c00-81c8-bbeeba076b48 None admin] RBAC: Authorizing `identity:get_group(group_id=b6b809c32f744ed78c642d920f86998e)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:58.383235 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6fda95-523f-4c00-81c8-bbeeba076b48 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:58.385293 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 196/397] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jun 21 05:40:58 2022] GET /identity/v3/groups/b6b809c32f744ed78c642d920f86998e => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:58.390705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6fda95-523f-4c00-81c8-bbeeba076b48 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:58.425014 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:58.471536 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf17aa-8630-425c-b92a-9601967cb638 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:58.474422 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:58.509813 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef92bb2-6bce-4e3d-8911-65d30132a90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:58.510852 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef92bb2-6bce-4e3d-8911-65d30132a90f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:58.511203 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef92bb2-6bce-4e3d-8911-65d30132a90f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:58.511738 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef92bb2-6bce-4e3d-8911-65d30132a90f None admin] PATH_INFO: `/v3/projects/6b293e7dd1fa40ad886795d229901112` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:58.513088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef92bb2-6bce-4e3d-8911-65d30132a90f None admin] RBAC: Authorizing `identity:get_project(project_id=6b293e7dd1fa40ad886795d229901112)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:58.514687 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef92bb2-6bce-4e3d-8911-65d30132a90f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:58.517844 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 202/398] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:58 2022] GET /identity/v3/projects/6b293e7dd1fa40ad886795d229901112 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:58.523395 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef92bb2-6bce-4e3d-8911-65d30132a90f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:58.647596 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef92bb2-6bce-4e3d-8911-65d30132a90f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:58.683722 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09cdc2-7fe8-456e-9333-c6d15cdb59a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:58.684850 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09cdc2-7fe8-456e-9333-c6d15cdb59a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:58.685232 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09cdc2-7fe8-456e-9333-c6d15cdb59a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:58.685609 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09cdc2-7fe8-456e-9333-c6d15cdb59a2 None admin] PATH_INFO: `/v3/projects/6b293e7dd1fa40ad886795d229901112/groups/b6b809c32f744ed78c642d920f86998e/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:58.687914 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09cdc2-7fe8-456e-9333-c6d15cdb59a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b293e7dd1fa40ad886795d229901112, group_id=b6b809c32f744ed78c642d920f86998e, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:58.690112 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09cdc2-7fe8-456e-9333-c6d15cdb59a2 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:58.706091 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6fda95-523f-4c00-81c8-bbeeba076b48 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:58.707110 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 203/399] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Jun 21 05:40:58 2022] PUT /identity/v3/projects/6b293e7dd1fa40ad886795d229901112/groups/b6b809c32f744ed78c642d920f86998e/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 05:40:58.774936 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e004070-f4db-474f-92ca-dbbba9d27bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:58.776061 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e004070-f4db-474f-92ca-dbbba9d27bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:58.776495 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e004070-f4db-474f-92ca-dbbba9d27bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:58.776938 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e004070-f4db-474f-92ca-dbbba9d27bf2 None admin] PATH_INFO: `/v3/projects/f8f1415161a745f387f7c6563159c122` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:58.778348 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e004070-f4db-474f-92ca-dbbba9d27bf2 None admin] RBAC: Authorizing `identity:get_project(project_id=f8f1415161a745f387f7c6563159c122)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:58.780045 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e004070-f4db-474f-92ca-dbbba9d27bf2 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:58.781920 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 197/400] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:58 2022] GET /identity/v3/projects/f8f1415161a745f387f7c6563159c122 => generated 298 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:58.789366 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09cdc2-7fe8-456e-9333-c6d15cdb59a2 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:58.822365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:58.930768 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09cdc2-7fe8-456e-9333-c6d15cdb59a2 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:58.941208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3db10-e43c-40e9-86ff-75a87cdc0efd None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:58.941639 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3db10-e43c-40e9-86ff-75a87cdc0efd None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:58.942114 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3db10-e43c-40e9-86ff-75a87cdc0efd None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:58.944641 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 198/401] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:40:58.950851 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324b6ff-67c3-4056-9340-1993fee72d71 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:58.951161 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324b6ff-67c3-4056-9340-1993fee72d71 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:58.951475 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324b6ff-67c3-4056-9340-1993fee72d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:58.973249 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967a843-7557-430f-a33f-15f6411f8deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:58.973451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-0324b6ff-67c3-4056-9340-1993fee72d71 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:58.974169 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967a843-7557-430f-a33f-15f6411f8deb None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:58.974500 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967a843-7557-430f-a33f-15f6411f8deb None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:58.974791 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967a843-7557-430f-a33f-15f6411f8deb None admin] PATH_INFO: `/v3/projects/f8f1415161a745f387f7c6563159c122/groups/b6b809c32f744ed78c642d920f86998e/roles/ad23f352111e42de99e9d92fbfe2e1f4` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:58.975039 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0324b6ff-67c3-4056-9340-1993fee72d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:58.977199 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967a843-7557-430f-a33f-15f6411f8deb None admin] RBAC: Authorizing `identity:create_grant(project_id=f8f1415161a745f387f7c6563159c122, group_id=b6b809c32f744ed78c642d920f86998e, role_id=ad23f352111e42de99e9d92fbfe2e1f4)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:58.979415 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967a843-7557-430f-a33f-15f6411f8deb None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:59.000072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 204/402] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Jun 21 05:40:58 2022] PUT /identity/v3/projects/f8f1415161a745f387f7c6563159c122/groups/b6b809c32f744ed78c642d920f86998e/roles/ad23f352111e42de99e9d92fbfe2e1f4 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:40:59.075852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 199/403] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 05:40:59.105664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967a843-7557-430f-a33f-15f6411f8deb None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:59.231096 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:59.257054 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac32bf-6096-48ba-a3e7-fcd81d9cbf53 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:59.257054 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac32bf-6096-48ba-a3e7-fcd81d9cbf53 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:59.258534 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac32bf-6096-48ba-a3e7-fcd81d9cbf53 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:59.258534 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 200/404] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 05:40:59.264315 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1a01d-4f31-4f39-8795-e55907e79e9d None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:59.264684 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1a01d-4f31-4f39-8795-e55907e79e9d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:59.265043 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1a01d-4f31-4f39-8795-e55907e79e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:59.273021 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967a843-7557-430f-a33f-15f6411f8deb None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:59.285185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-e9a1a01d-4f31-4f39-8795-e55907e79e9d None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:40:59.286439 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e9a1a01d-4f31-4f39-8795-e55907e79e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:40:59.288849 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:59.330435 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23820b-12d1-4d65-9e31-0c5f78ad2072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:59.331264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23820b-12d1-4d65-9e31-0c5f78ad2072 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:59.331555 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23820b-12d1-4d65-9e31-0c5f78ad2072 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:59.331839 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23820b-12d1-4d65-9e31-0c5f78ad2072 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:59.359949 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23820b-12d1-4d65-9e31-0c5f78ad2072 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:59.366575 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 201/405] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:40:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:40:59.370077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-ff23820b-12d1-4d65-9e31-0c5f78ad2072 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 05:40:59.370077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:59.370077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:59.370077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:59.370077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:59.370077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:59.370077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:59.370077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:59.370077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:59.370077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:59.370077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:59.370077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:59.370077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:59.370077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:59.370077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:59.370077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:59.370961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:59.370961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:59.370961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:59.370961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:59.370961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:59.370961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:59.370961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:59.370961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:59.370961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:59.370961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:59.370961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:59.370961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:59.370961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:59.370961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:59.370961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:59.370961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:59.371756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:59.371756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:59.371756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:59.371756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:59.371756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:59.371756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:59.371756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:59.371756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:59.371756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:59.371756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:59.371756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 05:40:59.371756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:40:59.378388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 205/406] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 21 05:40:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:59.384368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1a01d-4f31-4f39-8795-e55907e79e9d None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:59.405769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23820b-12d1-4d65-9e31-0c5f78ad2072 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:59.528119 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23820b-12d1-4d65-9e31-0c5f78ad2072 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:59.575001 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1a01d-4f31-4f39-8795-e55907e79e9d None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:59.576838 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8546c-9d93-43e9-93d2-a74debb8882d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:59.578060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8546c-9d93-43e9-93d2-a74debb8882d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:59.578555 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8546c-9d93-43e9-93d2-a74debb8882d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:59.579055 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8546c-9d93-43e9-93d2-a74debb8882d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:59.582550 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:59.594033 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8546c-9d93-43e9-93d2-a74debb8882d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:40:59.607027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-b7e8546c-9d93-43e9-93d2-a74debb8882d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:40:59.607027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:40:59.607027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:40:59.607027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:40:59.607027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:40:59.607027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:40:59.607027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:40:59.607027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:40:59.607027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:40:59.607027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:40:59.607027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:40:59.607027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:40:59.607027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:40:59.607027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:40:59.607027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:40:59.607027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:40:59.608005 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:40:59.608005 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:40:59.608005 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:40:59.608005 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:40:59.608005 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:40:59.608005 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:40:59.608005 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:40:59.608005 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:40:59.608005 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:40:59.608005 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:40:59.608005 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:40:59.608005 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:40:59.608005 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:40:59.608005 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:40:59.608005 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:40:59.608005 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:40:59.608801 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:40:59.608801 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:40:59.608801 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:40:59.608801 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:40:59.608801 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:40:59.608801 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:40:59.608801 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:40:59.608801 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:40:59.608801 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:40:59.608801 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:40:59.608801 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:40:59.608801 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:40:59.608801 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 206/407] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:40:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:40:59.612240 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8546c-9d93-43e9-93d2-a74debb8882d None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:59.634841 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10c876-816a-43ba-a9e6-05ab55c4e0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:59.635797 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10c876-816a-43ba-a9e6-05ab55c4e0c8 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:59.636230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10c876-816a-43ba-a9e6-05ab55c4e0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:59.636654 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10c876-816a-43ba-a9e6-05ab55c4e0c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:59.637688 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10c876-816a-43ba-a9e6-05ab55c4e0c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:59.638168 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10c876-816a-43ba-a9e6-05ab55c4e0c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:59.639718 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10c876-816a-43ba-a9e6-05ab55c4e0c8 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:59.655359 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:59.662292 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 202/408] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:40:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:59.665070 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10c876-816a-43ba-a9e6-05ab55c4e0c8 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:59.762138 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8546c-9d93-43e9-93d2-a74debb8882d None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:59.801225 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab54c3-4a16-4e66-a953-3dadb95c83a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:59.802385 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab54c3-4a16-4e66-a953-3dadb95c83a1 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:59.802925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab54c3-4a16-4e66-a953-3dadb95c83a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:59.803423 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab54c3-4a16-4e66-a953-3dadb95c83a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:59.804448 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab54c3-4a16-4e66-a953-3dadb95c83a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:40:59.804964 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab54c3-4a16-4e66-a953-3dadb95c83a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:59.806750 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab54c3-4a16-4e66-a953-3dadb95c83a1 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:59.817500 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 207/409] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:40:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:59.826173 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab54c3-4a16-4e66-a953-3dadb95c83a1 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:59.829144 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10c876-816a-43ba-a9e6-05ab55c4e0c8 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:40:59.896540 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79178a7-35d9-4e1d-b85a-0c0c4ebeb01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:40:59.897551 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79178a7-35d9-4e1d-b85a-0c0c4ebeb01e None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:40:59.897808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79178a7-35d9-4e1d-b85a-0c0c4ebeb01e None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:40:59.898119 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79178a7-35d9-4e1d-b85a-0c0c4ebeb01e None admin] PATH_INFO: `/v3/groups/b6b809c32f744ed78c642d920f86998e` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:40:59.901740 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79178a7-35d9-4e1d-b85a-0c0c4ebeb01e None admin] RBAC: Authorizing `identity:get_group(group_id=b6b809c32f744ed78c642d920f86998e)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:40:59.903247 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79178a7-35d9-4e1d-b85a-0c0c4ebeb01e None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:40:59.905747 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 203/410] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jun 21 05:40:59 2022] GET /identity/v3/groups/b6b809c32f744ed78c642d920f86998e => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:40:59.909039 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:40:59.911277 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79178a7-35d9-4e1d-b85a-0c0c4ebeb01e None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:40:59.962799 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab54c3-4a16-4e66-a953-3dadb95c83a1 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:00.009096 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a727b8-4da3-46a9-8c64-8932d35befc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:00.010484 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a727b8-4da3-46a9-8c64-8932d35befc8 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:00.010975 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a727b8-4da3-46a9-8c64-8932d35befc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:00.011500 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a727b8-4da3-46a9-8c64-8932d35befc8 None admin] PATH_INFO: `/v3/groups/e84a2ce06ad24262ae2b7a4c2d965875` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:00.013123 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a727b8-4da3-46a9-8c64-8932d35befc8 None admin] RBAC: Authorizing `identity:get_group(group_id=e84a2ce06ad24262ae2b7a4c2d965875)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:00.014832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a727b8-4da3-46a9-8c64-8932d35befc8 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:00.017179 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 208/411] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jun 21 05:40:59 2022] GET /identity/v3/groups/e84a2ce06ad24262ae2b7a4c2d965875 => generated 229 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:00.022846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a727b8-4da3-46a9-8c64-8932d35befc8 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:00.054655 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:00.093717 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79178a7-35d9-4e1d-b85a-0c0c4ebeb01e None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:00.142685 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ef515-d693-4af9-aae4-1c161c8cd4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:00.143615 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ef515-d693-4af9-aae4-1c161c8cd4ac None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:00.143898 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ef515-d693-4af9-aae4-1c161c8cd4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:00.144229 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ef515-d693-4af9-aae4-1c161c8cd4ac None admin] PATH_INFO: `/v3/projects/6b293e7dd1fa40ad886795d229901112` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:00.145483 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ef515-d693-4af9-aae4-1c161c8cd4ac None admin] RBAC: Authorizing `identity:get_project(project_id=6b293e7dd1fa40ad886795d229901112)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:00.146998 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ef515-d693-4af9-aae4-1c161c8cd4ac None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:00.149063 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 204/412] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:40:59 2022] GET /identity/v3/projects/6b293e7dd1fa40ad886795d229901112 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:00.150590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3dddcf-a976-4922-aa7c-155494c82845 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:00.150893 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3dddcf-a976-4922-aa7c-155494c82845 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:00.151172 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3dddcf-a976-4922-aa7c-155494c82845 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:00.152799 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a727b8-4da3-46a9-8c64-8932d35befc8 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:00.156652 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 205/413] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:00.159283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c259a-aa7c-46ba-8e15-6beb8ac47fd4 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:00.159567 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c259a-aa7c-46ba-8e15-6beb8ac47fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:00.159917 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c259a-aa7c-46ba-8e15-6beb8ac47fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:00.178811 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-856c259a-aa7c-46ba-8e15-6beb8ac47fd4 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:00.180120 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-856c259a-aa7c-46ba-8e15-6beb8ac47fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:00.193535 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:00.203752 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dea3a1-b07a-4a2d-85f8-4408e7650773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:00.204707 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dea3a1-b07a-4a2d-85f8-4408e7650773 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:00.204987 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dea3a1-b07a-4a2d-85f8-4408e7650773 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:00.205259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dea3a1-b07a-4a2d-85f8-4408e7650773 None admin] PATH_INFO: `/v3/projects/fcf1eaa475624717b45bb4aefba5ae51` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:00.206514 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dea3a1-b07a-4a2d-85f8-4408e7650773 None admin] RBAC: Authorizing `identity:get_project(project_id=fcf1eaa475624717b45bb4aefba5ae51)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:00.208106 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dea3a1-b07a-4a2d-85f8-4408e7650773 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:00.210178 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 209/414] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:41:00 2022] GET /identity/v3/projects/fcf1eaa475624717b45bb4aefba5ae51 => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:41:00.210977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dea3a1-b07a-4a2d-85f8-4408e7650773 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:00.268773 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 206/415] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 05:41:00.274382 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c259a-aa7c-46ba-8e15-6beb8ac47fd4 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:00.346341 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dea3a1-b07a-4a2d-85f8-4408e7650773 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:00.381984 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:00.384199 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034237e-f92a-4586-b6c9-1278f0e70246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:00.385176 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034237e-f92a-4586-b6c9-1278f0e70246 None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:00.385517 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034237e-f92a-4586-b6c9-1278f0e70246 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:00.385852 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034237e-f92a-4586-b6c9-1278f0e70246 None admin] PATH_INFO: `/v3/projects/6b293e7dd1fa40ad886795d229901112/groups/b6b809c32f744ed78c642d920f86998e/roles/ad23f352111e42de99e9d92fbfe2e1f4` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:00.388253 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034237e-f92a-4586-b6c9-1278f0e70246 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b293e7dd1fa40ad886795d229901112, group_id=b6b809c32f744ed78c642d920f86998e, role_id=ad23f352111e42de99e9d92fbfe2e1f4)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:00.389860 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034237e-f92a-4586-b6c9-1278f0e70246 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:00.418079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 210/416] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Jun 21 05:41:00 2022] PUT /identity/v3/projects/6b293e7dd1fa40ad886795d229901112/groups/b6b809c32f744ed78c642d920f86998e/roles/ad23f352111e42de99e9d92fbfe2e1f4 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:41:00.419214 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034237e-f92a-4586-b6c9-1278f0e70246 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:00.434663 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c259a-aa7c-46ba-8e15-6beb8ac47fd4 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:00.529803 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144a97c-0267-494b-95f2-5c3520b6ca3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:00.531129 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144a97c-0267-494b-95f2-5c3520b6ca3a None admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:00.531613 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144a97c-0267-494b-95f2-5c3520b6ca3a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:00.532685 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144a97c-0267-494b-95f2-5c3520b6ca3a None admin] PATH_INFO: `/v3/projects/fcf1eaa475624717b45bb4aefba5ae51/groups/e84a2ce06ad24262ae2b7a4c2d965875/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:00.535038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144a97c-0267-494b-95f2-5c3520b6ca3a None admin] RBAC: Authorizing `identity:create_grant(project_id=fcf1eaa475624717b45bb4aefba5ae51, group_id=e84a2ce06ad24262ae2b7a4c2d965875, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:00.537494 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144a97c-0267-494b-95f2-5c3520b6ca3a None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:00.561195 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 207/417] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Jun 21 05:41:00 2022] PUT /identity/v3/projects/fcf1eaa475624717b45bb4aefba5ae51/groups/e84a2ce06ad24262ae2b7a4c2d965875/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:41:00.565803 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:00.628365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034237e-f92a-4586-b6c9-1278f0e70246 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:00.678724 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca2a00-6e66-4f6e-b35f-4d3fe96a7cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:00.680171 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca2a00-6e66-4f6e-b35f-4d3fe96a7cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:00.680721 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca2a00-6e66-4f6e-b35f-4d3fe96a7cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:00.681214 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca2a00-6e66-4f6e-b35f-4d3fe96a7cf7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:00.695721 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca2a00-6e66-4f6e-b35f-4d3fe96a7cf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:00.704922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-00ca2a00-6e66-4f6e-b35f-4d3fe96a7cf7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:41:00.704922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:00.704922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:00.704922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:00.704922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:00.704922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:00.704922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:00.704922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:00.704922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:00.704922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:00.704922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:00.704922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:00.704922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:00.704922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:00.704922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:00.704922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:00.705909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:00.705909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:00.705909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:00.705909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:00.705909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:00.705909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:00.705909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:00.705909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:00.705909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:00.705909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:00.705909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:00.705909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:00.705909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:00.705909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:00.705909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:00.705909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:00.707047 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:00.707047 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:00.707047 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:00.707047 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:00.707047 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:00.707047 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:00.707047 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:00.707047 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:00.707047 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:00.707047 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:00.707047 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:41:00.707047 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:00.709530 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 211/418] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:41:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:00.719528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144a97c-0267-494b-95f2-5c3520b6ca3a None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:00.862329 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144a97c-0267-494b-95f2-5c3520b6ca3a None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:00.895803 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:00.906560 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfece8a3-5df9-4565-a59b-12b7f69d1f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:00.907634 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfece8a3-5df9-4565-a59b-12b7f69d1f8d None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:00.908119 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfece8a3-5df9-4565-a59b-12b7f69d1f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:00.908595 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfece8a3-5df9-4565-a59b-12b7f69d1f8d None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:00.909602 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfece8a3-5df9-4565-a59b-12b7f69d1f8d None admin] RBAC: Adding query filter params (name=member) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:00.910154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfece8a3-5df9-4565-a59b-12b7f69d1f8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:00.911766 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfece8a3-5df9-4565-a59b-12b7f69d1f8d None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:00.922973 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 208/419] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 21 05:41:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:00.930300 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca2a00-6e66-4f6e-b35f-4d3fe96a7cf7 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:01.106514 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca2a00-6e66-4f6e-b35f-4d3fe96a7cf7 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:01.138844 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:01.164397 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3a9fd-3058-460d-93b5-6ae155e19849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:01.165002 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3a9fd-3058-460d-93b5-6ae155e19849 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:01.165294 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3a9fd-3058-460d-93b5-6ae155e19849 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:01.165600 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3a9fd-3058-460d-93b5-6ae155e19849 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:01.247163 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3a9fd-3058-460d-93b5-6ae155e19849 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:01.248668 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3a9fd-3058-460d-93b5-6ae155e19849 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:01.366136 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0d42e-36b0-4b11-9758-4e70ade77381 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:01.366622 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0d42e-36b0-4b11-9758-4e70ade77381 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:01.367080 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0d42e-36b0-4b11-9758-4e70ade77381 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:01.369639 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 209/420] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:01.377086 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2e87b-9562-4ace-9177-01cac9257480 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:01.377390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2e87b-9562-4ace-9177-01cac9257480 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:01.377647 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2e87b-9562-4ace-9177-01cac9257480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:01.394851 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 212/421] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:41:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:41:01.399740 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-63c2e87b-9562-4ace-9177-01cac9257480 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:01.400080 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3a9fd-3058-460d-93b5-6ae155e19849 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:01.401148 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-63c2e87b-9562-4ace-9177-01cac9257480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:01.436314 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:01.537007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 210/422] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 05:41:01.570296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3a9fd-3058-460d-93b5-6ae155e19849 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:01.575106 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2e87b-9562-4ace-9177-01cac9257480 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:01.644515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3a060-668e-49b5-9ab8-d7ec35837a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:01.645388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3a060-668e-49b5-9ab8-d7ec35837a32 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:01.645671 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3a060-668e-49b5-9ab8-d7ec35837a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:01.645958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3a060-668e-49b5-9ab8-d7ec35837a32 None admin] PATH_INFO: `/v3/projects/f8f1415161a745f387f7c6563159c122` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:01.647839 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3a060-668e-49b5-9ab8-d7ec35837a32 None admin] RBAC: Authorizing `identity:get_project(project_id=f8f1415161a745f387f7c6563159c122)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:01.649310 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3a060-668e-49b5-9ab8-d7ec35837a32 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:01.653245 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 213/423] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:41:01 2022] GET /identity/v3/projects/f8f1415161a745f387f7c6563159c122 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:41:01.656555 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3a060-668e-49b5-9ab8-d7ec35837a32 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:01.756334 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2e87b-9562-4ace-9177-01cac9257480 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:01.786425 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:01.823893 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25647a6-53bf-48de-88a9-b84fc2f707f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:01.824536 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:01.824707 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25647a6-53bf-48de-88a9-b84fc2f707f5 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:01.824995 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25647a6-53bf-48de-88a9-b84fc2f707f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:01.825273 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25647a6-53bf-48de-88a9-b84fc2f707f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:01.843573 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25647a6-53bf-48de-88a9-b84fc2f707f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:01.852007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-a25647a6-53bf-48de-88a9-b84fc2f707f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:41:01.852007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:01.852007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:01.852007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:01.852007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:01.852007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:01.852007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:01.852007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:01.852007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:01.852007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:01.852007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:01.852007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:01.852007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:01.852007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:01.852007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:01.852007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:01.853454 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:01.853454 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:01.853454 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:01.853454 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:01.853454 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:01.853454 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:01.853454 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:01.853454 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:01.853454 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:01.853454 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:01.853454 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:01.853454 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:01.853454 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:01.853454 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:01.853454 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:01.853454 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:01.854266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:01.854266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:01.854266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:01.854266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:01.854266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:01.854266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:01.854266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:01.854266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:01.854266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:01.854266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:01.854266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 05:41:01.854266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:01.854880 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 211/424] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:41:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:01.865286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3a060-668e-49b5-9ab8-d7ec35837a32 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:01.866963 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25647a6-53bf-48de-88a9-b84fc2f707f5 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:01.904685 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18077a6-4a12-4980-ac3a-0eb0f945d0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:01.905722 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18077a6-4a12-4980-ac3a-0eb0f945d0ba None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:01.906144 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18077a6-4a12-4980-ac3a-0eb0f945d0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:01.906516 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18077a6-4a12-4980-ac3a-0eb0f945d0ba None admin] PATH_INFO: `/v3/groups/b6b809c32f744ed78c642d920f86998e` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:01.908445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18077a6-4a12-4980-ac3a-0eb0f945d0ba None admin] RBAC: Authorizing `identity:get_group(group_id=b6b809c32f744ed78c642d920f86998e)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:01.910144 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18077a6-4a12-4980-ac3a-0eb0f945d0ba None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:01.919861 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 214/425] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jun 21 05:41:01 2022] GET /identity/v3/groups/b6b809c32f744ed78c642d920f86998e => generated 226 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:01.925282 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18077a6-4a12-4980-ac3a-0eb0f945d0ba None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:01.994435 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25647a6-53bf-48de-88a9-b84fc2f707f5 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:02.031154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97464875-eaf2-4dab-8e30-d1535621418f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:02.031764 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97464875-eaf2-4dab-8e30-d1535621418f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:02.032625 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97464875-eaf2-4dab-8e30-d1535621418f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:02.035544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97464875-eaf2-4dab-8e30-d1535621418f None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:02.035544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97464875-eaf2-4dab-8e30-d1535621418f None admin] RBAC: Adding query filter params (name=member) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:02.035544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97464875-eaf2-4dab-8e30-d1535621418f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:02.035544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97464875-eaf2-4dab-8e30-d1535621418f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:02.044532 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 212/426] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 21 05:41:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:02.045926 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cced0-11eb-4e93-9917-584dadea5603 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:02.046245 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cced0-11eb-4e93-9917-584dadea5603 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:02.046535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cced0-11eb-4e93-9917-584dadea5603 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:02.048211 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 213/427] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:02.053633 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18077a6-4a12-4980-ac3a-0eb0f945d0ba None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:02.055909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673be41b-ef8d-4edb-9b21-9c556d2eb588 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:02.056446 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673be41b-ef8d-4edb-9b21-9c556d2eb588 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:02.056929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673be41b-ef8d-4edb-9b21-9c556d2eb588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:02.074579 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-673be41b-ef8d-4edb-9b21-9c556d2eb588 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:02.076333 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-673be41b-ef8d-4edb-9b21-9c556d2eb588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:02.093995 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf28c75-f28c-4900-8193-7f09dea3b11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:02.095271 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf28c75-f28c-4900-8193-7f09dea3b11e None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:02.095553 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf28c75-f28c-4900-8193-7f09dea3b11e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:02.095856 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf28c75-f28c-4900-8193-7f09dea3b11e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:02.102502 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf28c75-f28c-4900-8193-7f09dea3b11e None admin] RBAC: Adding query filter params (group.id=b6b809c32f744ed78c642d920f86998e, role.id=a9602a7e01694084a0f9713d9d6394b1, scope.project.id=f8f1415161a745f387f7c6563159c122) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:02.103013 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf28c75-f28c-4900-8193-7f09dea3b11e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:02.106128 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf28c75-f28c-4900-8193-7f09dea3b11e None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:02.120762 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 215/428] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jun 21 05:41:01 2022] GET /identity/v3/role_assignments?group.id=b6b809c32f744ed78c642d920f86998e&scope.project.id=f8f1415161a745f387f7c6563159c122&role.id=a9602a7e01694084a0f9713d9d6394b1 => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:41:02.121040 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf28c75-f28c-4900-8193-7f09dea3b11e None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:02.127632 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:02.141978 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:02.183803 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 214/429] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:41:02.259763 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673be41b-ef8d-4edb-9b21-9c556d2eb588 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:02.295560 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf28c75-f28c-4900-8193-7f09dea3b11e None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:02.336455 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19de42-4e19-45db-a5f1-f55e2f0f58ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:02.337645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19de42-4e19-45db-a5f1-f55e2f0f58ec None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:02.338192 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19de42-4e19-45db-a5f1-f55e2f0f58ec None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:02.338749 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19de42-4e19-45db-a5f1-f55e2f0f58ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:02.414583 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673be41b-ef8d-4edb-9b21-9c556d2eb588 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:02.419840 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19de42-4e19-45db-a5f1-f55e2f0f58ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:02.421991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19de42-4e19-45db-a5f1-f55e2f0f58ec None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:02.439437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:02.461499 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d577148-f824-4d35-909d-38592e75cae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:02.462364 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d577148-f824-4d35-909d-38592e75cae7 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:02.462639 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d577148-f824-4d35-909d-38592e75cae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:02.462920 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d577148-f824-4d35-909d-38592e75cae7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:02.474787 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d577148-f824-4d35-909d-38592e75cae7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:02.485366 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-2d577148-f824-4d35-909d-38592e75cae7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 05:41:02.485366 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:02.485366 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:02.485366 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:02.485366 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:02.485366 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:02.485366 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:02.485366 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:02.485366 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:02.485366 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:02.485366 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:02.485366 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:02.485366 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:02.485366 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:02.485366 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:02.485366 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:02.486356 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:02.486356 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:02.486356 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:02.486356 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:02.486356 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:02.486356 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:02.486356 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:02.486356 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:02.486356 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:02.486356 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:02.486356 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:02.486356 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:02.486356 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:02.486356 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:02.486356 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:02.486356 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:02.487142 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:02.487142 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:02.487142 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:02.487142 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:02.487142 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:02.487142 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:02.487142 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:02.487142 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:02.487142 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:02.487142 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:02.487142 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 05:41:02.487142 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:02.487740 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 215/430] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 21 05:41:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:02.494669 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d577148-f824-4d35-909d-38592e75cae7 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:02.536332 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:02.588293 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 216/431] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:41:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:41:02.593039 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19de42-4e19-45db-a5f1-f55e2f0f58ec None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:02.660864 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d577148-f824-4d35-909d-38592e75cae7 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:02.702601 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca945e4c-7f81-473a-97b4-9d16164983aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:02.703284 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca945e4c-7f81-473a-97b4-9d16164983aa None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:02.703570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca945e4c-7f81-473a-97b4-9d16164983aa None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:02.704402 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca945e4c-7f81-473a-97b4-9d16164983aa None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:02.705172 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca945e4c-7f81-473a-97b4-9d16164983aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:02.705483 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca945e4c-7f81-473a-97b4-9d16164983aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:02.706909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca945e4c-7f81-473a-97b4-9d16164983aa None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:02.722244 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 216/432] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:41:02.731853 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca945e4c-7f81-473a-97b4-9d16164983aa None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:02.745639 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19de42-4e19-45db-a5f1-f55e2f0f58ec None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:02.775099 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:02.800423 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e2f9f-aea9-4d21-974a-e55f85c89a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:02.801404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e2f9f-aea9-4d21-974a-e55f85c89a65 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:02.801758 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e2f9f-aea9-4d21-974a-e55f85c89a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:02.802159 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e2f9f-aea9-4d21-974a-e55f85c89a65 None admin] PATH_INFO: `/v3/projects/6b293e7dd1fa40ad886795d229901112` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:02.803557 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e2f9f-aea9-4d21-974a-e55f85c89a65 None admin] RBAC: Authorizing `identity:get_project(project_id=6b293e7dd1fa40ad886795d229901112)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:02.805177 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e2f9f-aea9-4d21-974a-e55f85c89a65 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:02.807378 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 217/433] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:41:02 2022] GET /identity/v3/projects/6b293e7dd1fa40ad886795d229901112 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:02.816290 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e2f9f-aea9-4d21-974a-e55f85c89a65 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:02.878446 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:02.889701 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca945e4c-7f81-473a-97b4-9d16164983aa None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:02.955212 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b092ea-eb96-44a4-a78d-b93a28dff1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:02.958494 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b092ea-eb96-44a4-a78d-b93a28dff1f9 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:02.958494 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b092ea-eb96-44a4-a78d-b93a28dff1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:02.958494 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b092ea-eb96-44a4-a78d-b93a28dff1f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:02.989399 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e2f9f-aea9-4d21-974a-e55f85c89a65 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:03.036800 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a88ad2-eab4-4e4e-9075-1f7c910a46f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:03.037676 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a88ad2-eab4-4e4e-9075-1f7c910a46f1 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:03.037996 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a88ad2-eab4-4e4e-9075-1f7c910a46f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:03.038402 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a88ad2-eab4-4e4e-9075-1f7c910a46f1 None admin] PATH_INFO: `/v3/groups/b6b809c32f744ed78c642d920f86998e` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:03.039649 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a88ad2-eab4-4e4e-9075-1f7c910a46f1 None admin] RBAC: Authorizing `identity:get_group(group_id=b6b809c32f744ed78c642d920f86998e)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:03.041139 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a88ad2-eab4-4e4e-9075-1f7c910a46f1 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:03.043204 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 218/434] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jun 21 05:41:02 2022] GET /identity/v3/groups/b6b809c32f744ed78c642d920f86998e => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:03.044105 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c795bd-fc27-428f-aa4a-e4b71666821e None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:03.044394 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c795bd-fc27-428f-aa4a-e4b71666821e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:03.044676 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c795bd-fc27-428f-aa4a-e4b71666821e None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:03.050140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 219/435] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:03.055809 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbcbf7-cc20-4856-b8d5-3b611e2ddd32 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:03.056102 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbcbf7-cc20-4856-b8d5-3b611e2ddd32 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:03.056379 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbcbf7-cc20-4856-b8d5-3b611e2ddd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:03.066429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b092ea-eb96-44a4-a78d-b93a28dff1f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:03.067922 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b092ea-eb96-44a4-a78d-b93a28dff1f9 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:03.080566 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-c9cbcbf7-cc20-4856-b8d5-3b611e2ddd32 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:03.085337 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c9cbcbf7-cc20-4856-b8d5-3b611e2ddd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:03.150172 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:03.176534 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 220/436] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:41:03.176916 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbcbf7-cc20-4856-b8d5-3b611e2ddd32 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:03.195300 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 217/437] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:41:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 05:41:03.195837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:03.206146 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b092ea-eb96-44a4-a78d-b93a28dff1f9 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:03.302890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbcbf7-cc20-4856-b8d5-3b611e2ddd32 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:03.320081 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b092ea-eb96-44a4-a78d-b93a28dff1f9 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:03.339391 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab989533-6956-4ce9-98cc-0c6c9cd5a779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:03.340048 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab989533-6956-4ce9-98cc-0c6c9cd5a779 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:03.340336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab989533-6956-4ce9-98cc-0c6c9cd5a779 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:03.340615 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab989533-6956-4ce9-98cc-0c6c9cd5a779 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:03.341450 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab989533-6956-4ce9-98cc-0c6c9cd5a779 None admin] RBAC: Adding query filter params (group.id=b6b809c32f744ed78c642d920f86998e, role.id=a9602a7e01694084a0f9713d9d6394b1, scope.project.id=6b293e7dd1fa40ad886795d229901112) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:03.341764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab989533-6956-4ce9-98cc-0c6c9cd5a779 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:03.343265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab989533-6956-4ce9-98cc-0c6c9cd5a779 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:03.349529 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 221/438] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jun 21 05:41:03 2022] GET /identity/v3/role_assignments?group.id=b6b809c32f744ed78c642d920f86998e&scope.project.id=6b293e7dd1fa40ad886795d229901112&role.id=a9602a7e01694084a0f9713d9d6394b1 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:03.350386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab989533-6956-4ce9-98cc-0c6c9cd5a779 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:03.356955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f3d34-9597-4cba-8828-523d414b6969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:03.357853 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f3d34-9597-4cba-8828-523d414b6969 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:03.358194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f3d34-9597-4cba-8828-523d414b6969 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:03.358478 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f3d34-9597-4cba-8828-523d414b6969 None admin] PATH_INFO: `/v3/projects/f8f1415161a745f387f7c6563159c122` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:03.360509 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f3d34-9597-4cba-8828-523d414b6969 None admin] RBAC: Authorizing `identity:get_project(project_id=f8f1415161a745f387f7c6563159c122)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:03.362641 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f3d34-9597-4cba-8828-523d414b6969 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:03.365899 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 218/439] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:41:03 2022] GET /identity/v3/projects/f8f1415161a745f387f7c6563159c122 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:41:03.367656 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6e1f4-7260-46e3-826a-5be906d8c8a9 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:03.367967 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6e1f4-7260-46e3-826a-5be906d8c8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:03.368218 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6e1f4-7260-46e3-826a-5be906d8c8a9 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:03.369919 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 219/440] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:03.374838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6e1f4-7260-46e3-826a-5be906d8c8a9 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:03.429924 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:03.445165 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:03.504516 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab989533-6956-4ce9-98cc-0c6c9cd5a779 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:03.519614 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6e1f4-7260-46e3-826a-5be906d8c8a9 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:03.548371 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a53c01-0b7d-4010-8c09-bfdd76b6946a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:03.549694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a53c01-0b7d-4010-8c09-bfdd76b6946a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:03.550353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a53c01-0b7d-4010-8c09-bfdd76b6946a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:03.550631 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a53c01-0b7d-4010-8c09-bfdd76b6946a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:03.560410 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7509c05-308a-461e-a324-e7cf70099e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:03.561576 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7509c05-308a-461e-a324-e7cf70099e38 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:03.562171 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7509c05-308a-461e-a324-e7cf70099e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:03.562450 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7509c05-308a-461e-a324-e7cf70099e38 None admin] PATH_INFO: `/v3/groups/b6b809c32f744ed78c642d920f86998e` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:03.564261 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7509c05-308a-461e-a324-e7cf70099e38 None admin] RBAC: Authorizing `identity:get_group(group_id=b6b809c32f744ed78c642d920f86998e)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:03.564460 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a53c01-0b7d-4010-8c09-bfdd76b6946a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:03.565689 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7509c05-308a-461e-a324-e7cf70099e38 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:03.567569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 220/441] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jun 21 05:41:03 2022] GET /identity/v3/groups/b6b809c32f744ed78c642d920f86998e => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:03.568756 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5085852-13fc-49d4-a553-1d718a67aa83 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:03.569037 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5085852-13fc-49d4-a553-1d718a67aa83 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:03.569307 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5085852-13fc-49d4-a553-1d718a67aa83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:03.577913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-84a53c01-0b7d-4010-8c09-bfdd76b6946a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 05:41:03.577913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:03.577913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:03.577913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:03.577913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:03.577913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:03.577913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:03.577913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:03.577913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:03.577913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:03.577913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:03.577913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:03.577913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:03.577913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:03.577913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:03.577913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:03.578917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:03.578917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:03.578917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:03.578917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:03.578917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:03.578917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:03.578917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:03.578917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:03.578917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:03.578917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:03.578917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:03.578917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:03.578917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:03.578917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:03.578917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:03.578917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:03.579814 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:03.579814 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:03.579814 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:03.579814 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:03.579814 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:03.579814 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:03.579814 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:03.579814 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:03.579814 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:03.579814 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:03.579814 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 05:41:03.579814 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:03.580406 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 222/442] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 21 05:41:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:03.581192 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a53c01-0b7d-4010-8c09-bfdd76b6946a None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:03.596805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-e5085852-13fc-49d4-a553-1d718a67aa83 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:03.598047 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e5085852-13fc-49d4-a553-1d718a67aa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:03.682008 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 221/443] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:41:03.682794 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5085852-13fc-49d4-a553-1d718a67aa83 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:03.710270 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a53c01-0b7d-4010-8c09-bfdd76b6946a None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:03.714075 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:03.752451 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f653e-6a65-42c3-84ab-7af60ba7bffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:03.753119 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f653e-6a65-42c3-84ab-7af60ba7bffa None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:03.753382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f653e-6a65-42c3-84ab-7af60ba7bffa None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:03.753662 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f653e-6a65-42c3-84ab-7af60ba7bffa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:03.754004 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:03.754691 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f653e-6a65-42c3-84ab-7af60ba7bffa None admin] RBAC: Adding query filter params (group.id=b6b809c32f744ed78c642d920f86998e, role.id=ad23f352111e42de99e9d92fbfe2e1f4, scope.project.id=f8f1415161a745f387f7c6563159c122) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:03.754874 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f653e-6a65-42c3-84ab-7af60ba7bffa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:03.756309 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f653e-6a65-42c3-84ab-7af60ba7bffa None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:03.765092 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 223/444] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jun 21 05:41:03 2022] GET /identity/v3/role_assignments?group.id=b6b809c32f744ed78c642d920f86998e&scope.project.id=f8f1415161a745f387f7c6563159c122&role.id=ad23f352111e42de99e9d92fbfe2e1f4 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:03.765963 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f653e-6a65-42c3-84ab-7af60ba7bffa None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:03.833108 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5085852-13fc-49d4-a553-1d718a67aa83 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:03.872578 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a667fd1-06e4-409e-a4e1-46808cf0a773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:03.873277 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a667fd1-06e4-409e-a4e1-46808cf0a773 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:03.873565 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a667fd1-06e4-409e-a4e1-46808cf0a773 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:03.873846 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a667fd1-06e4-409e-a4e1-46808cf0a773 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:03.874655 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a667fd1-06e4-409e-a4e1-46808cf0a773 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:03.874968 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a667fd1-06e4-409e-a4e1-46808cf0a773 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:03.876921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a667fd1-06e4-409e-a4e1-46808cf0a773 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:03.885971 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 222/445] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:03.892401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a667fd1-06e4-409e-a4e1-46808cf0a773 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:03.904716 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f653e-6a65-42c3-84ab-7af60ba7bffa None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:03.945401 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed686e-4655-40bb-8842-4f5aee03ccb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:03.946143 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed686e-4655-40bb-8842-4f5aee03ccb7 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:03.946429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed686e-4655-40bb-8842-4f5aee03ccb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:03.946702 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed686e-4655-40bb-8842-4f5aee03ccb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:03.959714 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed686e-4655-40bb-8842-4f5aee03ccb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:03.967620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-15ed686e-4655-40bb-8842-4f5aee03ccb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:41:03.967620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:03.967620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:03.967620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:03.967620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:03.967620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:03.967620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:03.967620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:03.967620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:03.967620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:03.967620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:03.967620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:03.967620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:03.967620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:03.967620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:03.967620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:03.968730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:03.968730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:03.968730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:03.968730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:03.968730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:03.968730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:03.968730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:03.968730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:03.968730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:03.968730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:03.968730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:03.968730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:03.968730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:03.968730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:03.968730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:03.968730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:03.969713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:03.969713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:03.969713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:03.969713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:03.969713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:03.969713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:03.969713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:03.969713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:03.969713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:03.969713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:03.969713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:41:03.969713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:03.969713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 224/446] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:41:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:03.974976 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed686e-4655-40bb-8842-4f5aee03ccb7 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:04.022610 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:04.035788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a667fd1-06e4-409e-a4e1-46808cf0a773 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:04.062623 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:04.087681 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f029c0-d98e-42b7-9cc9-ac7e3439f1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:04.088356 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f029c0-d98e-42b7-9cc9-ac7e3439f1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:04.088644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f029c0-d98e-42b7-9cc9-ac7e3439f1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:04.088934 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f029c0-d98e-42b7-9cc9-ac7e3439f1d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:04.137552 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed686e-4655-40bb-8842-4f5aee03ccb7 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:04.178282 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612bd5b-512e-4a3f-bbd1-b32ac9f21278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:04.178965 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612bd5b-512e-4a3f-bbd1-b32ac9f21278 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:04.179256 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612bd5b-512e-4a3f-bbd1-b32ac9f21278 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:04.179540 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612bd5b-512e-4a3f-bbd1-b32ac9f21278 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:04.180321 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612bd5b-512e-4a3f-bbd1-b32ac9f21278 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:04.180625 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612bd5b-512e-4a3f-bbd1-b32ac9f21278 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:04.182067 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612bd5b-512e-4a3f-bbd1-b32ac9f21278 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:04.185644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f029c0-d98e-42b7-9cc9-ac7e3439f1d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:04.187173 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f029c0-d98e-42b7-9cc9-ac7e3439f1d3 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:04.195636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 225/447] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:41:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:41:04.201197 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612bd5b-512e-4a3f-bbd1-b32ac9f21278 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:04.337210 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 223/448] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:41:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 05:41:04.340911 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:04.344438 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f029c0-d98e-42b7-9cc9-ac7e3439f1d3 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:04.354209 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612bd5b-512e-4a3f-bbd1-b32ac9f21278 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:04.376764 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:04.390352 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712b002-fab5-4942-92fd-0bd0a80da984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:04.391017 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712b002-fab5-4942-92fd-0bd0a80da984 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:04.391303 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712b002-fab5-4942-92fd-0bd0a80da984 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:04.391584 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712b002-fab5-4942-92fd-0bd0a80da984 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:04.458908 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f029c0-d98e-42b7-9cc9-ac7e3439f1d3 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:04.476158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712b002-fab5-4942-92fd-0bd0a80da984 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:04.477644 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712b002-fab5-4942-92fd-0bd0a80da984 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:04.499781 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a448d8-50d7-4262-9ea1-6090461a312c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:04.500824 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a448d8-50d7-4262-9ea1-6090461a312c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:04.501115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a448d8-50d7-4262-9ea1-6090461a312c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:04.501401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a448d8-50d7-4262-9ea1-6090461a312c None admin] PATH_INFO: `/v3/projects/6b293e7dd1fa40ad886795d229901112` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:04.502708 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a448d8-50d7-4262-9ea1-6090461a312c None admin] RBAC: Authorizing `identity:get_project(project_id=6b293e7dd1fa40ad886795d229901112)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:04.504177 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a448d8-50d7-4262-9ea1-6090461a312c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:04.505886 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 224/449] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:41:04 2022] GET /identity/v3/projects/6b293e7dd1fa40ad886795d229901112 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:41:04.511255 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a448d8-50d7-4262-9ea1-6090461a312c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:04.574462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:04.585820 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 226/450] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:41:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 05:41:04.591397 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712b002-fab5-4942-92fd-0bd0a80da984 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:04.614082 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:04.626908 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a448d8-50d7-4262-9ea1-6090461a312c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:04.663403 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ce0da-a587-4498-b4ee-84e8cb70b1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:04.664265 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ce0da-a587-4498-b4ee-84e8cb70b1cb None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:04.664554 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ce0da-a587-4498-b4ee-84e8cb70b1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:04.664833 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ce0da-a587-4498-b4ee-84e8cb70b1cb None admin] PATH_INFO: `/v3/groups/b6b809c32f744ed78c642d920f86998e` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:04.666065 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ce0da-a587-4498-b4ee-84e8cb70b1cb None admin] RBAC: Authorizing `identity:get_group(group_id=b6b809c32f744ed78c642d920f86998e)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:04.667509 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ce0da-a587-4498-b4ee-84e8cb70b1cb None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:04.669143 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 225/451] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jun 21 05:41:04 2022] GET /identity/v3/groups/b6b809c32f744ed78c642d920f86998e => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:41:04.675571 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ce0da-a587-4498-b4ee-84e8cb70b1cb None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:04.706064 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712b002-fab5-4942-92fd-0bd0a80da984 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:04.743049 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097f48d-bd85-4ee3-b725-8b967ec7f5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:04.743821 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097f48d-bd85-4ee3-b725-8b967ec7f5ce None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:04.744104 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097f48d-bd85-4ee3-b725-8b967ec7f5ce None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:04.744382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097f48d-bd85-4ee3-b725-8b967ec7f5ce None admin] PATH_INFO: `/v3/projects/fcf1eaa475624717b45bb4aefba5ae51` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:04.745606 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c097f48d-bd85-4ee3-b725-8b967ec7f5ce None admin] RBAC: Authorizing `identity:get_project(project_id=fcf1eaa475624717b45bb4aefba5ae51)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:04.747117 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c097f48d-bd85-4ee3-b725-8b967ec7f5ce None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:04.748833 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 227/452] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:41:04 2022] GET /identity/v3/projects/fcf1eaa475624717b45bb4aefba5ae51 => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:41:04.754347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097f48d-bd85-4ee3-b725-8b967ec7f5ce None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:04.776895 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ce0da-a587-4498-b4ee-84e8cb70b1cb None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:04.814724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85751cc7-5f28-45cb-a742-cbb391d4ef6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:04.814981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:04.815391 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85751cc7-5f28-45cb-a742-cbb391d4ef6d None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:04.815679 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85751cc7-5f28-45cb-a742-cbb391d4ef6d None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:04.815955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85751cc7-5f28-45cb-a742-cbb391d4ef6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:04.816856 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85751cc7-5f28-45cb-a742-cbb391d4ef6d None admin] RBAC: Adding query filter params (group.id=b6b809c32f744ed78c642d920f86998e, role.id=ad23f352111e42de99e9d92fbfe2e1f4, scope.project.id=6b293e7dd1fa40ad886795d229901112) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:04.817218 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85751cc7-5f28-45cb-a742-cbb391d4ef6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:04.818735 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85751cc7-5f28-45cb-a742-cbb391d4ef6d None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:04.826614 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 226/453] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jun 21 05:41:04 2022] GET /identity/v3/role_assignments?group.id=b6b809c32f744ed78c642d920f86998e&scope.project.id=6b293e7dd1fa40ad886795d229901112&role.id=ad23f352111e42de99e9d92fbfe2e1f4 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:41:04.864630 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097f48d-bd85-4ee3-b725-8b967ec7f5ce None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:04.902554 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5fb62-4f09-44bb-9d85-dfa7b59fa53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:04.903425 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5fb62-4f09-44bb-9d85-dfa7b59fa53e None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:04.903708 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5fb62-4f09-44bb-9d85-dfa7b59fa53e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:04.903984 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5fb62-4f09-44bb-9d85-dfa7b59fa53e None admin] PATH_INFO: `/v3/groups/e84a2ce06ad24262ae2b7a4c2d965875` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:04.905276 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf5fb62-4f09-44bb-9d85-dfa7b59fa53e None admin] RBAC: Authorizing `identity:get_group(group_id=e84a2ce06ad24262ae2b7a4c2d965875)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:04.907744 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf5fb62-4f09-44bb-9d85-dfa7b59fa53e None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:04.909066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 228/454] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jun 21 05:41:04 2022] GET /identity/v3/groups/e84a2ce06ad24262ae2b7a4c2d965875 => generated 229 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:41:04.915149 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85751cc7-5f28-45cb-a742-cbb391d4ef6d None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:04.939052 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:05.023277 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85751cc7-5f28-45cb-a742-cbb391d4ef6d None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:05.058415 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2c3bb-f564-4878-a048-ffd57f15971c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:05.059088 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2c3bb-f564-4878-a048-ffd57f15971c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:05.059372 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2c3bb-f564-4878-a048-ffd57f15971c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:05.059655 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2c3bb-f564-4878-a048-ffd57f15971c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:05.060499 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2c3bb-f564-4878-a048-ffd57f15971c None admin] RBAC: Adding query filter params (group.id=e84a2ce06ad24262ae2b7a4c2d965875, role.id=24aa6040c86049f996560e477e83886f, scope.project.id=fcf1eaa475624717b45bb4aefba5ae51) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:05.060811 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2c3bb-f564-4878-a048-ffd57f15971c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:05.062271 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2c3bb-f564-4878-a048-ffd57f15971c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:05.068575 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 227/455] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jun 21 05:41:04 2022] GET /identity/v3/role_assignments?group.id=e84a2ce06ad24262ae2b7a4c2d965875&scope.project.id=fcf1eaa475624717b45bb4aefba5ae51&role.id=24aa6040c86049f996560e477e83886f => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:07.540742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd4110-8eaa-459c-be31-f351f5684fd3 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:07.541592 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd4110-8eaa-459c-be31-f351f5684fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:07.542041 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd4110-8eaa-459c-be31-f351f5684fd3 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:07.543817 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 229/456] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:07.550269 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d42f5-f810-4999-a09a-2f1b470de4fe None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:07.550740 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d42f5-f810-4999-a09a-2f1b470de4fe None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:07.550965 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d42f5-f810-4999-a09a-2f1b470de4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:07.574974 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-226d42f5-f810-4999-a09a-2f1b470de4fe None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:07.576677 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-226d42f5-f810-4999-a09a-2f1b470de4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:07.679849 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 228/457] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:41:07.725174 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd4110-8eaa-459c-be31-f351f5684fd3 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:07.855139 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33c262-cbf0-4861-a532-86f02e3f0c5a None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:07.855812 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33c262-cbf0-4861-a532-86f02e3f0c5a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:07.856408 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33c262-cbf0-4861-a532-86f02e3f0c5a None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:07.862108 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 229/458] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:07.864243 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb08ac-568a-4310-a42b-9daa6910fd0a None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:07.864778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb08ac-568a-4310-a42b-9daa6910fd0a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:07.865257 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb08ac-568a-4310-a42b-9daa6910fd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:07.867797 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd4110-8eaa-459c-be31-f351f5684fd3 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:07.892083 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-01cb08ac-568a-4310-a42b-9daa6910fd0a None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:07.893634 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-01cb08ac-568a-4310-a42b-9daa6910fd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:07.904532 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:07.930296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:07.954246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6beb74-8e0d-48b7-baf7-0f52670341a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:07.955054 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6beb74-8e0d-48b7-baf7-0f52670341a0 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:07.955332 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6beb74-8e0d-48b7-baf7-0f52670341a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:07.955663 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6beb74-8e0d-48b7-baf7-0f52670341a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:07.976913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6beb74-8e0d-48b7-baf7-0f52670341a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:07.978425 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6beb74-8e0d-48b7-baf7-0f52670341a0 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:08.010869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-8f6beb74-8e0d-48b7-baf7-0f52670341a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:08.010869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:08.010869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:08.010869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:08.010869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:08.010869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:08.010869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:08.010869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:08.010869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:08.010869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:08.010869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:08.010869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:08.010869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:08.010869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:08.010869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:08.011809 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:08.011809 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:08.011809 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:08.011809 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:08.011809 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:08.011809 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:08.011809 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:08.011809 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:08.011809 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:08.011809 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:08.011809 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:08.011809 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:08.011809 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:08.011809 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:08.011809 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:08.011809 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:08.011809 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:08.012652 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:08.012652 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:08.012652 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:08.012652 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:08.016801 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 230/459] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:08.018174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 230/460] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 05:41:08.019126 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6beb74-8e0d-48b7-baf7-0f52670341a0 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:08.043899 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb08ac-568a-4310-a42b-9daa6910fd0a None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:08.209847 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb08ac-568a-4310-a42b-9daa6910fd0a None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:08.227412 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6beb74-8e0d-48b7-baf7-0f52670341a0 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:08.247552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d109b60-4487-4e3c-8176-244809dbb81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:08.248701 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d109b60-4487-4e3c-8176-244809dbb81c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:08.249127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d109b60-4487-4e3c-8176-244809dbb81c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:08.249577 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d109b60-4487-4e3c-8176-244809dbb81c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:08.262359 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d109b60-4487-4e3c-8176-244809dbb81c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:08.264338 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d109b60-4487-4e3c-8176-244809dbb81c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:08.267756 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:08.278339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e512e4-d69e-4903-9ad2-80628f1cf623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:08.279159 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e512e4-d69e-4903-9ad2-80628f1cf623 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:08.279596 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e512e4-d69e-4903-9ad2-80628f1cf623 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:08.279893 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e512e4-d69e-4903-9ad2-80628f1cf623 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:08.280645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e512e4-d69e-4903-9ad2-80628f1cf623 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:08.280957 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e512e4-d69e-4903-9ad2-80628f1cf623 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:08.282433 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e512e4-d69e-4903-9ad2-80628f1cf623 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:08.288755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-3d109b60-4487-4e3c-8176-244809dbb81c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:08.288755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:08.288755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:08.288755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:08.288755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:08.288755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:08.288755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:08.288755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:08.288755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:08.288755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:08.288755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:08.288755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:08.288755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:08.288755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:08.288755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:08.289788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:08.289788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:08.289788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:08.289788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:08.289788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:08.289788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:08.289788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:08.289788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:08.289788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:08.289788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:08.289788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:08.289788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:08.289788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:08.289788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:08.289788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:08.289788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:08.289788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:08.290773 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:08.290773 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:08.290773 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:08.290773 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:08.292603 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 231/461] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:41:08.294216 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637c3a7-4b25-4913-bc25-c58e2aa567f5 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:08.294704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637c3a7-4b25-4913-bc25-c58e2aa567f5 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:08.295154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637c3a7-4b25-4913-bc25-c58e2aa567f5 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:08.296924 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 232/462] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:08.298436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637c3a7-4b25-4913-bc25-c58e2aa567f5 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:08.305724 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 231/463] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:08.307067 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4596052-79e3-404d-b3f2-cb6b2663d53a None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:08.307355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4596052-79e3-404d-b3f2-cb6b2663d53a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:08.307636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4596052-79e3-404d-b3f2-cb6b2663d53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:08.334533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-d4596052-79e3-404d-b3f2-cb6b2663d53a None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:08.335759 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d4596052-79e3-404d-b3f2-cb6b2663d53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:08.372854 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:08.415093 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637c3a7-4b25-4913-bc25-c58e2aa567f5 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:08.422030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 232/464] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:41:08.423573 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4596052-79e3-404d-b3f2-cb6b2663d53a None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:08.455111 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc647f-c97b-4ecf-bb6e-91b2ed821825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:08.455785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc647f-c97b-4ecf-bb6e-91b2ed821825 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:08.456093 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc647f-c97b-4ecf-bb6e-91b2ed821825 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:08.456359 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc647f-c97b-4ecf-bb6e-91b2ed821825 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:08.457124 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc647f-c97b-4ecf-bb6e-91b2ed821825 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:08.457437 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc647f-c97b-4ecf-bb6e-91b2ed821825 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:08.458838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc647f-c97b-4ecf-bb6e-91b2ed821825 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:08.479680 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 233/465] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:08.482414 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19dc79-f370-433f-92ec-90e71784ee79 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:08.482919 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19dc79-f370-433f-92ec-90e71784ee79 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:08.483396 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19dc79-f370-433f-92ec-90e71784ee79 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:08.485778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 234/466] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:08.486762 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19dc79-f370-433f-92ec-90e71784ee79 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:08.564293 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:08.577513 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4596052-79e3-404d-b3f2-cb6b2663d53a None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:08.616897 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30c081-ebc5-45b9-b2af-c1ee2c727352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:08.617670 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30c081-ebc5-45b9-b2af-c1ee2c727352 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:08.618049 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30c081-ebc5-45b9-b2af-c1ee2c727352 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:08.618396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30c081-ebc5-45b9-b2af-c1ee2c727352 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:08.619175 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30c081-ebc5-45b9-b2af-c1ee2c727352 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:08.619416 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19dc79-f370-433f-92ec-90e71784ee79 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:08.620802 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30c081-ebc5-45b9-b2af-c1ee2c727352 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:08.646708 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 233/467] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 21 05:41:08 2022] POST /identity/v3/users => generated 246 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:41:08.659113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30c081-ebc5-45b9-b2af-c1ee2c727352 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:08.672534 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e41c4-b827-4bce-b94b-1132064f0cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:08.673643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e41c4-b827-4bce-b94b-1132064f0cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:08.674168 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e41c4-b827-4bce-b94b-1132064f0cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:08.674649 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e41c4-b827-4bce-b94b-1132064f0cf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:08.694165 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e41c4-b827-4bce-b94b-1132064f0cf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:08.695987 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e41c4-b827-4bce-b94b-1132064f0cf4 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:08.701564 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:08.722982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-702e41c4-b827-4bce-b94b-1132064f0cf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:08.722982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:08.722982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:08.722982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:08.722982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:08.722982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:08.722982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:08.722982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:08.722982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:08.722982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:08.722982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:08.722982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:08.722982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:08.722982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:08.722982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:08.724665 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:08.724665 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:08.724665 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:08.724665 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:08.724665 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:08.724665 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:08.724665 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:08.724665 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:08.724665 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:08.724665 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:08.724665 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:08.724665 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:08.724665 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:08.724665 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:08.724665 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:08.724665 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:08.724665 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:08.725873 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:08.725873 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:08.725873 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:08.725873 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:08.730886 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 235/468] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:08.732176 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce49df6-41d1-42b8-a7d8-7f2b7757433e None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:08.732467 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce49df6-41d1-42b8-a7d8-7f2b7757433e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:08.732745 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce49df6-41d1-42b8-a7d8-7f2b7757433e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:08.751985 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-7ce49df6-41d1-42b8-a7d8-7f2b7757433e None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:08.753345 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-7ce49df6-41d1-42b8-a7d8-7f2b7757433e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:08.811923 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30c081-ebc5-45b9-b2af-c1ee2c727352 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:08.839600 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 236/469] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:41:08.840383 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce49df6-41d1-42b8-a7d8-7f2b7757433e None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:08.852565 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab286be-b422-42e5-9661-175429a7f838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:08.853488 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab286be-b422-42e5-9661-175429a7f838 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:08.853919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab286be-b422-42e5-9661-175429a7f838 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:08.854390 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab286be-b422-42e5-9661-175429a7f838 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:08.855259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab286be-b422-42e5-9661-175429a7f838 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:08.857138 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab286be-b422-42e5-9661-175429a7f838 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:08.883323 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 234/470] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 21 05:41:08 2022] POST /identity/v3/users => generated 248 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:41:08.884258 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab286be-b422-42e5-9661-175429a7f838 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:08.910894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:09.005196 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce49df6-41d1-42b8-a7d8-7f2b7757433e None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:09.051522 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22928e3c-1558-4ca2-aaf9-f59cc7bd75df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:09.053821 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22928e3c-1558-4ca2-aaf9-f59cc7bd75df None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:09.054051 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:09.054237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22928e3c-1558-4ca2-aaf9-f59cc7bd75df None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:09.054237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22928e3c-1558-4ca2-aaf9-f59cc7bd75df None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:09.054237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22928e3c-1558-4ca2-aaf9-f59cc7bd75df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:09.054237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22928e3c-1558-4ca2-aaf9-f59cc7bd75df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:09.055510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22928e3c-1558-4ca2-aaf9-f59cc7bd75df None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:09.059413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab286be-b422-42e5-9661-175429a7f838 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:09.068663 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 237/471] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:09.074305 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22928e3c-1558-4ca2-aaf9-f59cc7bd75df None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:09.125737 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e9ab6-d087-4462-be3a-2eee777c3559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:09.126813 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e9ab6-d087-4462-be3a-2eee777c3559 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:09.127094 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e9ab6-d087-4462-be3a-2eee777c3559 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:09.127373 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e9ab6-d087-4462-be3a-2eee777c3559 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:09.140808 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e9ab6-d087-4462-be3a-2eee777c3559 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:09.143309 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e9ab6-d087-4462-be3a-2eee777c3559 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:09.164742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-d99e9ab6-d087-4462-be3a-2eee777c3559 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:09.164742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:09.164742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:09.164742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:09.164742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:09.164742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:09.164742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:09.164742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:09.164742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:09.164742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:09.164742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:09.164742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:09.164742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:09.164742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:09.164742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:09.165635 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:09.165635 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:09.165635 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:09.165635 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:09.165635 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:09.165635 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:09.165635 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:09.165635 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:09.165635 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:09.165635 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:09.165635 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:09.165635 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:09.165635 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:09.165635 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:09.165635 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:09.165635 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:09.165635 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:09.166521 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:09.166521 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:09.166521 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:09.166521 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:09.166521 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 235/472] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:09.173829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e9ab6-d087-4462-be3a-2eee777c3559 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:09.193789 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22928e3c-1558-4ca2-aaf9-f59cc7bd75df None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:09.220471 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:09.233023 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517708ac-7866-489f-94b3-1a2da73d7eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:09.233710 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517708ac-7866-489f-94b3-1a2da73d7eda None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:09.234601 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517708ac-7866-489f-94b3-1a2da73d7eda None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:09.234601 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517708ac-7866-489f-94b3-1a2da73d7eda None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:09.235409 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517708ac-7866-489f-94b3-1a2da73d7eda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:09.236512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517708ac-7866-489f-94b3-1a2da73d7eda None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:09.261494 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 238/473] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 21 05:41:09 2022] POST /identity/v3/users => generated 248 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 05:41:09.267785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8dfae-7578-4b6f-a431-2ed80fb01bea None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:09.268123 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8dfae-7578-4b6f-a431-2ed80fb01bea None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:09.268409 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8dfae-7578-4b6f-a431-2ed80fb01bea None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:09.270114 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 239/474] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:09.277554 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb91f1-022f-4f89-9463-1eaf061596b3 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:09.278004 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb91f1-022f-4f89-9463-1eaf061596b3 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:09.278295 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb91f1-022f-4f89-9463-1eaf061596b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:09.300878 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-53fb91f1-022f-4f89-9463-1eaf061596b3 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:09.302214 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-53fb91f1-022f-4f89-9463-1eaf061596b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:09.316803 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e9ab6-d087-4462-be3a-2eee777c3559 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:09.390326 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:09.399415 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d1452-6afa-4b17-8eb5-187bf98a8342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:09.400193 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d1452-6afa-4b17-8eb5-187bf98a8342 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:09.400482 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d1452-6afa-4b17-8eb5-187bf98a8342 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:09.400806 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d1452-6afa-4b17-8eb5-187bf98a8342 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:09.401563 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d1452-6afa-4b17-8eb5-187bf98a8342 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:09.401874 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d1452-6afa-4b17-8eb5-187bf98a8342 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:09.407793 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d1452-6afa-4b17-8eb5-187bf98a8342 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:09.431785 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 236/475] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:09.437449 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 240/476] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 05:41:09.439107 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d1452-6afa-4b17-8eb5-187bf98a8342 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:09.469578 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb91f1-022f-4f89-9463-1eaf061596b3 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:09.566652 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:09.576229 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d1452-6afa-4b17-8eb5-187bf98a8342 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:09.589195 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb91f1-022f-4f89-9463-1eaf061596b3 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:09.620316 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffa219-9f90-43c2-8b72-7ef0ef5440e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:09.621115 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffa219-9f90-43c2-8b72-7ef0ef5440e8 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:09.621403 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffa219-9f90-43c2-8b72-7ef0ef5440e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:09.621803 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffa219-9f90-43c2-8b72-7ef0ef5440e8 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:09.622567 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dffa219-9f90-43c2-8b72-7ef0ef5440e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:09.624198 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dffa219-9f90-43c2-8b72-7ef0ef5440e8 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:09.634779 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2dc1c-60db-4162-9ef6-410d4c256baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:09.635845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2dc1c-60db-4162-9ef6-410d4c256baf None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:09.636204 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2dc1c-60db-4162-9ef6-410d4c256baf None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:09.636549 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2dc1c-60db-4162-9ef6-410d4c256baf None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:09.637380 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc2dc1c-60db-4162-9ef6-410d4c256baf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:09.638868 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc2dc1c-60db-4162-9ef6-410d4c256baf None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:09.649426 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.sql.core [None req-fcc2dc1c-60db-4162-9ef6-410d4c256baf None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 21 05:41:09.649426 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 21 05:41:09.649426 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [parameters: {'id': '2a8b8ea2659c4137b7d550202499a89e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 21 05:41:09.649426 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80110) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 21 05:41:09.654648 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 237/477] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 21 05:41:09 2022] POST /identity/v3/users => generated 249 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:41:09.675610 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-fcc2dc1c-60db-4162-9ef6-410d4c256baf None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 21 05:41:09.675610 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:09.675610 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 05:41:09.675610 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 05:41:09.675610 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 05:41:09.675610 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 05:41:09.675610 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 05:41:09.675610 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 05:41:09.675610 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 05:41:09.675610 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application conn.query(q) Jun 21 05:41:09.675610 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 05:41:09.675610 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 05:41:09.675610 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 05:41:09.675610 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application result.read() Jun 21 05:41:09.675610 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 05:41:09.676632 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 05:41:09.676632 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 05:41:09.676632 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 05:41:09.676632 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 05:41:09.676632 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 05:41:09.676632 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 05:41:09.676632 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 05:41:09.676632 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 21 05:41:09.676632 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:09.676632 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 21 05:41:09.676632 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:09.676632 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:09.676632 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 21 05:41:09.676632 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 21 05:41:09.676632 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 21 05:41:09.676632 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return ref.to_dict() Jun 21 05:41:09.676632 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 05:41:09.676632 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application next(self.gen) Jun 21 05:41:09.677743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 21 05:41:09.677743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application yield resource Jun 21 05:41:09.677743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 05:41:09.677743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application next(self.gen) Jun 21 05:41:09.677743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 21 05:41:09.677743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self.session.rollback() Jun 21 05:41:09.677743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 21 05:41:09.677743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self.force_reraise() Jun 21 05:41:09.677743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 21 05:41:09.677743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise self.value Jun 21 05:41:09.677743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 21 05:41:09.677743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 21 05:41:09.677743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 21 05:41:09.677743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application session.commit() Jun 21 05:41:09.677743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 21 05:41:09.677743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 21 05:41:09.677743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 21 05:41:09.679331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._prepare_impl() Jun 21 05:41:09.679331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 21 05:41:09.679331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self.session.flush() Jun 21 05:41:09.679331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 21 05:41:09.679331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._flush(objects) Jun 21 05:41:09.679331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 21 05:41:09.679331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 21 05:41:09.679331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 21 05:41:09.679331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application compat.raise_( Jun 21 05:41:09.679331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 05:41:09.679331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception Jun 21 05:41:09.679331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 21 05:41:09.679331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application flush_context.execute() Jun 21 05:41:09.679331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 21 05:41:09.679331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rec.execute(self) Jun 21 05:41:09.679331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 21 05:41:09.679331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 21 05:41:09.680921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 21 05:41:09.680921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 21 05:41:09.680921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 21 05:41:09.680921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 21 05:41:09.680921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 21 05:41:09.680921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 21 05:41:09.680921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 21 05:41:09.680921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 21 05:41:09.680921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 21 05:41:09.680921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 21 05:41:09.680921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 21 05:41:09.680921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 21 05:41:09.680921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 21 05:41:09.680921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 21 05:41:09.680921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 05:41:09.680921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception Jun 21 05:41:09.682290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 05:41:09.682290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 05:41:09.682290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 05:41:09.682290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 05:41:09.682290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 05:41:09.682290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 05:41:09.682290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 05:41:09.682290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application conn.query(q) Jun 21 05:41:09.682290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 05:41:09.682290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 05:41:09.682290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 05:41:09.682290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application result.read() Jun 21 05:41:09.682290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 05:41:09.682290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 05:41:09.682290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 05:41:09.682290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 05:41:09.683344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 05:41:09.683344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 05:41:09.683344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 05:41:09.683344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 05:41:09.683344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 21 05:41:09.683344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 21 05:41:09.683344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [parameters: {'id': '2a8b8ea2659c4137b7d550202499a89e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 21 05:41:09.683344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 21 05:41:09.683344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:09.683344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:41:09.683344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:09.683344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:09.683344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:09.683344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:09.683344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:09.683344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:09.684365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:09.684365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:09.684365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:09.684365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:09.684365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:09.684365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:09.684365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 21 05:41:09.684365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 21 05:41:09.684365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:09.684365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:09.684365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 21 05:41:09.684365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 21 05:41:09.684365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 21 05:41:09.684365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 21 05:41:09.684365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 21 05:41:09.684365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:09.688434 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 241/478] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Jun 21 05:41:09 2022] POST /identity/v3/roles => generated 144 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:41:09.694598 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffa219-9f90-43c2-8b72-7ef0ef5440e8 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:09.785400 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:09.858194 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffa219-9f90-43c2-8b72-7ef0ef5440e8 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:09.907310 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84cef8-73ad-451f-83a0-1280389e0f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:09.908143 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84cef8-73ad-451f-83a0-1280389e0f4d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:09.908426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84cef8-73ad-451f-83a0-1280389e0f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:09.908702 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84cef8-73ad-451f-83a0-1280389e0f4d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:09.921718 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84cef8-73ad-451f-83a0-1280389e0f4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:09.933576 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-bb84cef8-73ad-451f-83a0-1280389e0f4d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 05:41:09.933576 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:09.933576 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:09.933576 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:09.933576 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:09.933576 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:09.933576 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:09.933576 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:09.933576 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:09.933576 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:09.933576 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:09.933576 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:09.933576 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:09.933576 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:09.933576 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:09.933576 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:09.934541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:09.934541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:09.934541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:09.934541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:09.934541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:09.934541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:09.934541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:09.934541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:09.934541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:09.934541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:09.934541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:09.934541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:09.934541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:09.934541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:09.934541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:09.934541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:09.935340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:09.935340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:09.935340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:09.935340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:09.935340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:09.935340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:09.935340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:09.935340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:09.935340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:09.935340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:09.935340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 05:41:09.935340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:09.936419 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 238/479] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 21 05:41:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:09.942635 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2dc1c-60db-4162-9ef6-410d4c256baf None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:10.084592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2dc1c-60db-4162-9ef6-410d4c256baf None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:10.124520 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00ec66-3626-4fc7-9a99-cfe40f1dc2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:10.125593 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00ec66-3626-4fc7-9a99-cfe40f1dc2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:10.126126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00ec66-3626-4fc7-9a99-cfe40f1dc2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:10.126633 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00ec66-3626-4fc7-9a99-cfe40f1dc2e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:10.127636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00ec66-3626-4fc7-9a99-cfe40f1dc2e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:10.128179 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00ec66-3626-4fc7-9a99-cfe40f1dc2e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:10.129783 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00ec66-3626-4fc7-9a99-cfe40f1dc2e6 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:10.140090 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 242/480] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:11.341873 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552a293-6d66-408d-96a3-e31fca2a0451 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:11.343002 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552a293-6d66-408d-96a3-e31fca2a0451 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:11.343502 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552a293-6d66-408d-96a3-e31fca2a0451 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:11.346175 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 239/481] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:11.351662 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc881cc3-a544-4a52-8527-f3952e1554c9 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:11.352590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc881cc3-a544-4a52-8527-f3952e1554c9 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:11.353090 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc881cc3-a544-4a52-8527-f3952e1554c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:11.376552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-cc881cc3-a544-4a52-8527-f3952e1554c9 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:11.378144 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-cc881cc3-a544-4a52-8527-f3952e1554c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:11.381780 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:11.467667 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 243/482] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:41:11.507148 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552a293-6d66-408d-96a3-e31fca2a0451 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:11.653112 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552a293-6d66-408d-96a3-e31fca2a0451 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:11.666494 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:11.708874 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943755c-b250-4f8c-b659-0ebe15ecba2a None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:11.709185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943755c-b250-4f8c-b659-0ebe15ecba2a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:11.709440 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943755c-b250-4f8c-b659-0ebe15ecba2a None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:11.710858 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 244/483] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 05:41:11.714738 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e8c2e-2a5b-4edc-a059-4d472bc83e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:11.715547 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e8c2e-2a5b-4edc-a059-4d472bc83e0b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:11.715833 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e8c2e-2a5b-4edc-a059-4d472bc83e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:11.716114 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e8c2e-2a5b-4edc-a059-4d472bc83e0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:11.720417 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e549de3-51cf-4062-853d-35685b25cd29 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:11.721232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e549de3-51cf-4062-853d-35685b25cd29 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:11.721981 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e549de3-51cf-4062-853d-35685b25cd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:11.740416 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e8c2e-2a5b-4edc-a059-4d472bc83e0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:11.751515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-691e8c2e-2a5b-4edc-a059-4d472bc83e0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:11.751515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:11.751515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:11.751515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:11.751515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:11.751515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:11.751515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:11.751515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:11.751515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:11.751515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:11.751515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:11.751515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:11.751515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:11.751515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:11.751515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:11.751515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:11.752465 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:11.752465 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:11.752465 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:11.752465 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:11.752465 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:11.752465 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:11.752465 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:11.752465 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:11.752465 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:11.752465 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:11.752465 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:11.752465 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:11.752465 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:11.752465 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:11.752465 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:11.752465 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:11.753271 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:11.753271 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:11.753271 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:11.753271 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:11.753271 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:11.753271 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:11.753271 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:11.753271 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:11.753271 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:11.753271 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:11.753271 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:11.753271 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:11.755488 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-3e549de3-51cf-4062-853d-35685b25cd29 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:11.756114 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 240/484] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 21 05:41:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:11.756712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3e549de3-51cf-4062-853d-35685b25cd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:11.767453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e8c2e-2a5b-4edc-a059-4d472bc83e0b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:11.911977 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 245/485] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:41:11.928675 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e8c2e-2a5b-4edc-a059-4d472bc83e0b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:11.945467 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e549de3-51cf-4062-853d-35685b25cd29 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:12.006380 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724ba2a-8774-449e-af8e-151eb13ac939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:12.007066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724ba2a-8774-449e-af8e-151eb13ac939 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:12.007350 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724ba2a-8774-449e-af8e-151eb13ac939 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:12.007629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724ba2a-8774-449e-af8e-151eb13ac939 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:12.008396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724ba2a-8774-449e-af8e-151eb13ac939 None admin] RBAC: Adding query filter params (name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:12.008703 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724ba2a-8774-449e-af8e-151eb13ac939 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:12.010199 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724ba2a-8774-449e-af8e-151eb13ac939 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:12.027463 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 241/486] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 21 05:41:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:12.037247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724ba2a-8774-449e-af8e-151eb13ac939 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:12.066305 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:12.087720 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:12.093558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e549de3-51cf-4062-853d-35685b25cd29 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:12.148323 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633ccbb-eabf-44c2-9fb7-06f506736853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:12.149669 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633ccbb-eabf-44c2-9fb7-06f506736853 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:12.151010 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633ccbb-eabf-44c2-9fb7-06f506736853 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:12.152163 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633ccbb-eabf-44c2-9fb7-06f506736853 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:12.174380 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633ccbb-eabf-44c2-9fb7-06f506736853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:12.190283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-9633ccbb-eabf-44c2-9fb7-06f506736853 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:12.190283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:12.190283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:12.190283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:12.190283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:12.190283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:12.190283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:12.190283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:12.190283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:12.190283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:12.190283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:12.190283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:12.190283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:12.190283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:12.190283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:12.190283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:12.191281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:12.191281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:12.191281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:12.191281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:12.191281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:12.191281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:12.191281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:12.191281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:12.191281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:12.191281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:12.191281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:12.191281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:12.191281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:12.191281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:12.191281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:12.191281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:12.192154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:12.192154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:12.192154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:12.192154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:12.192154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:12.192154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:12.192154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:12.192154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:12.192154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:12.192154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:12.192154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:12.192154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:12.197338 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 246/487] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 21 05:41:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:41:12.202944 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633ccbb-eabf-44c2-9fb7-06f506736853 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:12.242204 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724ba2a-8774-449e-af8e-151eb13ac939 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:12.288419 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4bef3-37d8-44db-a5c4-854e795ced78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:12.289274 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4bef3-37d8-44db-a5c4-854e795ced78 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:12.289598 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4bef3-37d8-44db-a5c4-854e795ced78 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:12.289874 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4bef3-37d8-44db-a5c4-854e795ced78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:12.301903 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4bef3-37d8-44db-a5c4-854e795ced78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:12.303425 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4bef3-37d8-44db-a5c4-854e795ced78 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:12.321823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-b9e4bef3-37d8-44db-a5c4-854e795ced78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:12.321823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:12.321823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:12.321823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:12.321823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:12.321823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:12.321823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:12.321823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:12.321823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:12.321823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:12.321823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:12.321823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:12.321823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:12.321823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:12.321823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:12.322776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:12.322776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:12.322776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:12.322776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:12.322776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:12.322776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:12.322776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:12.322776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:12.322776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:12.322776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:12.322776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:12.322776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:12.322776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:12.322776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:12.322776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:12.322776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:12.322776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:12.324074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:12.324074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:12.324074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:12.324074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:12.324074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 242/488] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:41:12.324681 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ef012-a6d5-48af-aff7-560db0ed5621 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:12.324968 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ef012-a6d5-48af-aff7-560db0ed5621 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:12.325249 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ef012-a6d5-48af-aff7-560db0ed5621 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:12.326905 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 243/489] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:12.331191 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ef012-a6d5-48af-aff7-560db0ed5621 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:12.340669 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633ccbb-eabf-44c2-9fb7-06f506736853 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:12.377109 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:12.385272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac98348d-825e-428d-9030-3597dd124f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:12.386306 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98348d-825e-428d-9030-3597dd124f25 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:12.386777 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98348d-825e-428d-9030-3597dd124f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:12.387238 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98348d-825e-428d-9030-3597dd124f25 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:12.388199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac98348d-825e-428d-9030-3597dd124f25 None admin] RBAC: Adding query filter params (name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:12.388707 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac98348d-825e-428d-9030-3597dd124f25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:12.390303 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac98348d-825e-428d-9030-3597dd124f25 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:12.399933 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 247/490] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 21 05:41:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:12.401525 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd9f67-c994-4bfa-bb76-278bf3fe5c2b None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:12.402039 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd9f67-c994-4bfa-bb76-278bf3fe5c2b None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:12.402685 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd9f67-c994-4bfa-bb76-278bf3fe5c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:12.423530 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-b4dd9f67-c994-4bfa-bb76-278bf3fe5c2b None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:12.425184 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b4dd9f67-c994-4bfa-bb76-278bf3fe5c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:12.454739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:12.480287 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ef012-a6d5-48af-aff7-560db0ed5621 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:12.509980 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 248/491] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:41:12.509980 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd9f67-c994-4bfa-bb76-278bf3fe5c2b None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:12.532931 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1cdc2-b386-418d-b968-c720788107be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:12.533692 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1cdc2-b386-418d-b968-c720788107be None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:12.534078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1cdc2-b386-418d-b968-c720788107be None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:12.534423 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1cdc2-b386-418d-b968-c720788107be None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:12.535223 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1cdc2-b386-418d-b968-c720788107be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:12.535597 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1cdc2-b386-418d-b968-c720788107be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:12.537077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1cdc2-b386-418d-b968-c720788107be None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:12.550307 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 244/492] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:12.551715 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16b0f8-a04f-44a4-b5d0-a5c349683999 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:12.552086 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16b0f8-a04f-44a4-b5d0-a5c349683999 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:12.552438 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16b0f8-a04f-44a4-b5d0-a5c349683999 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:12.553987 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 245/493] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:12.554565 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16b0f8-a04f-44a4-b5d0-a5c349683999 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:12.643613 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd9f67-c994-4bfa-bb76-278bf3fe5c2b None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:12.676208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:12.677420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16b0f8-a04f-44a4-b5d0-a5c349683999 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:12.692708 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c4962-a8ba-4b68-8132-d178e6979d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:12.693807 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c4962-a8ba-4b68-8132-d178e6979d6c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:12.694133 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c4962-a8ba-4b68-8132-d178e6979d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:12.694419 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c4962-a8ba-4b68-8132-d178e6979d6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:12.707770 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c4962-a8ba-4b68-8132-d178e6979d6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:12.709225 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c4962-a8ba-4b68-8132-d178e6979d6c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:12.718848 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45817e10-3028-49b8-853d-f9216c4409e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:12.720266 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45817e10-3028-49b8-853d-f9216c4409e0 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:12.720716 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45817e10-3028-49b8-853d-f9216c4409e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:12.721001 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45817e10-3028-49b8-853d-f9216c4409e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:12.729801 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-715c4962-a8ba-4b68-8132-d178e6979d6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:12.729801 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:12.729801 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:12.729801 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:12.729801 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:12.729801 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:12.729801 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:12.729801 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:12.729801 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:12.729801 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:12.729801 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:12.729801 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:12.729801 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:12.729801 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:12.729801 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:12.731030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:12.731030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:12.731030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:12.731030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:12.731030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:12.731030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:12.731030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:12.731030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:12.731030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:12.731030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:12.731030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:12.731030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:12.731030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:12.731030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:12.731030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:12.731030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:12.731030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:12.732128 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:12.732128 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:12.732128 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:12.732128 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:12.732128 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 249/494] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:12.732128 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c4962-a8ba-4b68-8132-d178e6979d6c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:12.739544 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45817e10-3028-49b8-853d-f9216c4409e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:12.749512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-45817e10-3028-49b8-853d-f9216c4409e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:12.749512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:12.749512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:12.749512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:12.749512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:12.749512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:12.749512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:12.749512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:12.749512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:12.749512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:12.749512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:12.749512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:12.749512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:12.749512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:12.749512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:12.749512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:12.750542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:12.750542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:12.750542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:12.750542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:12.750542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:12.750542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:12.750542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:12.750542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:12.750542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:12.750542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:12.750542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:12.750542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:12.750542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:12.750542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:12.750542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:12.750542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:12.751392 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:12.751392 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:12.751392 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:12.751392 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:12.751392 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:12.751392 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:12.751392 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:12.751392 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:12.751392 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:12.751392 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:12.751392 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:12.751392 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:12.751392 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 246/495] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 21 05:41:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:12.751392 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949f636-b3ad-4e78-9c3d-456d9f7122b9 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:12.752106 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949f636-b3ad-4e78-9c3d-456d9f7122b9 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:12.752106 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949f636-b3ad-4e78-9c3d-456d9f7122b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:12.756638 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:12.769673 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-5949f636-b3ad-4e78-9c3d-456d9f7122b9 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:12.770913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5949f636-b3ad-4e78-9c3d-456d9f7122b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:12.855316 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 247/496] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:41:12.860694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949f636-b3ad-4e78-9c3d-456d9f7122b9 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:12.881434 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c4962-a8ba-4b68-8132-d178e6979d6c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:12.923091 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58acca-789f-409f-88c2-e059e124aad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:12.923891 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58acca-789f-409f-88c2-e059e124aad3 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:12.924177 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58acca-789f-409f-88c2-e059e124aad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:12.924478 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58acca-789f-409f-88c2-e059e124aad3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:12.932357 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58acca-789f-409f-88c2-e059e124aad3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:12.933747 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58acca-789f-409f-88c2-e059e124aad3 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:12.952733 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-ad58acca-789f-409f-88c2-e059e124aad3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 05:41:12.952733 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:12.952733 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:12.952733 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:12.952733 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:12.952733 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:12.952733 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:12.952733 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:12.952733 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:12.952733 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:12.952733 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:12.952733 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:12.952733 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:41:12.952733 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:41:12.952733 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:41:12.952733 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:41:12.953755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:12.953755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:12.953755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:41:12.953755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:12.953755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:41:12.953755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:12.953755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:12.953755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:12.953755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:12.953755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:12.953755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:12.953755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:12.953755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:12.953755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:12.953755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:12.953755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:12.953755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:12.953755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:12.954771 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:12.954771 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:12.954771 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:41:12.954771 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:41:12.954771 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:41:12.954771 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:41:12.954771 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:41:12.954771 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:41:12.954771 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 05:41:12.954771 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:12.954771 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 250/497] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jun 21 05:41:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:12.954771 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58acca-789f-409f-88c2-e059e124aad3 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:12.985611 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949f636-b3ad-4e78-9c3d-456d9f7122b9 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:12.995754 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:13.017650 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:13.023340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350af2b8-bac3-4d46-be10-2ed28d2fb5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:13.024001 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350af2b8-bac3-4d46-be10-2ed28d2fb5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:13.024283 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350af2b8-bac3-4d46-be10-2ed28d2fb5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:13.024558 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350af2b8-bac3-4d46-be10-2ed28d2fb5c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:13.025291 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350af2b8-bac3-4d46-be10-2ed28d2fb5c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:13.027145 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350af2b8-bac3-4d46-be10-2ed28d2fb5c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:13.027145 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350af2b8-bac3-4d46-be10-2ed28d2fb5c4 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:13.039686 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 248/498] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:13.040532 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350af2b8-bac3-4d46-be10-2ed28d2fb5c4 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:13.070419 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58acca-789f-409f-88c2-e059e124aad3 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:13.111305 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad5b21-3dff-45fd-abf0-d8e916cc8403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:13.111990 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad5b21-3dff-45fd-abf0-d8e916cc8403 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:13.112271 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad5b21-3dff-45fd-abf0-d8e916cc8403 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:13.112552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad5b21-3dff-45fd-abf0-d8e916cc8403 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:13.113306 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad5b21-3dff-45fd-abf0-d8e916cc8403 None admin] RBAC: Adding query filter params (name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:13.114044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad5b21-3dff-45fd-abf0-d8e916cc8403 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:13.115027 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad5b21-3dff-45fd-abf0-d8e916cc8403 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:13.124541 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 251/499] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 21 05:41:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:13.124541 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44404da9-bdfc-44d3-8cfd-257b27476920 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:13.124541 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44404da9-bdfc-44d3-8cfd-257b27476920 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:13.124541 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44404da9-bdfc-44d3-8cfd-257b27476920 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:13.124541 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 252/500] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:13.124541 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44404da9-bdfc-44d3-8cfd-257b27476920 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:13.163208 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350af2b8-bac3-4d46-be10-2ed28d2fb5c4 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:13.196629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5d808-6001-4f47-a9be-7586a2a60e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:13.197335 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5d808-6001-4f47-a9be-7586a2a60e10 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:13.197617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5d808-6001-4f47-a9be-7586a2a60e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:13.197892 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5d808-6001-4f47-a9be-7586a2a60e10 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:13.208952 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5d808-6001-4f47-a9be-7586a2a60e10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:13.216689 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-bca5d808-6001-4f47-a9be-7586a2a60e10 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:13.216689 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:13.216689 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:13.216689 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:13.216689 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:13.216689 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:13.216689 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:13.216689 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:13.216689 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:13.216689 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:13.216689 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:13.216689 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:13.216689 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:13.216689 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:13.216689 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:13.216689 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:13.217796 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:13.217796 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:13.217796 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:13.217796 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:13.217796 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:13.217796 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:13.217796 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:13.217796 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:13.217796 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:13.217796 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:13.217796 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:13.217796 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:13.217796 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:13.217796 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:13.217796 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:13.217796 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:13.218662 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:13.218662 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:13.218662 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:13.218662 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:13.218662 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:13.218662 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:13.218662 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:13.218662 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:13.218662 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:13.218662 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:13.218662 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:13.218662 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:13.218662 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 249/501] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 21 05:41:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:13.218662 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5d808-6001-4f47-a9be-7586a2a60e10 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:13.247165 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:13.254748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44404da9-bdfc-44d3-8cfd-257b27476920 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:13.279868 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:13.292680 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfbc34-4982-444b-9635-5236e782bac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:13.293350 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfbc34-4982-444b-9635-5236e782bac2 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:13.293633 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfbc34-4982-444b-9635-5236e782bac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:13.293908 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfbc34-4982-444b-9635-5236e782bac2 None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:13.294787 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfbc34-4982-444b-9635-5236e782bac2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:13.295094 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfbc34-4982-444b-9635-5236e782bac2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:13.296528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfbc34-4982-444b-9635-5236e782bac2 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:13.334015 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5d808-6001-4f47-a9be-7586a2a60e10 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:13.334384 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 253/502] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jun 21 05:41:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:13.335234 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfbc34-4982-444b-9635-5236e782bac2 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:13.380958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d6cea-27a2-41a8-beea-fc694ab1e5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:13.381745 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d6cea-27a2-41a8-beea-fc694ab1e5ac None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:13.382063 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d6cea-27a2-41a8-beea-fc694ab1e5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:13.382349 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d6cea-27a2-41a8-beea-fc694ab1e5ac None admin] PATH_INFO: `/v3/users/glance` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:13.391660 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d6cea-27a2-41a8-beea-fc694ab1e5ac None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:13.393139 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d6cea-27a2-41a8-beea-fc694ab1e5ac None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:13.409958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-d03d6cea-27a2-41a8-beea-fc694ab1e5ac None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 21 05:41:13.409958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:13.409958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:13.409958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:13.409958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:13.409958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:13.409958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:13.409958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:13.409958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:13.409958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:13.409958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:13.409958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:13.409958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:41:13.409958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:41:13.409958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:41:13.409958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:41:13.410951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:13.410951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:13.410951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:41:13.410951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:13.410951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:41:13.410951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:13.410951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:13.410951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:13.410951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:13.410951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:13.410951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:13.410951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:13.410951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:13.410951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:13.410951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:13.410951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:13.410951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:13.410951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:13.411835 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:13.411835 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:13.411835 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:41:13.411835 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:41:13.411835 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:41:13.411835 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:41:13.411835 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:41:13.411835 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:41:13.411835 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 21 05:41:13.411835 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:13.411835 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 250/503] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:41:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:13.412578 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334085e-47a9-4a74-beb4-960099cb6ea7 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:13.412868 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334085e-47a9-4a74-beb4-960099cb6ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:13.413148 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334085e-47a9-4a74-beb4-960099cb6ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:13.430572 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-b334085e-47a9-4a74-beb4-960099cb6ea7 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:13.431952 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b334085e-47a9-4a74-beb4-960099cb6ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:13.458406 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfbc34-4982-444b-9635-5236e782bac2 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:13.502701 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 251/504] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:41:13.503277 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836532fa-c9d9-417f-a47d-e2112406419a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:13.503558 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334085e-47a9-4a74-beb4-960099cb6ea7 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:13.503976 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836532fa-c9d9-417f-a47d-e2112406419a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:13.504210 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836532fa-c9d9-417f-a47d-e2112406419a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:13.504489 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836532fa-c9d9-417f-a47d-e2112406419a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:13.529834 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836532fa-c9d9-417f-a47d-e2112406419a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:13.531361 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836532fa-c9d9-417f-a47d-e2112406419a None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:13.547753 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:13.550535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-836532fa-c9d9-417f-a47d-e2112406419a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:13.550535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:13.550535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:13.550535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:13.550535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:13.550535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:13.550535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:13.550535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:13.550535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:13.550535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:13.550535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:13.550535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:13.550535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:13.550535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:13.550535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:13.551523 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:13.551523 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:13.551523 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:13.551523 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:13.551523 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:13.551523 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:13.551523 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:13.551523 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:13.551523 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:13.551523 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:13.551523 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:13.551523 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:13.551523 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:13.551523 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:13.551523 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:13.551523 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:13.551523 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:13.552951 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:13.552951 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:13.552951 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:13.552951 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:13.552951 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 254/505] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:13.552951 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836532fa-c9d9-417f-a47d-e2112406419a None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:13.565253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:13.622665 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334085e-47a9-4a74-beb4-960099cb6ea7 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:13.659646 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229c5d0-cb7c-49b6-be6d-56c31e586521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:13.660304 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229c5d0-cb7c-49b6-be6d-56c31e586521 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:13.660585 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229c5d0-cb7c-49b6-be6d-56c31e586521 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:13.660860 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229c5d0-cb7c-49b6-be6d-56c31e586521 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:13.661608 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d229c5d0-cb7c-49b6-be6d-56c31e586521 None admin] RBAC: Adding query filter params (name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:13.661911 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d229c5d0-cb7c-49b6-be6d-56c31e586521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:13.663356 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d229c5d0-cb7c-49b6-be6d-56c31e586521 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:13.676712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 252/506] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 21 05:41:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:13.677477 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836532fa-c9d9-417f-a47d-e2112406419a None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:13.677600 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229c5d0-cb7c-49b6-be6d-56c31e586521 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:13.714564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f956061-9044-46f0-bd22-f99500f85035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:13.715205 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f956061-9044-46f0-bd22-f99500f85035 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:13.715494 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f956061-9044-46f0-bd22-f99500f85035 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:13.715770 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f956061-9044-46f0-bd22-f99500f85035 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:13.789379 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f956061-9044-46f0-bd22-f99500f85035 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:13.790886 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f956061-9044-46f0-bd22-f99500f85035 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:13.792953 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229c5d0-cb7c-49b6-be6d-56c31e586521 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:13.795442 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:13.799904 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:13.833295 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3eb38-31c8-4b36-bc89-d41aec315852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:13.833993 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3eb38-31c8-4b36-bc89-d41aec315852 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:13.834276 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3eb38-31c8-4b36-bc89-d41aec315852 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:13.834553 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3eb38-31c8-4b36-bc89-d41aec315852 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:13.835394 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c3eb38-31c8-4b36-bc89-d41aec315852 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:13.835702 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c3eb38-31c8-4b36-bc89-d41aec315852 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:13.837147 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c3eb38-31c8-4b36-bc89-d41aec315852 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:13.874520 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 253/507] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Jun 21 05:41:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:13.875933 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3eb38-31c8-4b36-bc89-d41aec315852 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:13.906010 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 255/508] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:41:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:41:13.906868 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f956061-9044-46f0-bd22-f99500f85035 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:13.982518 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3eb38-31c8-4b36-bc89-d41aec315852 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:14.011274 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f956061-9044-46f0-bd22-f99500f85035 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:14.017114 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c89ed-2a4b-4856-98fb-5cc218c51ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:14.017907 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c89ed-2a4b-4856-98fb-5cc218c51ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:14.018223 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c89ed-2a4b-4856-98fb-5cc218c51ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:14.018504 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c89ed-2a4b-4856-98fb-5cc218c51ea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:14.019379 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:14.033194 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c89ed-2a4b-4856-98fb-5cc218c51ea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:14.034794 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c89ed-2a4b-4856-98fb-5cc218c51ea5 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:14.047240 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3ce48-82ff-4615-8518-0aa4d86146ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:14.047905 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3ce48-82ff-4615-8518-0aa4d86146ee None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:14.048192 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3ce48-82ff-4615-8518-0aa4d86146ee None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:14.048475 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3ce48-82ff-4615-8518-0aa4d86146ee None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:14.049196 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3ce48-82ff-4615-8518-0aa4d86146ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:14.049512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3ce48-82ff-4615-8518-0aa4d86146ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:14.050935 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3ce48-82ff-4615-8518-0aa4d86146ee None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:14.057860 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-6f3c89ed-2a4b-4856-98fb-5cc218c51ea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:14.057860 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:14.057860 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:14.057860 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:14.057860 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:14.057860 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:14.057860 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:14.057860 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:14.057860 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:14.057860 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:14.057860 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:14.057860 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:14.057860 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:14.057860 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:14.057860 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:14.058864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:14.058864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:14.058864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:14.058864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:14.058864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:14.058864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:14.058864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:14.058864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:14.058864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:14.058864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:14.058864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:14.058864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:14.058864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:14.058864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:14.058864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:14.058864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:14.058864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:14.059872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:14.059872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:14.059872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:14.059872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:14.059872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 254/509] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:14.060284 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c89ed-2a4b-4856-98fb-5cc218c51ea5 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:14.065703 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 256/510] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:14.066658 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3ce48-82ff-4615-8518-0aa4d86146ee None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:14.082853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:14.176108 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c89ed-2a4b-4856-98fb-5cc218c51ea5 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:14.179725 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3ce48-82ff-4615-8518-0aa4d86146ee None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:14.212103 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd727d-c389-4700-b838-de6750a7a242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:14.212895 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd727d-c389-4700-b838-de6750a7a242 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:14.213177 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd727d-c389-4700-b838-de6750a7a242 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:14.213467 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd727d-c389-4700-b838-de6750a7a242 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:14.222416 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87833b4-4cce-462d-947e-3f958a34bbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:14.223073 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87833b4-4cce-462d-947e-3f958a34bbba None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:14.223364 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87833b4-4cce-462d-947e-3f958a34bbba None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:14.223657 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87833b4-4cce-462d-947e-3f958a34bbba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:14.225733 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd727d-c389-4700-b838-de6750a7a242 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:14.227282 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd727d-c389-4700-b838-de6750a7a242 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:14.244857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-1ecd727d-c389-4700-b838-de6750a7a242 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:14.244857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:14.244857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:14.244857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:14.244857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:14.244857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:14.244857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:14.244857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:14.244857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:14.244857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:14.244857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:14.244857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:14.244857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:14.244857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:14.244857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:14.245890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:14.245890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:14.245890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:14.245890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:14.245890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:14.245890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:14.245890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:14.245890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:14.245890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:14.245890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:14.245890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:14.245890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:14.245890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:14.245890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:14.245890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:14.245890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:14.245890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:14.247178 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:14.247178 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:14.247178 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:14.247178 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:14.247178 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 255/511] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:14.247178 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd727d-c389-4700-b838-de6750a7a242 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:14.264331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:14.300341 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87833b4-4cce-462d-947e-3f958a34bbba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:14.301825 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87833b4-4cce-462d-947e-3f958a34bbba None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:14.322840 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:14.359708 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd727d-c389-4700-b838-de6750a7a242 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:14.394935 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13b77d-911d-4b83-9b7b-cab1f83e9dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:14.395731 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13b77d-911d-4b83-9b7b-cab1f83e9dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:14.396041 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13b77d-911d-4b83-9b7b-cab1f83e9dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:14.396329 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13b77d-911d-4b83-9b7b-cab1f83e9dc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:14.409566 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13b77d-911d-4b83-9b7b-cab1f83e9dc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:14.410793 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 257/512] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:41:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:41:14.411153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13b77d-911d-4b83-9b7b-cab1f83e9dc5 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:14.411808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87833b4-4cce-462d-947e-3f958a34bbba None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:14.432846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-dd13b77d-911d-4b83-9b7b-cab1f83e9dc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:14.432846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:14.432846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:14.432846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:14.432846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:14.432846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:14.432846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:14.432846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:14.432846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:14.432846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:14.432846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:14.432846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:14.432846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:14.432846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:14.432846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:14.433906 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:14.433906 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:14.433906 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:14.433906 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:14.433906 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:14.433906 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:14.433906 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:14.433906 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:14.433906 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:14.433906 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:14.433906 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:14.433906 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:14.433906 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:14.433906 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:14.433906 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:14.433906 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:14.433906 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:14.434799 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:14.434799 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:14.434799 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:14.434799 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:14.434799 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 256/513] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:14.435067 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13b77d-911d-4b83-9b7b-cab1f83e9dc5 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:14.489709 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:14.530148 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87833b4-4cce-462d-947e-3f958a34bbba None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:14.550104 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13b77d-911d-4b83-9b7b-cab1f83e9dc5 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:14.567336 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c389d4f-f06e-4107-a40f-c7f26ce13961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:14.568001 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c389d4f-f06e-4107-a40f-c7f26ce13961 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:14.568281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c389d4f-f06e-4107-a40f-c7f26ce13961 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:14.568559 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c389d4f-f06e-4107-a40f-c7f26ce13961 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:14.569282 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c389d4f-f06e-4107-a40f-c7f26ce13961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:14.569588 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c389d4f-f06e-4107-a40f-c7f26ce13961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:14.571005 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c389d4f-f06e-4107-a40f-c7f26ce13961 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:14.571109 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:14.583175 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 258/514] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:14.584012 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c389d4f-f06e-4107-a40f-c7f26ce13961 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:14.595095 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5c10d-b7b0-4e64-a488-9e5b65cd6acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:14.595883 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5c10d-b7b0-4e64-a488-9e5b65cd6acf None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:14.596175 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5c10d-b7b0-4e64-a488-9e5b65cd6acf None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:14.596440 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5c10d-b7b0-4e64-a488-9e5b65cd6acf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:14.605104 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5c10d-b7b0-4e64-a488-9e5b65cd6acf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:14.606870 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5c10d-b7b0-4e64-a488-9e5b65cd6acf None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:14.623427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-ebf5c10d-b7b0-4e64-a488-9e5b65cd6acf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 05:41:14.623427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:14.623427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:14.623427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:14.623427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:14.623427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:14.623427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:14.623427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:14.623427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:14.623427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:14.623427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:14.623427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:14.623427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:41:14.623427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:41:14.623427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:41:14.623427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:41:14.624403 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:14.624403 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:14.624403 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:41:14.624403 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:14.624403 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:41:14.624403 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:14.624403 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:14.624403 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:14.624403 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:14.624403 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:14.624403 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:14.624403 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:14.624403 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:14.624403 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:14.624403 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:14.624403 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:14.624403 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:14.624403 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:14.625923 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:14.625923 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:14.625923 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:41:14.625923 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:41:14.625923 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:41:14.625923 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:41:14.625923 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:41:14.625923 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:41:14.625923 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 05:41:14.625923 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:14.625923 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 257/515] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:41:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:14.627242 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5c10d-b7b0-4e64-a488-9e5b65cd6acf None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:14.716649 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c389d4f-f06e-4107-a40f-c7f26ce13961 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:14.729517 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5c10d-b7b0-4e64-a488-9e5b65cd6acf None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:14.746905 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:14.766314 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc465a-827c-4b23-9fe5-b012483d13f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:14.767032 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc465a-827c-4b23-9fe5-b012483d13f2 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:14.767322 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc465a-827c-4b23-9fe5-b012483d13f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:14.767589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc465a-827c-4b23-9fe5-b012483d13f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:14.768321 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc465a-827c-4b23-9fe5-b012483d13f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:14.768639 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc465a-827c-4b23-9fe5-b012483d13f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:14.770034 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc465a-827c-4b23-9fe5-b012483d13f2 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:14.774423 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bebe36-0365-4c84-ae72-edb139a86509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:14.775202 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bebe36-0365-4c84-ae72-edb139a86509 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:14.775481 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bebe36-0365-4c84-ae72-edb139a86509 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:14.775756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bebe36-0365-4c84-ae72-edb139a86509 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:14.787028 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bebe36-0365-4c84-ae72-edb139a86509 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:14.787668 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 259/516] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:14.791314 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bebe36-0365-4c84-ae72-edb139a86509 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:14.791404 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc465a-827c-4b23-9fe5-b012483d13f2 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:14.809676 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-a6bebe36-0365-4c84-ae72-edb139a86509 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:14.809676 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:14.809676 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:14.809676 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:14.809676 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:14.809676 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:14.809676 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:14.809676 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:14.809676 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:14.809676 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:14.809676 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:14.809676 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:14.809676 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:14.809676 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:14.809676 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:14.810776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:14.810776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:14.810776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:14.810776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:14.810776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:14.810776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:14.810776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:14.810776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:14.810776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:14.810776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:14.810776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:14.810776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:14.810776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:14.810776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:14.810776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:14.810776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:14.810776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:14.817429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:14.817429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:14.817429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:14.817429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:14.817429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 258/517] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:14.817429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bebe36-0365-4c84-ae72-edb139a86509 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:14.845409 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:14.912000 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc465a-827c-4b23-9fe5-b012483d13f2 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:14.927810 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bebe36-0365-4c84-ae72-edb139a86509 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:14.946313 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6496e-9a98-41e1-9288-161cfa6ed762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:14.946986 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6496e-9a98-41e1-9288-161cfa6ed762 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:14.947373 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6496e-9a98-41e1-9288-161cfa6ed762 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:14.948516 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6496e-9a98-41e1-9288-161cfa6ed762 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:14.948516 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6496e-9a98-41e1-9288-161cfa6ed762 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:14.948732 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6496e-9a98-41e1-9288-161cfa6ed762 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:14.949916 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6496e-9a98-41e1-9288-161cfa6ed762 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:14.962096 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 260/518] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:14.966247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35578df4-751a-4945-abed-283c077f6cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:14.966921 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35578df4-751a-4945-abed-283c077f6cac None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:14.967206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35578df4-751a-4945-abed-283c077f6cac None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:14.967322 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6496e-9a98-41e1-9288-161cfa6ed762 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:14.967487 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35578df4-751a-4945-abed-283c077f6cac None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:14.968204 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35578df4-751a-4945-abed-283c077f6cac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:14.970224 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35578df4-751a-4945-abed-283c077f6cac None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:14.992285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 259/519] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 21 05:41:14 2022] POST /identity/v3/users => generated 247 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:41:14.993188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35578df4-751a-4945-abed-283c077f6cac None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:15.024278 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:15.103753 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6496e-9a98-41e1-9288-161cfa6ed762 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:15.129080 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:15.151705 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35578df4-751a-4945-abed-283c077f6cac None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:15.158209 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64393325-2cdd-43b2-a5b9-dcce968af996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:15.158893 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64393325-2cdd-43b2-a5b9-dcce968af996 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:15.159182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64393325-2cdd-43b2-a5b9-dcce968af996 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:15.160764 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64393325-2cdd-43b2-a5b9-dcce968af996 None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:15.160764 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64393325-2cdd-43b2-a5b9-dcce968af996 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:15.160764 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64393325-2cdd-43b2-a5b9-dcce968af996 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:15.162877 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64393325-2cdd-43b2-a5b9-dcce968af996 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:15.183548 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 261/520] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Jun 21 05:41:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:15.184712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64393325-2cdd-43b2-a5b9-dcce968af996 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:15.198512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210dbb3-902f-4d68-9877-12db4cb5f2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:15.199471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210dbb3-902f-4d68-9877-12db4cb5f2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:15.199757 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210dbb3-902f-4d68-9877-12db4cb5f2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:15.204755 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210dbb3-902f-4d68-9877-12db4cb5f2e9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:15.214047 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210dbb3-902f-4d68-9877-12db4cb5f2e9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:15.215524 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210dbb3-902f-4d68-9877-12db4cb5f2e9 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:15.231107 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-8210dbb3-902f-4d68-9877-12db4cb5f2e9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 05:41:15.231107 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:15.231107 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:15.231107 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:15.231107 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:15.231107 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:15.231107 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:15.231107 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:15.231107 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:15.231107 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:15.231107 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:15.231107 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:15.231107 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:41:15.231107 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:41:15.231107 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:41:15.231107 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:41:15.232336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:15.232336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:15.232336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:41:15.232336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:15.232336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:41:15.232336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:15.232336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:15.232336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:15.232336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:15.232336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:15.232336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:15.232336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:15.232336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:15.232336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:15.232336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:15.232336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:15.232336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:15.232336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:15.233223 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:15.233223 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:15.233223 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:41:15.233223 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:41:15.233223 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:41:15.233223 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:41:15.233223 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:41:15.233223 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:41:15.233223 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 05:41:15.233223 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:15.233223 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 260/521] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 21 05:41:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:15.233791 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210dbb3-902f-4d68-9877-12db4cb5f2e9 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:15.327213 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64393325-2cdd-43b2-a5b9-dcce968af996 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:15.333127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:15.375590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210dbb3-902f-4d68-9877-12db4cb5f2e9 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:15.382152 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f2dba-6fdd-49c9-825c-cda47b248db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:15.382827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f2dba-6fdd-49c9-825c-cda47b248db2 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:15.383118 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f2dba-6fdd-49c9-825c-cda47b248db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:15.383398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f2dba-6fdd-49c9-825c-cda47b248db2 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:15.384127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f2dba-6fdd-49c9-825c-cda47b248db2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:15.384435 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f2dba-6fdd-49c9-825c-cda47b248db2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:15.387731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f2dba-6fdd-49c9-825c-cda47b248db2 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:15.398404 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 262/522] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:15.399256 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f2dba-6fdd-49c9-825c-cda47b248db2 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:15.422832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cee6bf-2397-4ef5-85bb-ded97b20a732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:15.423635 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cee6bf-2397-4ef5-85bb-ded97b20a732 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:15.423916 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cee6bf-2397-4ef5-85bb-ded97b20a732 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:15.424191 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cee6bf-2397-4ef5-85bb-ded97b20a732 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:15.434542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cee6bf-2397-4ef5-85bb-ded97b20a732 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:15.436044 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cee6bf-2397-4ef5-85bb-ded97b20a732 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:15.451866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-c2cee6bf-2397-4ef5-85bb-ded97b20a732 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:15.451866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:15.451866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:15.451866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:15.451866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:15.451866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:15.451866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:15.451866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:15.451866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:15.451866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:15.451866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:15.451866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:15.451866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:41:15.451866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:41:15.451866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:41:15.452945 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:41:15.452945 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:15.452945 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:15.452945 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:15.452945 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:15.452945 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:15.452945 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:15.452945 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:15.452945 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:15.452945 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:15.452945 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:15.452945 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:15.452945 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:15.452945 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:15.452945 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:15.452945 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:15.452945 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:15.454367 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:41:15.454367 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:41:15.454367 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:41:15.454367 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:41:15.454367 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:41:15.454367 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:41:15.454367 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:15.454367 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:15.454367 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 261/523] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:15.454836 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cee6bf-2397-4ef5-85bb-ded97b20a732 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:15.467076 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:15.537416 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f2dba-6fdd-49c9-825c-cda47b248db2 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:15.579165 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ceb36-c61b-4841-8c8a-df11879325f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:15.579806 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ceb36-c61b-4841-8c8a-df11879325f6 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:15.580094 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ceb36-c61b-4841-8c8a-df11879325f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:15.580374 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ceb36-c61b-4841-8c8a-df11879325f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:15.588980 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cee6bf-2397-4ef5-85bb-ded97b20a732 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:15.623715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:15.633201 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ffafe-453b-49f0-989e-46873820ea4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:15.633771 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ffafe-453b-49f0-989e-46873820ea4d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:15.634090 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ffafe-453b-49f0-989e-46873820ea4d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:15.634769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ffafe-453b-49f0-989e-46873820ea4d None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:15.635231 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ffafe-453b-49f0-989e-46873820ea4d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:15.635543 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ffafe-453b-49f0-989e-46873820ea4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:15.637495 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ffafe-453b-49f0-989e-46873820ea4d None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:15.657077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 262/524] 10.222.0.18 () {56 vars in 1139 bytes} [Tue Jun 21 05:41:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:15.657856 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ffafe-453b-49f0-989e-46873820ea4d None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:15.680763 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ceb36-c61b-4841-8c8a-df11879325f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:15.682281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ceb36-c61b-4841-8c8a-df11879325f6 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:15.754677 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:15.798769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ffafe-453b-49f0-989e-46873820ea4d None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:15.800750 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 263/525] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:41:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:41:15.803893 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ceb36-c61b-4841-8c8a-df11879325f6 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:15.854455 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded850b-07b0-4c17-a717-6cc31fa8feb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:15.855255 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded850b-07b0-4c17-a717-6cc31fa8feb0 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:15.855524 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded850b-07b0-4c17-a717-6cc31fa8feb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:15.855802 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded850b-07b0-4c17-a717-6cc31fa8feb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:15.863666 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded850b-07b0-4c17-a717-6cc31fa8feb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:15.865132 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded850b-07b0-4c17-a717-6cc31fa8feb0 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:15.879823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-3ded850b-07b0-4c17-a717-6cc31fa8feb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:15.879823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:15.879823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:15.879823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:15.879823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:15.879823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:15.879823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:15.879823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:15.879823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:15.879823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:15.879823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:15.879823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:15.879823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:41:15.879823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:41:15.879823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:41:15.880756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:41:15.880756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:15.880756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:15.880756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:15.880756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:15.880756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:15.880756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:15.880756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:15.880756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:15.880756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:15.880756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:15.880756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:15.880756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:15.880756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:15.880756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:15.880756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:15.880756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:15.881593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:41:15.881593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:41:15.881593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:41:15.881593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:41:15.881593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:41:15.881593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:41:15.881593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:15.881593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:15.881593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 263/526] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:15.882662 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded850b-07b0-4c17-a717-6cc31fa8feb0 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:15.898570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:15.953223 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ceb36-c61b-4841-8c8a-df11879325f6 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:15.995680 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308cde7e-360e-4717-95a5-0dc7c80923cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:15.996359 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308cde7e-360e-4717-95a5-0dc7c80923cb None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:15.996648 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308cde7e-360e-4717-95a5-0dc7c80923cb None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:15.996934 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308cde7e-360e-4717-95a5-0dc7c80923cb None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:15.997737 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308cde7e-360e-4717-95a5-0dc7c80923cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:15.998087 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308cde7e-360e-4717-95a5-0dc7c80923cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:15.999544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308cde7e-360e-4717-95a5-0dc7c80923cb None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:16.007627 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded850b-07b0-4c17-a717-6cc31fa8feb0 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:16.022634 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 264/527] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:41:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:16.023495 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308cde7e-360e-4717-95a5-0dc7c80923cb None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:16.038154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:16.058335 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4dceb9-a74d-4b14-8dc7-4a0bd2eee05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:16.058992 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dceb9-a74d-4b14-8dc7-4a0bd2eee05d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:16.060667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dceb9-a74d-4b14-8dc7-4a0bd2eee05d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:16.060952 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dceb9-a74d-4b14-8dc7-4a0bd2eee05d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:16.151871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4dceb9-a74d-4b14-8dc7-4a0bd2eee05d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:16.153278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4dceb9-a74d-4b14-8dc7-4a0bd2eee05d None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:16.158648 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308cde7e-360e-4717-95a5-0dc7c80923cb None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:16.191503 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:16.207686 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73036633-f496-4431-ad66-9f794282d6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:16.208505 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73036633-f496-4431-ad66-9f794282d6be None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:16.208813 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73036633-f496-4431-ad66-9f794282d6be None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:16.209109 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73036633-f496-4431-ad66-9f794282d6be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:16.224612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73036633-f496-4431-ad66-9f794282d6be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:16.226298 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73036633-f496-4431-ad66-9f794282d6be None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:16.245436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-73036633-f496-4431-ad66-9f794282d6be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:16.245436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:16.245436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:16.245436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:16.245436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:16.245436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:16.245436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:16.245436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:16.245436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:16.245436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:16.245436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:16.245436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:16.245436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:16.245436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:16.245436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:16.246609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:16.246609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:16.246609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:16.246609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:16.246609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:16.246609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:16.246609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:16.246609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:16.246609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:16.246609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:16.246609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:16.246609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:16.246609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:16.246609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:16.246609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:16.246609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:16.246609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:16.249079 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:16.249079 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:16.249079 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:16.249079 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:16.249079 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 265/528] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:16.249079 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73036633-f496-4431-ad66-9f794282d6be None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:16.288336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 264/529] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:41:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:41:16.288336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4dceb9-a74d-4b14-8dc7-4a0bd2eee05d None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:16.318580 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:16.385419 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73036633-f496-4431-ad66-9f794282d6be None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:16.403638 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4dceb9-a74d-4b14-8dc7-4a0bd2eee05d None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:16.435262 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868a627-a6f7-4454-b55d-f8cf4a3be39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:16.435934 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868a627-a6f7-4454-b55d-f8cf4a3be39d None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:16.436224 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868a627-a6f7-4454-b55d-f8cf4a3be39d None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:16.436515 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868a627-a6f7-4454-b55d-f8cf4a3be39d None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:16.437298 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868a627-a6f7-4454-b55d-f8cf4a3be39d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:16.437891 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868a627-a6f7-4454-b55d-f8cf4a3be39d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:16.439144 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868a627-a6f7-4454-b55d-f8cf4a3be39d None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:16.443443 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965a887-2a11-49c3-bcb1-bdc2c635483c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:16.444097 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965a887-2a11-49c3-bcb1-bdc2c635483c None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:16.444381 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965a887-2a11-49c3-bcb1-bdc2c635483c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:16.444656 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965a887-2a11-49c3-bcb1-bdc2c635483c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:16.445597 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8965a887-2a11-49c3-bcb1-bdc2c635483c None admin] RBAC: Adding query filter params (role.id=b2f95849039f475c904876eb2958a375, scope.project.id=e64b932ef6bf481cb93a04885a93b4b2, user.id=f702830987ba4548a4c2ee3d0e302d02) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:16.445913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8965a887-2a11-49c3-bcb1-bdc2c635483c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:16.447722 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8965a887-2a11-49c3-bcb1-bdc2c635483c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:16.452011 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 266/530] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:41:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:16.453790 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868a627-a6f7-4454-b55d-f8cf4a3be39d None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:16.466112 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 265/531] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:41:16 2022] GET /identity/v3/role_assignments?user.id=f702830987ba4548a4c2ee3d0e302d02&scope.project.id=e64b932ef6bf481cb93a04885a93b4b2&role.id=b2f95849039f475c904876eb2958a375 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:16.466112 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965a887-2a11-49c3-bcb1-bdc2c635483c None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:16.510196 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:16.606913 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868a627-a6f7-4454-b55d-f8cf4a3be39d None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:16.621076 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:16.638124 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965a887-2a11-49c3-bcb1-bdc2c635483c None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:16.660234 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf15a1-3415-4a6f-b849-5fce19b50d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:16.660829 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf15a1-3415-4a6f-b849-5fce19b50d97 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:16.661110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf15a1-3415-4a6f-b849-5fce19b50d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:16.661382 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf15a1-3415-4a6f-b849-5fce19b50d97 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:16.662270 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf15a1-3415-4a6f-b849-5fce19b50d97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:16.662447 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf15a1-3415-4a6f-b849-5fce19b50d97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:16.663939 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf15a1-3415-4a6f-b849-5fce19b50d97 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:16.679905 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 267/532] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:16.680915 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf15a1-3415-4a6f-b849-5fce19b50d97 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:16.688163 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfc926-125e-4e8b-91e0-179903e5e145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:16.689304 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfc926-125e-4e8b-91e0-179903e5e145 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:16.689810 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfc926-125e-4e8b-91e0-179903e5e145 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:16.690311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfc926-125e-4e8b-91e0-179903e5e145 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:16.704745 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dfc926-125e-4e8b-91e0-179903e5e145 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:16.707681 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dfc926-125e-4e8b-91e0-179903e5e145 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:16.736909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-b1dfc926-125e-4e8b-91e0-179903e5e145 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:16.736909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:16.736909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:16.736909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:16.736909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:16.736909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:16.736909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:16.736909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:16.736909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:16.736909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:16.736909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:16.736909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:16.736909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:16.736909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:16.736909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:16.738148 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:16.738148 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:16.738148 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:16.738148 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:16.738148 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:16.738148 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:16.738148 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:16.738148 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:16.738148 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:16.738148 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:16.738148 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:16.738148 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:16.738148 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:16.738148 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:16.738148 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:16.738148 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:16.738148 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:16.744380 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:16.744380 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:16.744380 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:16.744380 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:16.744380 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 266/533] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:16.744380 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfc926-125e-4e8b-91e0-179903e5e145 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:16.834121 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:16.848255 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf15a1-3415-4a6f-b849-5fce19b50d97 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:16.877705 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfc926-125e-4e8b-91e0-179903e5e145 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:16.903455 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65a1b3-473b-45e7-969a-ed291a5524ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:16.904746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65a1b3-473b-45e7-969a-ed291a5524ab None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:16.905648 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65a1b3-473b-45e7-969a-ed291a5524ab None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:16.906983 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65a1b3-473b-45e7-969a-ed291a5524ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:16.908471 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b65a1b3-473b-45e7-969a-ed291a5524ab None admin] RBAC: Adding query filter params (role.id=b2f95849039f475c904876eb2958a375, scope.project.id=e64b932ef6bf481cb93a04885a93b4b2, user.id=d44776834b134ae98fa28d4741cc4ec3) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:16.909582 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b65a1b3-473b-45e7-969a-ed291a5524ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:16.911838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b65a1b3-473b-45e7-969a-ed291a5524ab None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:16.918263 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693f098-8062-4f7b-9bae-3024966b55b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:16.919145 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693f098-8062-4f7b-9bae-3024966b55b2 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:16.919496 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693f098-8062-4f7b-9bae-3024966b55b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:16.919842 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693f098-8062-4f7b-9bae-3024966b55b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:16.920614 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 268/534] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:41:16 2022] GET /identity/v3/role_assignments?user.id=d44776834b134ae98fa28d4741cc4ec3&scope.project.id=e64b932ef6bf481cb93a04885a93b4b2&role.id=b2f95849039f475c904876eb2958a375 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:16.921729 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65a1b3-473b-45e7-969a-ed291a5524ab None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:16.939326 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693f098-8062-4f7b-9bae-3024966b55b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:16.941032 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693f098-8062-4f7b-9bae-3024966b55b2 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:16.947578 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:16.966239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-4693f098-8062-4f7b-9bae-3024966b55b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:16.966239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:16.966239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:16.966239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:16.966239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:16.966239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:16.966239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:16.966239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:16.966239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:16.966239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:16.966239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:16.966239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:16.966239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:41:16.966239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:41:16.966239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:41:16.967159 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:41:16.967159 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:16.967159 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:16.967159 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:16.967159 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:16.967159 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:16.967159 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:16.967159 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:16.967159 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:16.967159 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:16.967159 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:16.967159 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:16.967159 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:16.967159 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:16.967159 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:16.967159 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:16.967159 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:16.968237 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:41:16.968237 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:41:16.968237 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:41:16.968237 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:41:16.968237 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:41:16.968237 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:41:16.968237 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:16.968237 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:16.968237 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 267/535] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:16.979071 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693f098-8062-4f7b-9bae-3024966b55b2 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:17.147953 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65a1b3-473b-45e7-969a-ed291a5524ab None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:17.150300 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693f098-8062-4f7b-9bae-3024966b55b2 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:17.208628 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50e0bb-9d00-490d-9ead-6a6e4057ee98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:17.209526 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50e0bb-9d00-490d-9ead-6a6e4057ee98 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:17.209985 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50e0bb-9d00-490d-9ead-6a6e4057ee98 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:17.210429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50e0bb-9d00-490d-9ead-6a6e4057ee98 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:17.211307 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c50e0bb-9d00-490d-9ead-6a6e4057ee98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:17.211764 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c50e0bb-9d00-490d-9ead-6a6e4057ee98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:17.213096 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b04d71-f5e6-4108-9343-452dcc439996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:17.213468 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c50e0bb-9d00-490d-9ead-6a6e4057ee98 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:17.213892 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b04d71-f5e6-4108-9343-452dcc439996 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:17.214332 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b04d71-f5e6-4108-9343-452dcc439996 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:17.214683 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b04d71-f5e6-4108-9343-452dcc439996 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:17.215798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b04d71-f5e6-4108-9343-452dcc439996 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:17.216118 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b04d71-f5e6-4108-9343-452dcc439996 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:17.217861 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b04d71-f5e6-4108-9343-452dcc439996 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:17.233137 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 269/536] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:17.234982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ae6b4-ef52-4237-bada-98bae4f2fc86 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:17.235424 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ae6b4-ef52-4237-bada-98bae4f2fc86 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:17.235845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ae6b4-ef52-4237-bada-98bae4f2fc86 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:17.237885 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 270/537] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:17.242820 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 268/538] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:41:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:17.243427 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3087d0-08b5-4f27-8539-57b7a5d38486 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:17.243762 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b04d71-f5e6-4108-9343-452dcc439996 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:17.244002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3087d0-08b5-4f27-8539-57b7a5d38486 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:17.244447 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3087d0-08b5-4f27-8539-57b7a5d38486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:17.263381 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-4c3087d0-08b5-4f27-8539-57b7a5d38486 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:17.265050 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4c3087d0-08b5-4f27-8539-57b7a5d38486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:17.284549 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:17.312969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:17.360765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b04d71-f5e6-4108-9343-452dcc439996 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:17.378360 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 271/539] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:41:17.380595 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3087d0-08b5-4f27-8539-57b7a5d38486 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:17.423645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6cf2d-847a-4727-b840-75cf87a6ccd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:17.424701 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6cf2d-847a-4727-b840-75cf87a6ccd3 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:17.424825 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6cf2d-847a-4727-b840-75cf87a6ccd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:17.425084 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6cf2d-847a-4727-b840-75cf87a6ccd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:17.432786 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6cf2d-847a-4727-b840-75cf87a6ccd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:17.434293 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6cf2d-847a-4727-b840-75cf87a6ccd3 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:17.450530 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-0cc6cf2d-847a-4727-b840-75cf87a6ccd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:17.450530 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:17.450530 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:17.450530 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:17.450530 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:17.450530 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:17.450530 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:17.450530 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:17.450530 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:17.450530 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:17.450530 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:17.450530 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:17.450530 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:41:17.450530 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:41:17.450530 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:41:17.452289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:41:17.452289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:17.452289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:17.452289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:17.452289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:17.452289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:17.452289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:17.452289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:17.452289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:17.452289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:17.452289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:17.452289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:17.452289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:17.452289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:17.452289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:17.452289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:17.452289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:17.454447 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:41:17.454447 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:41:17.454447 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:41:17.454447 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:41:17.454447 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:41:17.454447 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:41:17.454447 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:17.454447 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:17.454447 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 269/540] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:17.454447 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6cf2d-847a-4727-b840-75cf87a6ccd3 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:17.541583 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3087d0-08b5-4f27-8539-57b7a5d38486 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:17.587906 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0e8c8-46ff-4753-affe-16d0e070fc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:17.589012 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0e8c8-46ff-4753-affe-16d0e070fc6e None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:17.589501 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0e8c8-46ff-4753-affe-16d0e070fc6e None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:17.590078 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0e8c8-46ff-4753-affe-16d0e070fc6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:17.591672 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0e8c8-46ff-4753-affe-16d0e070fc6e None admin] RBAC: Adding query filter params (role.id=b2f95849039f475c904876eb2958a375, scope.project.id=e64b932ef6bf481cb93a04885a93b4b2, user.id=5c13a614e6b04b3a93247e3790f96240) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:17.591951 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0e8c8-46ff-4753-affe-16d0e070fc6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:17.594868 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0e8c8-46ff-4753-affe-16d0e070fc6e None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:17.599844 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6cf2d-847a-4727-b840-75cf87a6ccd3 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:17.601375 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 272/541] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:41:17 2022] GET /identity/v3/role_assignments?user.id=5c13a614e6b04b3a93247e3790f96240&scope.project.id=e64b932ef6bf481cb93a04885a93b4b2&role.id=b2f95849039f475c904876eb2958a375 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:17.602350 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0e8c8-46ff-4753-affe-16d0e070fc6e None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:17.619823 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:17.631636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:17.653562 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecc36f-a571-4cec-9849-957aa6a3722d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:17.654677 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecc36f-a571-4cec-9849-957aa6a3722d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:17.655102 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecc36f-a571-4cec-9849-957aa6a3722d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:17.655549 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecc36f-a571-4cec-9849-957aa6a3722d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:17.673224 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecc36f-a571-4cec-9849-957aa6a3722d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:17.688045 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-81ecc36f-a571-4cec-9849-957aa6a3722d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:17.688045 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:17.688045 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:17.688045 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:17.688045 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:17.688045 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:17.688045 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:17.688045 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:17.688045 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:17.688045 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:17.688045 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:17.688045 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:17.688045 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:17.688045 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:17.688045 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:17.688045 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:17.689030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:17.689030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:17.689030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:17.689030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:17.689030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:17.689030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:17.689030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:17.689030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:17.689030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:17.689030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:17.689030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:17.689030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:17.689030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:17.689030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:17.689030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:17.689030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:17.689821 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:17.689821 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:17.689821 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:17.689821 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:17.689821 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:17.689821 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:17.689821 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:17.689821 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:17.689821 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:17.689821 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:17.689821 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:17.689821 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:17.691320 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 270/542] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 21 05:41:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:17.698285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecc36f-a571-4cec-9849-957aa6a3722d None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:17.810957 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0e8c8-46ff-4753-affe-16d0e070fc6e None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:17.857806 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecc36f-a571-4cec-9849-957aa6a3722d None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:17.862146 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fb4d3-06c8-425f-9d3c-3060a931f4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:17.863133 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fb4d3-06c8-425f-9d3c-3060a931f4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:17.863646 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fb4d3-06c8-425f-9d3c-3060a931f4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:17.864123 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fb4d3-06c8-425f-9d3c-3060a931f4f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:17.865138 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fb4d3-06c8-425f-9d3c-3060a931f4f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:17.865667 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fb4d3-06c8-425f-9d3c-3060a931f4f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:17.867997 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fb4d3-06c8-425f-9d3c-3060a931f4f8 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:17.888462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 273/543] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:41:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:17.890163 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fb4d3-06c8-425f-9d3c-3060a931f4f8 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:17.960808 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdb641-9a12-45ed-beb0-59d286110c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:17.961831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdb641-9a12-45ed-beb0-59d286110c70 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:17.963211 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdb641-9a12-45ed-beb0-59d286110c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:17.963728 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdb641-9a12-45ed-beb0-59d286110c70 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:17.966002 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdb641-9a12-45ed-beb0-59d286110c70 None admin] RBAC: Adding query filter params (name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:17.967830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdb641-9a12-45ed-beb0-59d286110c70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:17.969490 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdb641-9a12-45ed-beb0-59d286110c70 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:17.992233 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 271/544] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 21 05:41:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:17.993903 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdb641-9a12-45ed-beb0-59d286110c70 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:18.005071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:18.035680 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fb4d3-06c8-425f-9d3c-3060a931f4f8 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:18.075915 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed73f5-d4ba-4ac5-be57-8cd5571dc552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:18.076914 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed73f5-d4ba-4ac5-be57-8cd5571dc552 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:18.077419 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed73f5-d4ba-4ac5-be57-8cd5571dc552 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:18.077891 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed73f5-d4ba-4ac5-be57-8cd5571dc552 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:18.080074 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed73f5-d4ba-4ac5-be57-8cd5571dc552 None admin] RBAC: Adding query filter params (role.id=b2f95849039f475c904876eb2958a375, scope.project.id=e64b932ef6bf481cb93a04885a93b4b2, user.id=51e845d0dc2c4a1fa612556c1aa73ed5) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:18.080842 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed73f5-d4ba-4ac5-be57-8cd5571dc552 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:18.083064 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed73f5-d4ba-4ac5-be57-8cd5571dc552 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:18.095206 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 274/545] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:41:17 2022] GET /identity/v3/role_assignments?user.id=51e845d0dc2c4a1fa612556c1aa73ed5&scope.project.id=e64b932ef6bf481cb93a04885a93b4b2&role.id=b2f95849039f475c904876eb2958a375 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:41:18.106667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:18.217613 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdb641-9a12-45ed-beb0-59d286110c70 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:18.275976 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ece51-7bed-4445-8686-9dd6b14e0d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:18.276810 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ece51-7bed-4445-8686-9dd6b14e0d3c None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:18.278476 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ece51-7bed-4445-8686-9dd6b14e0d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:18.278476 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ece51-7bed-4445-8686-9dd6b14e0d3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:18.292526 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ece51-7bed-4445-8686-9dd6b14e0d3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:18.294136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ece51-7bed-4445-8686-9dd6b14e0d3c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:18.314078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-3c8ece51-7bed-4445-8686-9dd6b14e0d3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:18.314078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:18.314078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:18.314078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:18.314078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:18.314078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:18.314078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:18.314078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:18.314078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:18.314078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:18.314078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:18.314078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:18.314078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:18.314078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:18.314078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:18.314993 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:18.314993 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:18.314993 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:18.314993 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:18.314993 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:18.314993 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:18.314993 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:18.314993 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:18.314993 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:18.314993 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:18.314993 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:18.314993 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:18.314993 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:18.314993 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:18.314993 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:18.314993 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:18.314993 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:18.316276 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:18.316276 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:18.316276 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:18.316276 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:18.316276 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 272/546] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:18.321542 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed73f5-d4ba-4ac5-be57-8cd5571dc552 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:18.453314 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed73f5-d4ba-4ac5-be57-8cd5571dc552 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:18.490236 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb5e24-3513-4a2d-a453-7d66c2f5baaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:18.491307 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb5e24-3513-4a2d-a453-7d66c2f5baaf None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:18.491793 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb5e24-3513-4a2d-a453-7d66c2f5baaf None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:18.492271 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb5e24-3513-4a2d-a453-7d66c2f5baaf None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:18.493224 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb5e24-3513-4a2d-a453-7d66c2f5baaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:18.493759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb5e24-3513-4a2d-a453-7d66c2f5baaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:18.495350 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb5e24-3513-4a2d-a453-7d66c2f5baaf None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:18.506332 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:18.510233 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 275/547] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:18.517969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ece51-7bed-4445-8686-9dd6b14e0d3c None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:18.708160 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:18.717993 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ece51-7bed-4445-8686-9dd6b14e0d3c None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:18.789462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e32f15-49a1-4408-9cc0-9a1e2e53bdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:18.790296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e32f15-49a1-4408-9cc0-9a1e2e53bdd3 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:18.790582 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e32f15-49a1-4408-9cc0-9a1e2e53bdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:18.790857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e32f15-49a1-4408-9cc0-9a1e2e53bdd3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:18.803451 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e32f15-49a1-4408-9cc0-9a1e2e53bdd3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:18.805832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e32f15-49a1-4408-9cc0-9a1e2e53bdd3 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:18.828774 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-21e32f15-49a1-4408-9cc0-9a1e2e53bdd3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 05:41:18.828774 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:18.828774 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:18.828774 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:18.828774 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:18.828774 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:18.828774 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:18.828774 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:18.828774 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:18.828774 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:18.828774 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:18.828774 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:18.828774 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:41:18.828774 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:41:18.828774 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:41:18.828774 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:41:18.829743 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:18.829743 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:18.829743 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:41:18.829743 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:18.829743 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:41:18.829743 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:18.829743 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:18.829743 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:18.829743 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:18.829743 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:18.829743 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:18.829743 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:18.829743 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:18.829743 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:18.829743 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:18.829743 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:18.829743 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:18.829743 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:18.831876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:18.831876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:18.831876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:41:18.831876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:41:18.831876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:41:18.831876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:41:18.831876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:41:18.831876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:41:18.831876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 05:41:18.831876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:18.831876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 273/548] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:41:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:41:18.836201 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb5e24-3513-4a2d-a453-7d66c2f5baaf None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:18.846014 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84404d9e-8fe5-476d-80b8-91eab5d96a10 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:18.846014 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84404d9e-8fe5-476d-80b8-91eab5d96a10 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:18.846014 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84404d9e-8fe5-476d-80b8-91eab5d96a10 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:18.846698 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 274/549] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 05:41:18.853968 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c7b56-aad8-454f-803c-5667a2be5b67 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:18.853968 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c7b56-aad8-454f-803c-5667a2be5b67 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:18.853968 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c7b56-aad8-454f-803c-5667a2be5b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:18.889971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-f20c7b56-aad8-454f-803c-5667a2be5b67 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:18.891278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f20c7b56-aad8-454f-803c-5667a2be5b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:18.964555 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 275/550] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 05:41:18.988865 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c7b56-aad8-454f-803c-5667a2be5b67 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:19.004051 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb5e24-3513-4a2d-a453-7d66c2f5baaf None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:19.065073 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd73df7-6d5b-4a50-8e6b-1587ac656700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:19.067282 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd73df7-6d5b-4a50-8e6b-1587ac656700 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:19.067572 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd73df7-6d5b-4a50-8e6b-1587ac656700 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:19.067859 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd73df7-6d5b-4a50-8e6b-1587ac656700 None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:19.068736 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd73df7-6d5b-4a50-8e6b-1587ac656700 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:19.069054 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd73df7-6d5b-4a50-8e6b-1587ac656700 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:19.070566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd73df7-6d5b-4a50-8e6b-1587ac656700 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:19.125976 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 276/551] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Jun 21 05:41:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:19.127005 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd73df7-6d5b-4a50-8e6b-1587ac656700 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:19.192358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:19.226399 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c7b56-aad8-454f-803c-5667a2be5b67 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:19.248224 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:19.296035 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3b1a3-e1b7-4295-aeb9-172aec22ea12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:19.296990 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3b1a3-e1b7-4295-aeb9-172aec22ea12 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:19.297510 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3b1a3-e1b7-4295-aeb9-172aec22ea12 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:19.297793 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3b1a3-e1b7-4295-aeb9-172aec22ea12 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:19.319652 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3b1a3-e1b7-4295-aeb9-172aec22ea12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:19.327471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-a8b3b1a3-e1b7-4295-aeb9-172aec22ea12 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:19.327471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:19.327471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:19.327471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:19.327471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:19.327471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:19.327471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:19.327471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:19.327471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:19.327471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:19.327471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:19.327471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:19.327471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:19.327471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:19.327471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:19.327471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:19.329042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:19.329042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:19.329042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:19.329042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:19.329042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:19.329042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:19.329042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:19.329042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:19.329042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:19.329042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:19.329042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:19.329042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:19.329042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:19.329042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:19.329042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:19.329042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:19.329995 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:19.329995 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:19.329995 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:19.329995 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:19.329995 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:19.329995 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:19.329995 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:19.329995 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:19.329995 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:19.329995 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:19.329995 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:19.329995 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:19.329995 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 276/552] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 21 05:41:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:19.346220 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3b1a3-e1b7-4295-aeb9-172aec22ea12 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:19.346583 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd73df7-6d5b-4a50-8e6b-1587ac656700 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:19.434950 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05414cdf-906b-4534-a8d8-dfcf771d253a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:19.435929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05414cdf-906b-4534-a8d8-dfcf771d253a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:19.436399 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05414cdf-906b-4534-a8d8-dfcf771d253a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:19.436747 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05414cdf-906b-4534-a8d8-dfcf771d253a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:19.489048 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3b1a3-e1b7-4295-aeb9-172aec22ea12 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:19.529441 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d695cc3-25aa-4884-832c-0a7311bad55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:19.530549 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d695cc3-25aa-4884-832c-0a7311bad55d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:19.531141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d695cc3-25aa-4884-832c-0a7311bad55d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:19.531930 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d695cc3-25aa-4884-832c-0a7311bad55d None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:19.532898 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d695cc3-25aa-4884-832c-0a7311bad55d None admin] RBAC: Adding query filter params (name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:19.533414 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d695cc3-25aa-4884-832c-0a7311bad55d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:19.535070 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d695cc3-25aa-4884-832c-0a7311bad55d None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:19.545226 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 277/553] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 21 05:41:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:19.551528 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d695cc3-25aa-4884-832c-0a7311bad55d None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:19.562069 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:19.602108 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05414cdf-906b-4534-a8d8-dfcf771d253a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:19.603697 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05414cdf-906b-4534-a8d8-dfcf771d253a None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:19.682339 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:19.693259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d695cc3-25aa-4884-832c-0a7311bad55d None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:19.737477 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6436165-e10b-4fbc-b7aa-6272535baefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:19.738960 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6436165-e10b-4fbc-b7aa-6272535baefd None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:19.739471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6436165-e10b-4fbc-b7aa-6272535baefd None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:19.739759 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6436165-e10b-4fbc-b7aa-6272535baefd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:19.744045 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 277/554] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:41:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:41:19.745698 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43446e-32df-45cd-83c7-edefd2efff53 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:19.746188 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43446e-32df-45cd-83c7-edefd2efff53 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:19.746639 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43446e-32df-45cd-83c7-edefd2efff53 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:19.749238 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 278/555] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:19.750786 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43446e-32df-45cd-83c7-edefd2efff53 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:19.758728 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6436165-e10b-4fbc-b7aa-6272535baefd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:19.760558 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6436165-e10b-4fbc-b7aa-6272535baefd None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:19.782991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-f6436165-e10b-4fbc-b7aa-6272535baefd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:19.782991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:19.782991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:19.782991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:19.782991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:19.782991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:19.782991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:19.782991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:19.782991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:19.782991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:19.782991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:19.782991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:19.782991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:19.782991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:19.782991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:19.783921 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:19.783921 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:19.783921 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:19.783921 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:19.783921 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:19.783921 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:19.783921 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:19.783921 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:19.783921 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:19.783921 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:19.783921 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:19.783921 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:19.783921 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:19.783921 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:19.783921 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:19.783921 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:19.783921 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:19.784792 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:19.784792 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:19.784792 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:19.784792 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:19.784792 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 278/556] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:19.786745 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70213c5-2186-4e96-a9fd-1f21f7f3c420 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:19.786745 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70213c5-2186-4e96-a9fd-1f21f7f3c420 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:19.787022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70213c5-2186-4e96-a9fd-1f21f7f3c420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:19.805003 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-b70213c5-2186-4e96-a9fd-1f21f7f3c420 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:19.806271 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b70213c5-2186-4e96-a9fd-1f21f7f3c420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:19.868751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:19.886239 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43446e-32df-45cd-83c7-edefd2efff53 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:19.890178 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 279/557] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:41:19.893065 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70213c5-2186-4e96-a9fd-1f21f7f3c420 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:19.950274 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb501cdc-c09f-428f-9d7d-d8e0a13324ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:19.951242 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb501cdc-c09f-428f-9d7d-d8e0a13324ce None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:19.951627 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb501cdc-c09f-428f-9d7d-d8e0a13324ce None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:19.952042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb501cdc-c09f-428f-9d7d-d8e0a13324ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:19.965239 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb501cdc-c09f-428f-9d7d-d8e0a13324ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:19.966847 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb501cdc-c09f-428f-9d7d-d8e0a13324ce None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:19.986921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-fb501cdc-c09f-428f-9d7d-d8e0a13324ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:19.986921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:19.986921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:19.986921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:19.986921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:19.986921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:19.986921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:19.986921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:19.986921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:19.986921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:19.986921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:19.986921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:19.986921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:19.986921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:19.986921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:19.988549 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:19.988549 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:19.988549 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:19.988549 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:19.988549 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:19.988549 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:19.988549 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:19.988549 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:19.988549 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:19.988549 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:19.988549 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:19.988549 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:19.988549 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:19.988549 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:19.988549 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:19.988549 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:19.988549 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:19.989734 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:19.989734 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:19.989734 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:19.989734 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:19.990666 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 279/558] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:19.991746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb501cdc-c09f-428f-9d7d-d8e0a13324ce None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:20.007026 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:20.026747 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70213c5-2186-4e96-a9fd-1f21f7f3c420 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:20.068375 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c20e4a-977b-4738-9665-fd1024538b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:20.069520 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c20e4a-977b-4738-9665-fd1024538b88 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:20.069664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c20e4a-977b-4738-9665-fd1024538b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:20.070048 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c20e4a-977b-4738-9665-fd1024538b88 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:20.070885 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c20e4a-977b-4738-9665-fd1024538b88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:20.071289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c20e4a-977b-4738-9665-fd1024538b88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:20.072871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c20e4a-977b-4738-9665-fd1024538b88 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:20.085831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 280/559] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:20.086715 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c20e4a-977b-4738-9665-fd1024538b88 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:20.124711 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb501cdc-c09f-428f-9d7d-d8e0a13324ce None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:20.153365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:20.164811 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f783b-482e-4c9a-81d0-fa93b02ce7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:20.165738 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f783b-482e-4c9a-81d0-fa93b02ce7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:20.166079 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f783b-482e-4c9a-81d0-fa93b02ce7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:20.166363 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f783b-482e-4c9a-81d0-fa93b02ce7e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:20.178036 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f783b-482e-4c9a-81d0-fa93b02ce7e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:20.186237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-794f783b-482e-4c9a-81d0-fa93b02ce7e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:20.186237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:20.186237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:20.186237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:20.186237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:20.186237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:20.186237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:20.186237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:20.186237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:20.186237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:20.186237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:20.186237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:20.186237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:20.186237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:20.186237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:20.186237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:20.187388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:20.187388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:20.187388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:20.187388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:20.187388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:20.187388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:20.187388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:20.187388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:20.187388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:20.187388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:20.187388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:20.187388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:20.187388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:20.187388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:20.187388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:20.187388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:20.188237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:20.188237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:20.188237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:20.188237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:20.188237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:20.188237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:20.188237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:20.188237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:20.188237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:20.188237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:20.188237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:20.188237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:20.188237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 280/560] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 21 05:41:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:20.190154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eaabf9-9f10-4698-a316-67d87d777c2d None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:20.190154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eaabf9-9f10-4698-a316-67d87d777c2d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:20.190154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eaabf9-9f10-4698-a316-67d87d777c2d None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:20.190924 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 281/561] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:20.195707 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eaabf9-9f10-4698-a316-67d87d777c2d None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:20.223334 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c20e4a-977b-4738-9665-fd1024538b88 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:20.264039 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856dea97-7e87-450b-b066-98ef41355d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:20.264369 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856dea97-7e87-450b-b066-98ef41355d68 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:20.264608 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856dea97-7e87-450b-b066-98ef41355d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:20.264892 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856dea97-7e87-450b-b066-98ef41355d68 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:20.265689 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856dea97-7e87-450b-b066-98ef41355d68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:20.266023 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856dea97-7e87-450b-b066-98ef41355d68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:20.267440 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856dea97-7e87-450b-b066-98ef41355d68 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:20.276608 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:20.280993 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 281/562] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:20.284735 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856dea97-7e87-450b-b066-98ef41355d68 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:20.334053 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eaabf9-9f10-4698-a316-67d87d777c2d None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:20.372625 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e00184-9a0d-46a1-abf1-7c554ef90755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:20.373414 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e00184-9a0d-46a1-abf1-7c554ef90755 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:20.373694 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e00184-9a0d-46a1-abf1-7c554ef90755 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:20.373990 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e00184-9a0d-46a1-abf1-7c554ef90755 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:20.382486 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e00184-9a0d-46a1-abf1-7c554ef90755 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:20.383951 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e00184-9a0d-46a1-abf1-7c554ef90755 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:20.398929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-a1e00184-9a0d-46a1-abf1-7c554ef90755 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 05:41:20.398929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:20.398929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:20.398929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:20.398929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:20.398929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:20.398929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:20.398929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:20.398929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:20.398929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:20.398929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:20.398929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:20.398929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:41:20.398929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:41:20.398929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:41:20.398929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:41:20.399925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:20.399925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:20.399925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:41:20.399925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:20.399925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:41:20.399925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:20.399925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:20.399925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:20.399925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:20.399925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:20.399925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:20.399925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:20.399925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:20.399925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:20.399925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:20.399925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:20.399925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:20.399925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:20.400861 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:20.400861 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:20.400861 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:41:20.400861 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:41:20.400861 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:41:20.400861 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:41:20.400861 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:41:20.400861 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:41:20.400861 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 05:41:20.400861 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:20.401399 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856dea97-7e87-450b-b066-98ef41355d68 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:20.404885 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 282/563] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jun 21 05:41:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:20.406618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a41ab6-e1ec-4188-b24e-adb2b6ed8ed4 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:20.407071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a41ab6-e1ec-4188-b24e-adb2b6ed8ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:20.407376 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a41ab6-e1ec-4188-b24e-adb2b6ed8ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:20.411927 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:20.427958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-b8a41ab6-e1ec-4188-b24e-adb2b6ed8ed4 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:20.429181 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b8a41ab6-e1ec-4188-b24e-adb2b6ed8ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:20.444371 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f4489-d83d-4b53-bbbe-67d84d9e0a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:20.445049 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f4489-d83d-4b53-bbbe-67d84d9e0a14 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:20.445329 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f4489-d83d-4b53-bbbe-67d84d9e0a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:20.445607 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f4489-d83d-4b53-bbbe-67d84d9e0a14 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:20.446382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f4489-d83d-4b53-bbbe-67d84d9e0a14 None admin] RBAC: Adding query filter params (name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:20.446690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f4489-d83d-4b53-bbbe-67d84d9e0a14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:20.448059 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f4489-d83d-4b53-bbbe-67d84d9e0a14 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:20.460764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 282/564] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 21 05:41:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:20.460764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f4489-d83d-4b53-bbbe-67d84d9e0a14 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:20.505373 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 283/565] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:41:20.506325 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a41ab6-e1ec-4188-b24e-adb2b6ed8ed4 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:20.563929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:20.574129 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f4489-d83d-4b53-bbbe-67d84d9e0a14 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:20.606137 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a41ab6-e1ec-4188-b24e-adb2b6ed8ed4 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:20.607996 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c0c19-8d65-48ad-8909-7e82a9985f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:20.608790 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c0c19-8d65-48ad-8909-7e82a9985f8b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:20.609080 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c0c19-8d65-48ad-8909-7e82a9985f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:20.609392 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c0c19-8d65-48ad-8909-7e82a9985f8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:20.618925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c0c19-8d65-48ad-8909-7e82a9985f8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:20.618925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c0c19-8d65-48ad-8909-7e82a9985f8b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:20.632648 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-d92c0c19-8d65-48ad-8909-7e82a9985f8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:20.632648 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:20.632648 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:20.632648 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:20.632648 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:20.632648 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:20.632648 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:20.632648 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:20.632648 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:20.632648 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:20.632648 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:20.632648 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:20.632648 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:41:20.632648 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:41:20.632648 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:41:20.633634 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:41:20.633634 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:20.633634 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:20.633634 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:20.633634 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:20.633634 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:20.633634 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:20.633634 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:20.633634 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:20.633634 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:20.633634 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:20.633634 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:20.633634 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:20.633634 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:20.633634 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:20.633634 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:20.633634 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:20.634559 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:41:20.634559 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:41:20.634559 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:41:20.634559 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:41:20.634559 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:41:20.634559 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:41:20.634559 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:20.634559 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:20.634559 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 283/566] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:20.635078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c0c19-8d65-48ad-8909-7e82a9985f8b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:20.646484 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc36e2-e19d-4ecb-aab4-d0c8dbb7d7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:20.647166 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc36e2-e19d-4ecb-aab4-d0c8dbb7d7ca None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:20.647458 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc36e2-e19d-4ecb-aab4-d0c8dbb7d7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:20.647739 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc36e2-e19d-4ecb-aab4-d0c8dbb7d7ca None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:20.648586 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc36e2-e19d-4ecb-aab4-d0c8dbb7d7ca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:20.648896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc36e2-e19d-4ecb-aab4-d0c8dbb7d7ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:20.650383 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc36e2-e19d-4ecb-aab4-d0c8dbb7d7ca None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:20.665765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:20.670051 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 284/567] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jun 21 05:41:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:20.671406 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda328d1-11f6-447b-b455-8afa5d98e91c None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:20.671726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda328d1-11f6-447b-b455-8afa5d98e91c None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:20.672009 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda328d1-11f6-447b-b455-8afa5d98e91c None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:20.677292 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 285/568] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:20.678181 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda328d1-11f6-447b-b455-8afa5d98e91c None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:20.738404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c0c19-8d65-48ad-8909-7e82a9985f8b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:20.773593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3728f-75a2-48d1-9424-9c1bf7a217b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:20.774437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3728f-75a2-48d1-9424-9c1bf7a217b8 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:20.774720 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3728f-75a2-48d1-9424-9c1bf7a217b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:20.774994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3728f-75a2-48d1-9424-9c1bf7a217b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:20.779796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda328d1-11f6-447b-b455-8afa5d98e91c None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:20.785719 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3728f-75a2-48d1-9424-9c1bf7a217b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:20.787237 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3728f-75a2-48d1-9424-9c1bf7a217b8 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:20.797118 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:20.804864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-53c3728f-75a2-48d1-9424-9c1bf7a217b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:20.804864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:20.804864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:20.804864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:20.804864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:20.804864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:20.804864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:20.804864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:20.804864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:20.804864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:20.804864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:20.804864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:20.804864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:20.804864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:20.804864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:20.805871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:20.805871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:20.805871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:20.805871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:20.805871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:20.805871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:20.805871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:20.805871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:20.805871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:20.805871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:20.805871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:20.805871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:20.805871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:20.805871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:20.805871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:20.805871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:20.805871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:20.806830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:20.806830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:20.806830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:20.806830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:20.806830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 284/569] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:20.807112 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3728f-75a2-48d1-9424-9c1bf7a217b8 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:20.819281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde7b13-df34-4064-84e0-fe661e5bedb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:20.820009 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde7b13-df34-4064-84e0-fe661e5bedb7 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:20.820289 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde7b13-df34-4064-84e0-fe661e5bedb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:20.820562 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde7b13-df34-4064-84e0-fe661e5bedb7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:20.831469 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde7b13-df34-4064-84e0-fe661e5bedb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:20.839156 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-abde7b13-df34-4064-84e0-fe661e5bedb7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:20.839156 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:20.839156 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:20.839156 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:20.839156 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:20.839156 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:20.839156 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:20.839156 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:20.839156 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:20.839156 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:20.839156 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:20.839156 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:20.839156 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:20.839156 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:20.839156 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:20.839156 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:20.840126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:20.840126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:20.840126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:20.840126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:20.840126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:20.840126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:20.840126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:20.840126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:20.840126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:20.840126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:20.840126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:20.840126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:20.840126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:20.840126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:20.840126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:20.840126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:20.840960 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:20.840960 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:20.840960 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:20.840960 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:20.840960 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:20.840960 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:20.840960 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:20.840960 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:20.840960 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:20.840960 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:20.840960 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:20.840960 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:20.840960 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 286/570] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 21 05:41:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:20.841646 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde7b13-df34-4064-84e0-fe661e5bedb7 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:20.894497 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:20.915126 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3728f-75a2-48d1-9424-9c1bf7a217b8 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:20.945524 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde7b13-df34-4064-84e0-fe661e5bedb7 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:20.950254 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e1154-0497-4356-a9c8-3b86891d41d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:20.950924 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e1154-0497-4356-a9c8-3b86891d41d7 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:20.951206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e1154-0497-4356-a9c8-3b86891d41d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:20.951481 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e1154-0497-4356-a9c8-3b86891d41d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:20.952273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e1154-0497-4356-a9c8-3b86891d41d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:20.952583 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e1154-0497-4356-a9c8-3b86891d41d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:20.954655 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e1154-0497-4356-a9c8-3b86891d41d7 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:20.966494 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 285/571] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:41:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:20.967767 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f654d5-630a-4cba-95f7-8be5a39d40a1 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:20.968051 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f654d5-630a-4cba-95f7-8be5a39d40a1 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:20.968325 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f654d5-630a-4cba-95f7-8be5a39d40a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:20.985683 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-62f654d5-630a-4cba-95f7-8be5a39d40a1 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:20.986119 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacffcd2-14b2-43fa-a621-fb1395575aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:20.986917 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacffcd2-14b2-43fa-a621-fb1395575aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:20.987103 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-62f654d5-630a-4cba-95f7-8be5a39d40a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:20.987202 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacffcd2-14b2-43fa-a621-fb1395575aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:20.987463 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacffcd2-14b2-43fa-a621-fb1395575aa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:20.999324 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacffcd2-14b2-43fa-a621-fb1395575aa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:21.001350 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacffcd2-14b2-43fa-a621-fb1395575aa4 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:21.020676 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-aacffcd2-14b2-43fa-a621-fb1395575aa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:21.020676 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:21.020676 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:21.020676 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:21.020676 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:21.020676 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:21.020676 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:21.020676 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:21.020676 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:21.020676 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:21.020676 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:21.020676 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:21.020676 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:21.020676 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:21.020676 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:21.021618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:21.021618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:21.021618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:21.021618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:21.021618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:21.021618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:21.021618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:21.021618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:21.021618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:21.021618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:21.021618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:21.021618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:21.021618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:21.021618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:21.021618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:21.021618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:21.021618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:21.022546 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:21.022546 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:21.022546 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:21.022546 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:21.022546 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 287/572] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:21.023199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacffcd2-14b2-43fa-a621-fb1395575aa4 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:21.053033 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:21.057179 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 286/573] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:41:21.057851 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f654d5-630a-4cba-95f7-8be5a39d40a1 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:21.131375 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacffcd2-14b2-43fa-a621-fb1395575aa4 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:21.136603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:21.167124 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70ec53-4d03-4855-9771-4019101b5470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:21.167802 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70ec53-4d03-4855-9771-4019101b5470 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:21.168060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f654d5-630a-4cba-95f7-8be5a39d40a1 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:21.168160 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70ec53-4d03-4855-9771-4019101b5470 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:21.168354 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70ec53-4d03-4855-9771-4019101b5470 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:21.169094 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70ec53-4d03-4855-9771-4019101b5470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:21.169403 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70ec53-4d03-4855-9771-4019101b5470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:21.170844 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70ec53-4d03-4855-9771-4019101b5470 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:21.184027 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 288/574] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:21.184845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70ec53-4d03-4855-9771-4019101b5470 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:21.205547 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46670b5d-cda7-4bdc-8683-c5d4af51ab32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:21.206308 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46670b5d-cda7-4bdc-8683-c5d4af51ab32 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:21.206589 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46670b5d-cda7-4bdc-8683-c5d4af51ab32 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:21.206861 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46670b5d-cda7-4bdc-8683-c5d4af51ab32 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:21.207613 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46670b5d-cda7-4bdc-8683-c5d4af51ab32 None admin] RBAC: Adding query filter params (name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:21.207916 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46670b5d-cda7-4bdc-8683-c5d4af51ab32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:21.209308 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46670b5d-cda7-4bdc-8683-c5d4af51ab32 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:21.217861 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 287/575] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 21 05:41:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:21.218801 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46670b5d-cda7-4bdc-8683-c5d4af51ab32 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:21.281966 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:21.294244 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70ec53-4d03-4855-9771-4019101b5470 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:21.319147 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46670b5d-cda7-4bdc-8683-c5d4af51ab32 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:21.330488 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584d2c2-9631-4528-a457-91a89563afd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:21.331418 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584d2c2-9631-4528-a457-91a89563afd1 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:21.331780 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584d2c2-9631-4528-a457-91a89563afd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:21.331979 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584d2c2-9631-4528-a457-91a89563afd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:21.332819 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584d2c2-9631-4528-a457-91a89563afd1 None admin] RBAC: Adding query filter params (role.id=b2f95849039f475c904876eb2958a375, scope.project.id=e64b932ef6bf481cb93a04885a93b4b2, user.id=ac485a336d8b4360bce4f495bd02dbde) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:21.333137 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584d2c2-9631-4528-a457-91a89563afd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:21.334602 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584d2c2-9631-4528-a457-91a89563afd1 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:21.340370 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 289/576] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:41:21 2022] GET /identity/v3/role_assignments?user.id=ac485a336d8b4360bce4f495bd02dbde&scope.project.id=e64b932ef6bf481cb93a04885a93b4b2&role.id=b2f95849039f475c904876eb2958a375 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:21.341180 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584d2c2-9631-4528-a457-91a89563afd1 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:21.355495 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e222a-c4c1-4c04-acac-7b86bb942ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:21.356194 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e222a-c4c1-4c04-acac-7b86bb942ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:21.356744 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e222a-c4c1-4c04-acac-7b86bb942ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:21.357024 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e222a-c4c1-4c04-acac-7b86bb942ee2 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:21.357777 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e222a-c4c1-4c04-acac-7b86bb942ee2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:21.358128 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e222a-c4c1-4c04-acac-7b86bb942ee2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:21.360159 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e222a-c4c1-4c04-acac-7b86bb942ee2 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:21.361967 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:21.381736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 288/577] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:21.381736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e222a-c4c1-4c04-acac-7b86bb942ee2 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:21.478919 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584d2c2-9631-4528-a457-91a89563afd1 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:21.490387 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e222a-c4c1-4c04-acac-7b86bb942ee2 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:21.517372 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e614d-4b18-435c-8dc6-d4942a141f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:21.518211 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e614d-4b18-435c-8dc6-d4942a141f00 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:21.518513 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e614d-4b18-435c-8dc6-d4942a141f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:21.518795 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e614d-4b18-435c-8dc6-d4942a141f00 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:21.529010 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa5357-a20c-4647-b0ef-e8efee886cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:21.530047 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa5357-a20c-4647-b0ef-e8efee886cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:21.530180 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e614d-4b18-435c-8dc6-d4942a141f00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:21.530598 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa5357-a20c-4647-b0ef-e8efee886cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:21.531145 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa5357-a20c-4647-b0ef-e8efee886cf1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:21.538584 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-6d9e614d-4b18-435c-8dc6-d4942a141f00 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:21.538584 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:21.538584 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:21.538584 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:21.538584 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:21.538584 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:21.538584 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:21.538584 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:21.538584 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:21.538584 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:21.538584 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:21.538584 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:21.538584 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:21.538584 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:21.538584 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:21.538584 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:21.539767 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:21.539767 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:21.539767 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:21.539767 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:21.539767 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:21.539767 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:21.539767 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:21.539767 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:21.539767 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:21.539767 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:21.539767 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:21.539767 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:21.539767 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:21.539767 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:21.539767 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:21.539767 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:21.540619 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:21.540619 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:21.540619 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:21.540619 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:21.540619 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:21.540619 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:21.540619 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:21.540619 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:21.540619 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:21.540619 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:21.540619 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:21.540619 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:21.540619 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 290/578] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 21 05:41:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:21.541306 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e614d-4b18-435c-8dc6-d4942a141f00 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:21.546038 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa5357-a20c-4647-b0ef-e8efee886cf1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:21.547641 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa5357-a20c-4647-b0ef-e8efee886cf1 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:21.557657 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:21.563831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-7eaa5357-a20c-4647-b0ef-e8efee886cf1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 21 05:41:21.563831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:21.563831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:21.563831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:21.563831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:21.563831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:21.563831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:21.563831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:21.563831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:21.563831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:21.563831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:21.563831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:21.563831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:41:21.563831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:41:21.563831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:41:21.563831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:41:21.564829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:21.564829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:21.564829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:41:21.564829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:21.564829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:41:21.564829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:21.564829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:21.564829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:21.564829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:21.564829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:21.564829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:21.564829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:21.564829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:21.564829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:21.564829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:21.564829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:21.564829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:21.564829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:21.571382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:21.571382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:21.571382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:41:21.571382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:41:21.571382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:41:21.571382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:41:21.571382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:41:21.571382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:41:21.571382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 21 05:41:21.571382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:21.571382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 289/579] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:41:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:21.571382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa5357-a20c-4647-b0ef-e8efee886cf1 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:21.632786 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:21.656252 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e614d-4b18-435c-8dc6-d4942a141f00 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:21.683327 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa5357-a20c-4647-b0ef-e8efee886cf1 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:21.692386 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33510c45-9441-427f-858e-8c8ec969b0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:21.693182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33510c45-9441-427f-858e-8c8ec969b0bd None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:21.693464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33510c45-9441-427f-858e-8c8ec969b0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:21.693742 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33510c45-9441-427f-858e-8c8ec969b0bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:21.705140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33510c45-9441-427f-858e-8c8ec969b0bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:21.706600 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33510c45-9441-427f-858e-8c8ec969b0bd None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:21.720140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e2b16-7ebf-4623-91c8-2a3525455802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:21.720929 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e2b16-7ebf-4623-91c8-2a3525455802 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:21.721208 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e2b16-7ebf-4623-91c8-2a3525455802 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:21.721479 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e2b16-7ebf-4623-91c8-2a3525455802 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:21.723392 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-33510c45-9441-427f-858e-8c8ec969b0bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:21.723392 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:21.723392 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:21.723392 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:21.723392 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:21.723392 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:21.723392 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:21.723392 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:21.723392 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:21.723392 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:21.723392 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:21.723392 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:21.723392 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:21.723392 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:21.723392 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:21.724422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:21.724422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:21.724422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:21.724422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:21.724422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:21.724422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:21.724422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:21.724422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:21.724422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:21.724422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:21.724422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:21.724422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:21.724422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:21.724422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:21.724422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:21.724422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:21.724422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:21.725432 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:21.725432 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:21.725432 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:21.725432 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:21.725432 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 291/580] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:21.725894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33510c45-9441-427f-858e-8c8ec969b0bd None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:21.735472 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e2b16-7ebf-4623-91c8-2a3525455802 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:21.736972 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e2b16-7ebf-4623-91c8-2a3525455802 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:21.752920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-ec7e2b16-7ebf-4623-91c8-2a3525455802 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:21.752920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:21.752920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:21.752920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:21.752920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:21.752920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:21.752920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:21.752920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:21.752920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:21.752920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:21.752920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:21.752920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:21.752920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:41:21.752920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:41:21.752920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:41:21.754692 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:41:21.754692 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:21.754692 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:21.754692 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:21.754692 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:21.754692 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:21.754692 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:21.754692 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:21.754692 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:21.754692 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:21.754692 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:21.754692 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:21.754692 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:21.754692 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:21.754692 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:21.754692 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:21.754692 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:21.755966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:41:21.755966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:41:21.755966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:41:21.755966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:41:21.755966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:41:21.755966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:41:21.755966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:21.755966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:21.755966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 290/581] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:21.758914 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e2b16-7ebf-4623-91c8-2a3525455802 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:21.807551 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:21.853464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33510c45-9441-427f-858e-8c8ec969b0bd None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:21.870439 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e2b16-7ebf-4623-91c8-2a3525455802 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:21.885541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:21.891545 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072e419-333f-4326-82bc-bf52a4d2ab31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:21.892234 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072e419-333f-4326-82bc-bf52a4d2ab31 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:21.892520 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072e419-333f-4326-82bc-bf52a4d2ab31 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:21.892802 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072e419-333f-4326-82bc-bf52a4d2ab31 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:21.893562 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072e419-333f-4326-82bc-bf52a4d2ab31 None admin] RBAC: Adding query filter params (name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:21.893880 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072e419-333f-4326-82bc-bf52a4d2ab31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:21.895861 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072e419-333f-4326-82bc-bf52a4d2ab31 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:21.904533 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 292/582] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 21 05:41:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:21.905357 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072e419-333f-4326-82bc-bf52a4d2ab31 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:21.914717 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f4fe6-9622-4442-b908-e19971856c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:21.915646 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f4fe6-9622-4442-b908-e19971856c4f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:21.916084 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f4fe6-9622-4442-b908-e19971856c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:21.916581 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f4fe6-9622-4442-b908-e19971856c4f None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:21.917616 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f4fe6-9622-4442-b908-e19971856c4f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:21.918127 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f4fe6-9622-4442-b908-e19971856c4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:21.919589 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f4fe6-9622-4442-b908-e19971856c4f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:21.940542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 291/583] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Jun 21 05:41:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:21.941462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f4fe6-9622-4442-b908-e19971856c4f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:22.024477 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072e419-333f-4326-82bc-bf52a4d2ab31 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:22.051230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:22.061123 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7d71b-9444-48dd-b92a-505721e537a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:22.061787 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7d71b-9444-48dd-b92a-505721e537a8 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:22.062102 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7d71b-9444-48dd-b92a-505721e537a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:22.062993 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7d71b-9444-48dd-b92a-505721e537a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:22.063570 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f4fe6-9622-4442-b908-e19971856c4f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:22.063758 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7d71b-9444-48dd-b92a-505721e537a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:22.064057 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7d71b-9444-48dd-b92a-505721e537a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:22.065442 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7d71b-9444-48dd-b92a-505721e537a8 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:22.082969 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 293/584] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:22.082969 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7d71b-9444-48dd-b92a-505721e537a8 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:22.114167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297a59a-2119-4817-be50-8de5517adf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:22.114740 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297a59a-2119-4817-be50-8de5517adf6f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:22.114992 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297a59a-2119-4817-be50-8de5517adf6f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:22.115277 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297a59a-2119-4817-be50-8de5517adf6f None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:22.116071 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297a59a-2119-4817-be50-8de5517adf6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:22.116392 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297a59a-2119-4817-be50-8de5517adf6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:22.117836 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297a59a-2119-4817-be50-8de5517adf6f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:22.130352 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 292/585] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:41:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:22.131178 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297a59a-2119-4817-be50-8de5517adf6f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:22.166962 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:22.204996 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7d71b-9444-48dd-b92a-505721e537a8 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:22.242372 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417a414-8a49-415e-966b-98c15c3a73ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:22.243169 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417a414-8a49-415e-966b-98c15c3a73ab None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:22.243457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417a414-8a49-415e-966b-98c15c3a73ab None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:22.243739 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417a414-8a49-415e-966b-98c15c3a73ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:22.243836 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297a59a-2119-4817-be50-8de5517adf6f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:22.256150 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417a414-8a49-415e-966b-98c15c3a73ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:22.257597 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417a414-8a49-415e-966b-98c15c3a73ab None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:22.275785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-8417a414-8a49-415e-966b-98c15c3a73ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:22.275785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:22.275785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:22.275785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:22.275785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:22.275785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:22.275785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:22.275785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:22.275785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:22.275785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:22.275785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:22.275785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:22.275785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:22.275785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:22.275785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:22.276715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:22.276715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:22.276715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:22.276715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:22.276715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:22.276715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:22.276715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:22.276715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:22.276715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:22.276715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:22.276715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:22.276715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:22.276715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:22.276715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:22.276715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:22.276715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:22.276715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:22.277647 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:22.277647 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:22.277647 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:22.277647 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:22.277647 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 294/586] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:22.277954 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417a414-8a49-415e-966b-98c15c3a73ab None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:22.283181 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371c6b9-558d-4145-875c-de4dffd2e76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:22.283994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371c6b9-558d-4145-875c-de4dffd2e76d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:22.284280 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371c6b9-558d-4145-875c-de4dffd2e76d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:22.284559 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371c6b9-558d-4145-875c-de4dffd2e76d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:22.295786 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371c6b9-558d-4145-875c-de4dffd2e76d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:22.297815 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371c6b9-558d-4145-875c-de4dffd2e76d None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:22.315919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-4371c6b9-558d-4145-875c-de4dffd2e76d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:22.315919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:22.315919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:22.315919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:22.315919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:22.315919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:22.315919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:22.315919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:22.315919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:22.315919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:22.315919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:22.315919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:22.315919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:22.315919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:22.315919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:22.316866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:22.316866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:22.316866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:22.316866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:22.316866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:22.316866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:22.316866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:22.316866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:22.316866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:22.316866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:22.316866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:22.316866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:22.316866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:22.316866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:22.316866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:22.316866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:22.316866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:22.317793 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:22.317793 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:22.317793 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:22.317793 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:22.321600 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 293/587] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:22.322409 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371c6b9-558d-4145-875c-de4dffd2e76d None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:22.325576 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:22.392815 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417a414-8a49-415e-966b-98c15c3a73ab None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:22.417072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:22.430571 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983618e-3a22-4512-ab3a-e3a6b63476f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:22.431382 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983618e-3a22-4512-ab3a-e3a6b63476f2 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:22.431674 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983618e-3a22-4512-ab3a-e3a6b63476f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:22.431950 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983618e-3a22-4512-ab3a-e3a6b63476f2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:22.437267 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371c6b9-558d-4145-875c-de4dffd2e76d None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:22.446507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1983618e-3a22-4512-ab3a-e3a6b63476f2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:22.454061 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1983618e-3a22-4512-ab3a-e3a6b63476f2 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:22.474775 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a1556-f720-4eea-9b53-a11443d80d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:22.474988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-1983618e-3a22-4512-ab3a-e3a6b63476f2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 05:41:22.474988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:22.474988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:22.474988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:22.474988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:22.474988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:22.474988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:22.474988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:22.474988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:22.474988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:22.474988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:22.474988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:22.474988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:41:22.474988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:41:22.474988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:41:22.474988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:41:22.475912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:22.475912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:22.475912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:41:22.475912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:22.475912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:41:22.475912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:22.475912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:22.475912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:22.475912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:22.475912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:22.475912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:22.475912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:22.475912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:22.475912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:22.475912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:22.475912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:22.475912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:22.475912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:22.476841 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:22.476841 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:22.476841 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:41:22.476841 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:41:22.476841 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:41:22.476841 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:41:22.476841 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:41:22.476841 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:41:22.476841 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 05:41:22.476841 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:22.477389 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a1556-f720-4eea-9b53-a11443d80d29 None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:22.477389 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a1556-f720-4eea-9b53-a11443d80d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:22.477389 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a1556-f720-4eea-9b53-a11443d80d29 None admin] PATH_INFO: `/v3/projects/e64b932ef6bf481cb93a04885a93b4b2/users/f702830987ba4548a4c2ee3d0e302d02/roles/b2f95849039f475c904876eb2958a375` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:22.482012 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 295/588] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:41:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:22.482012 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983618e-3a22-4512-ab3a-e3a6b63476f2 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:22.494450 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a1556-f720-4eea-9b53-a11443d80d29 None admin] RBAC: Authorizing `identity:create_grant(project_id=e64b932ef6bf481cb93a04885a93b4b2, user_id=f702830987ba4548a4c2ee3d0e302d02, role_id=b2f95849039f475c904876eb2958a375)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:22.495898 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a1556-f720-4eea-9b53-a11443d80d29 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:22.510030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 294/589] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 21 05:41:22 2022] PUT /identity/v3/projects/e64b932ef6bf481cb93a04885a93b4b2/users/f702830987ba4548a4c2ee3d0e302d02/roles/b2f95849039f475c904876eb2958a375 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:41:22.510861 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a1556-f720-4eea-9b53-a11443d80d29 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:22.607290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:22.612212 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983618e-3a22-4512-ab3a-e3a6b63476f2 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:22.651074 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86329b1-8131-4807-a2f6-7cd1be0eebf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:22.651809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86329b1-8131-4807-a2f6-7cd1be0eebf7 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:22.652093 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86329b1-8131-4807-a2f6-7cd1be0eebf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:22.652423 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86329b1-8131-4807-a2f6-7cd1be0eebf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:22.653141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a1556-f720-4eea-9b53-a11443d80d29 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:22.653277 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86329b1-8131-4807-a2f6-7cd1be0eebf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:22.653459 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86329b1-8131-4807-a2f6-7cd1be0eebf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:22.654912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86329b1-8131-4807-a2f6-7cd1be0eebf7 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:22.669190 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 296/590] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:22.670542 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86329b1-8131-4807-a2f6-7cd1be0eebf7 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:22.703820 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7954f8-c02e-4e3a-92ea-599dda3a00eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:22.704839 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7954f8-c02e-4e3a-92ea-599dda3a00eb None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:22.705378 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7954f8-c02e-4e3a-92ea-599dda3a00eb None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:22.705900 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7954f8-c02e-4e3a-92ea-599dda3a00eb None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:22.706957 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7954f8-c02e-4e3a-92ea-599dda3a00eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:22.707474 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7954f8-c02e-4e3a-92ea-599dda3a00eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:22.709069 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7954f8-c02e-4e3a-92ea-599dda3a00eb None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:22.712488 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:22.723816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 295/591] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:22.724992 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7954f8-c02e-4e3a-92ea-599dda3a00eb None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:22.799821 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86329b1-8131-4807-a2f6-7cd1be0eebf7 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:22.849315 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091139a8-337b-4d99-8b08-96e5eb902a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:22.850384 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091139a8-337b-4d99-8b08-96e5eb902a85 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:22.851074 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091139a8-337b-4d99-8b08-96e5eb902a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:22.851530 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091139a8-337b-4d99-8b08-96e5eb902a85 None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:22.853261 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091139a8-337b-4d99-8b08-96e5eb902a85 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:22.853743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091139a8-337b-4d99-8b08-96e5eb902a85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:22.856614 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091139a8-337b-4d99-8b08-96e5eb902a85 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:22.861419 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7954f8-c02e-4e3a-92ea-599dda3a00eb None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:22.882564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 297/592] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Jun 21 05:41:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:22.884257 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091139a8-337b-4d99-8b08-96e5eb902a85 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:22.905095 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:22.907750 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149034d5-2de2-4e0d-bb53-ce753652972d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:22.908743 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149034d5-2de2-4e0d-bb53-ce753652972d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:22.909207 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149034d5-2de2-4e0d-bb53-ce753652972d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:22.909653 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149034d5-2de2-4e0d-bb53-ce753652972d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:22.922683 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149034d5-2de2-4e0d-bb53-ce753652972d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:22.924647 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149034d5-2de2-4e0d-bb53-ce753652972d None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:22.947246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-149034d5-2de2-4e0d-bb53-ce753652972d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 05:41:22.947246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:22.947246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:22.947246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:22.947246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:22.947246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:22.947246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:22.947246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:22.947246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:22.947246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:22.947246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:22.947246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:22.947246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:41:22.947246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:41:22.947246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:41:22.947246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:41:22.948429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:22.948429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:22.948429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:41:22.948429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:22.948429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:41:22.948429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:22.948429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:22.948429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:22.948429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:22.948429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:22.948429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:22.948429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:22.948429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:22.948429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:22.948429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:22.948429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:22.948429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:22.948429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:22.949612 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:22.949612 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:22.949612 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:41:22.949612 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:41:22.949612 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:41:22.949612 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:41:22.949612 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:41:22.949612 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:41:22.949612 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 05:41:22.949612 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:22.952629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 296/593] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 21 05:41:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:22.954574 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149034d5-2de2-4e0d-bb53-ce753652972d None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:23.004039 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091139a8-337b-4d99-8b08-96e5eb902a85 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:23.035359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:23.043764 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a41aff-2ce7-4188-82d5-9c1600b96d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:23.044719 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a41aff-2ce7-4188-82d5-9c1600b96d7b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:23.045254 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a41aff-2ce7-4188-82d5-9c1600b96d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:23.045563 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a41aff-2ce7-4188-82d5-9c1600b96d7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:23.053541 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a41aff-2ce7-4188-82d5-9c1600b96d7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:23.055249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a41aff-2ce7-4188-82d5-9c1600b96d7b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:23.071444 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-81a41aff-2ce7-4188-82d5-9c1600b96d7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:23.071444 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:23.071444 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:23.071444 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:23.071444 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:23.071444 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:23.071444 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:23.071444 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:23.071444 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:23.071444 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:23.071444 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:23.071444 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:23.071444 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:41:23.071444 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:41:23.071444 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:41:23.072574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:41:23.072574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:23.072574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:23.072574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:23.072574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:23.072574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:23.072574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:23.072574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:23.072574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:23.072574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:23.072574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:23.072574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:23.072574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:23.072574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:23.072574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:23.072574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:23.072574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:23.073672 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:41:23.073672 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:41:23.073672 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:41:23.073672 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:41:23.073672 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:41:23.073672 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:41:23.073672 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:23.073672 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:23.080731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 298/594] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:23.081889 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a41aff-2ce7-4188-82d5-9c1600b96d7b None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:23.096125 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149034d5-2de2-4e0d-bb53-ce753652972d None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:23.142524 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180ea06-04fc-4432-91be-ee8c66313c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:23.143331 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180ea06-04fc-4432-91be-ee8c66313c7c None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:23.143621 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180ea06-04fc-4432-91be-ee8c66313c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:23.143898 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180ea06-04fc-4432-91be-ee8c66313c7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:23.158791 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180ea06-04fc-4432-91be-ee8c66313c7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:23.160556 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180ea06-04fc-4432-91be-ee8c66313c7c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:23.184828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-2180ea06-04fc-4432-91be-ee8c66313c7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:23.184828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:23.184828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:23.184828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:23.184828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:23.184828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:23.184828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:23.184828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:23.184828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:23.184828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:23.184828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:23.184828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:23.184828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:23.184828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:23.184828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:23.186875 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:23.186875 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:23.186875 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:23.186875 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:23.186875 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:23.186875 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:23.186875 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:23.186875 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:23.186875 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:23.186875 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:23.186875 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:23.186875 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:23.186875 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:23.186875 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:23.186875 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:23.186875 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:23.186875 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:23.189154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:23.189154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:23.189154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:23.189154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:23.189154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 297/595] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:23.189154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180ea06-04fc-4432-91be-ee8c66313c7c None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:23.205135 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:23.244826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a41aff-2ce7-4188-82d5-9c1600b96d7b None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:23.286291 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb22d2d-1523-4270-b46f-6a968443966a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:23.287399 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb22d2d-1523-4270-b46f-6a968443966a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:23.287929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb22d2d-1523-4270-b46f-6a968443966a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:23.288404 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb22d2d-1523-4270-b46f-6a968443966a None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:23.289449 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb22d2d-1523-4270-b46f-6a968443966a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:23.290015 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb22d2d-1523-4270-b46f-6a968443966a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:23.292147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb22d2d-1523-4270-b46f-6a968443966a None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:23.316663 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 299/596] 10.222.0.18 () {56 vars in 1139 bytes} [Tue Jun 21 05:41:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:23.318185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb22d2d-1523-4270-b46f-6a968443966a None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:23.324129 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180ea06-04fc-4432-91be-ee8c66313c7c None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:23.333565 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:23.371373 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0412b1-e1fa-4b44-9917-853c0b22bbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:23.372043 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0412b1-e1fa-4b44-9917-853c0b22bbc4 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:23.372336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0412b1-e1fa-4b44-9917-853c0b22bbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:23.372616 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0412b1-e1fa-4b44-9917-853c0b22bbc4 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:23.373409 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0412b1-e1fa-4b44-9917-853c0b22bbc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:23.373725 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0412b1-e1fa-4b44-9917-853c0b22bbc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:23.376705 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0412b1-e1fa-4b44-9917-853c0b22bbc4 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:23.398764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 298/597] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:41:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:23.398764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0412b1-e1fa-4b44-9917-853c0b22bbc4 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:23.447633 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb22d2d-1523-4270-b46f-6a968443966a None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:23.495129 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b8bd4-51b2-40b8-9b4a-2042aff2bacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:23.495794 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b8bd4-51b2-40b8-9b4a-2042aff2bacf None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:23.496092 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b8bd4-51b2-40b8-9b4a-2042aff2bacf None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:23.496376 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b8bd4-51b2-40b8-9b4a-2042aff2bacf None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:23.497104 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b8bd4-51b2-40b8-9b4a-2042aff2bacf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:23.497415 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b8bd4-51b2-40b8-9b4a-2042aff2bacf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:23.498810 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b8bd4-51b2-40b8-9b4a-2042aff2bacf None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:23.500979 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:23.507112 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0412b1-e1fa-4b44-9917-853c0b22bbc4 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:23.518267 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 300/598] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:23.519510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b8bd4-51b2-40b8-9b4a-2042aff2bacf None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:23.549062 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe58740-2e8d-4488-a044-49087147a7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:23.550140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe58740-2e8d-4488-a044-49087147a7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:23.550578 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe58740-2e8d-4488-a044-49087147a7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:23.550866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe58740-2e8d-4488-a044-49087147a7e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:23.561543 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe58740-2e8d-4488-a044-49087147a7e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:23.563654 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe58740-2e8d-4488-a044-49087147a7e5 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:23.582526 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-3fe58740-2e8d-4488-a044-49087147a7e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:23.582526 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:23.582526 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:23.582526 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:23.582526 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:23.582526 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:23.582526 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:23.582526 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:23.582526 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:23.582526 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:23.582526 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:23.582526 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:23.582526 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:23.582526 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:23.582526 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:23.583657 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:23.583657 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:23.583657 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:23.583657 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:23.583657 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:23.583657 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:23.583657 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:23.583657 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:23.583657 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:23.583657 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:23.583657 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:23.583657 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:23.583657 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:23.583657 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:23.583657 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:23.583657 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:23.583657 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:23.584720 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:23.584720 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:23.584720 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:23.584720 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:23.588144 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 299/599] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:23.589488 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e06697-c952-4eec-8af1-9d937ec3dee4 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:23.589786 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e06697-c952-4eec-8af1-9d937ec3dee4 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:23.590092 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e06697-c952-4eec-8af1-9d937ec3dee4 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:23.591427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 300/600] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:23.594763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e06697-c952-4eec-8af1-9d937ec3dee4 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:23.621165 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:23.630818 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b8bd4-51b2-40b8-9b4a-2042aff2bacf None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:23.667200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de5066-9cef-4225-bb4c-81066944234b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:23.668092 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de5066-9cef-4225-bb4c-81066944234b None admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:23.668373 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de5066-9cef-4225-bb4c-81066944234b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:23.668644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de5066-9cef-4225-bb4c-81066944234b None admin] PATH_INFO: `/v3/projects/e64b932ef6bf481cb93a04885a93b4b2/users/d44776834b134ae98fa28d4741cc4ec3/roles/b2f95849039f475c904876eb2958a375` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:23.684674 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de5066-9cef-4225-bb4c-81066944234b None admin] RBAC: Authorizing `identity:create_grant(project_id=e64b932ef6bf481cb93a04885a93b4b2, user_id=d44776834b134ae98fa28d4741cc4ec3, role_id=b2f95849039f475c904876eb2958a375)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:23.686167 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de5066-9cef-4225-bb4c-81066944234b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:23.700237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 301/601] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 21 05:41:23 2022] PUT /identity/v3/projects/e64b932ef6bf481cb93a04885a93b4b2/users/d44776834b134ae98fa28d4741cc4ec3/roles/b2f95849039f475c904876eb2958a375 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:41:23.706967 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de5066-9cef-4225-bb4c-81066944234b None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:23.729630 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e06697-c952-4eec-8af1-9d937ec3dee4 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:23.775995 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:23.788437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbadbd-c060-4b20-9caf-1ce65c34a55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:23.789846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbadbd-c060-4b20-9caf-1ce65c34a55a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:23.790428 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbadbd-c060-4b20-9caf-1ce65c34a55a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:23.790913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbadbd-c060-4b20-9caf-1ce65c34a55a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:23.800527 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfbadbd-c060-4b20-9caf-1ce65c34a55a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:23.802438 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfbadbd-c060-4b20-9caf-1ce65c34a55a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:23.819729 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-edfbadbd-c060-4b20-9caf-1ce65c34a55a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:23.819729 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:23.819729 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:23.819729 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:23.819729 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:23.819729 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:23.819729 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:23.819729 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:23.819729 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:23.819729 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:23.819729 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:23.819729 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:23.819729 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:41:23.819729 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:41:23.819729 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:41:23.820716 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:41:23.820716 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:23.820716 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:23.820716 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:23.820716 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:23.820716 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:23.820716 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:23.820716 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:23.820716 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:23.820716 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:23.820716 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:23.820716 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:23.820716 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:23.820716 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:23.820716 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:23.820716 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:23.820716 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:23.821600 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:41:23.821600 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:41:23.821600 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:41:23.821600 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:41:23.821600 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:41:23.821600 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:41:23.821600 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:23.821600 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:23.829008 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 301/602] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:23.830940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a9f17-844b-4e76-b629-725414d824aa None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:23.831507 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a9f17-844b-4e76-b629-725414d824aa None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:23.831998 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a9f17-844b-4e76-b629-725414d824aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:23.845239 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de5066-9cef-4225-bb4c-81066944234b None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:23.850598 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-693a9f17-844b-4e76-b629-725414d824aa None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:23.852195 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-693a9f17-844b-4e76-b629-725414d824aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:23.888527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8de11-6b40-46b8-a718-1bfce04c29fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:23.889193 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8de11-6b40-46b8-a718-1bfce04c29fb None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:23.889477 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8de11-6b40-46b8-a718-1bfce04c29fb None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:23.889755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8de11-6b40-46b8-a718-1bfce04c29fb None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:23.890913 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8de11-6b40-46b8-a718-1bfce04c29fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:23.890913 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8de11-6b40-46b8-a718-1bfce04c29fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:23.892240 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8de11-6b40-46b8-a718-1bfce04c29fb None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:23.905647 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 302/603] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:23.907086 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8de11-6b40-46b8-a718-1bfce04c29fb None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:23.928182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 302/604] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:41:23.930047 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a9f17-844b-4e76-b629-725414d824aa None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:23.942047 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:24.059349 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8de11-6b40-46b8-a718-1bfce04c29fb None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:24.060664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a9f17-844b-4e76-b629-725414d824aa None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:24.062944 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:24.113621 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f257470-07ac-43af-be36-5f5f295d87d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:24.115024 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f257470-07ac-43af-be36-5f5f295d87d2 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:24.115434 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f257470-07ac-43af-be36-5f5f295d87d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:24.115816 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f257470-07ac-43af-be36-5f5f295d87d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:24.116775 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f257470-07ac-43af-be36-5f5f295d87d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:24.117209 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f257470-07ac-43af-be36-5f5f295d87d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:24.118326 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e28ad-f17d-49aa-80d3-53bdd6af2081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:24.119447 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e28ad-f17d-49aa-80d3-53bdd6af2081 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:24.119786 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f257470-07ac-43af-be36-5f5f295d87d2 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:24.120095 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e28ad-f17d-49aa-80d3-53bdd6af2081 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:24.120547 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e28ad-f17d-49aa-80d3-53bdd6af2081 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:24.130548 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e28ad-f17d-49aa-80d3-53bdd6af2081 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:24.132815 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e28ad-f17d-49aa-80d3-53bdd6af2081 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:24.135497 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 303/605] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:41:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:24.140856 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f257470-07ac-43af-be36-5f5f295d87d2 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:24.151040 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-409e28ad-f17d-49aa-80d3-53bdd6af2081 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:24.151040 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:24.151040 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:24.151040 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:24.151040 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:24.151040 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:24.151040 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:24.151040 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:24.151040 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:24.151040 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:24.151040 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:24.151040 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:24.151040 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:41:24.151040 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:41:24.151040 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:41:24.152140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:41:24.152140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:24.152140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:24.152140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:24.152140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:24.152140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:24.152140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:24.152140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:24.152140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:24.152140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:24.152140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:24.152140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:24.152140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:24.152140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:24.152140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:24.152140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:24.152140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:24.153224 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:41:24.153224 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:41:24.153224 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:41:24.153224 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:41:24.153224 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:41:24.153224 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:41:24.153224 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:24.153224 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:24.160808 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 303/606] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:24.160808 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e28ad-f17d-49aa-80d3-53bdd6af2081 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:24.235137 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:24.274627 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e28ad-f17d-49aa-80d3-53bdd6af2081 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:24.286181 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f257470-07ac-43af-be36-5f5f295d87d2 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:24.310818 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378847a-b0e6-4cd7-83ab-fa17e8cda651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:24.311819 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378847a-b0e6-4cd7-83ab-fa17e8cda651 None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:24.312251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378847a-b0e6-4cd7-83ab-fa17e8cda651 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:24.312636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378847a-b0e6-4cd7-83ab-fa17e8cda651 None admin] PATH_INFO: `/v3/projects/e64b932ef6bf481cb93a04885a93b4b2/users/5c13a614e6b04b3a93247e3790f96240/roles/b2f95849039f475c904876eb2958a375` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:24.334274 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378847a-b0e6-4cd7-83ab-fa17e8cda651 None admin] RBAC: Authorizing `identity:create_grant(project_id=e64b932ef6bf481cb93a04885a93b4b2, user_id=5c13a614e6b04b3a93247e3790f96240, role_id=b2f95849039f475c904876eb2958a375)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:24.334506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ed3ad-b92b-4f2f-a80c-4688369f6d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:24.335144 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ed3ad-b92b-4f2f-a80c-4688369f6d00 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:24.335428 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ed3ad-b92b-4f2f-a80c-4688369f6d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:24.335706 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ed3ad-b92b-4f2f-a80c-4688369f6d00 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:24.336409 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378847a-b0e6-4cd7-83ab-fa17e8cda651 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:24.349642 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ed3ad-b92b-4f2f-a80c-4688369f6d00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:24.358093 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 304/607] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 21 05:41:24 2022] PUT /identity/v3/projects/e64b932ef6bf481cb93a04885a93b4b2/users/5c13a614e6b04b3a93247e3790f96240/roles/b2f95849039f475c904876eb2958a375 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:41:24.358650 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-3f7ed3ad-b92b-4f2f-a80c-4688369f6d00 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:24.358650 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:24.358650 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:24.358650 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:24.358650 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:24.358650 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:24.358650 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:24.358650 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:24.358650 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:24.358650 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:24.358650 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:24.358650 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:24.358650 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:24.358650 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:24.358650 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:24.358650 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:24.359796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:24.359796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:24.359796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:24.359796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:24.359796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:24.359796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:24.359796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:24.359796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:24.359796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:24.359796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:24.359796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:24.359796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:24.359796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:24.359796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:24.359796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:24.359796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:24.360716 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:24.360716 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:24.360716 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:24.360716 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:24.360716 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:24.360716 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:24.360716 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:24.360716 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:24.360716 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:24.360716 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:24.360716 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:24.360716 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:24.360716 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 304/608] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 21 05:41:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:24.361541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378847a-b0e6-4cd7-83ab-fa17e8cda651 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:24.369924 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ed3ad-b92b-4f2f-a80c-4688369f6d00 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:24.419726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:24.584064 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ed3ad-b92b-4f2f-a80c-4688369f6d00 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:24.584240 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378847a-b0e6-4cd7-83ab-fa17e8cda651 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:24.604336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:24.623496 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad9dfc-6d2c-4bd7-b95c-df32ac27a59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:24.624272 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad9dfc-6d2c-4bd7-b95c-df32ac27a59b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:24.624554 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad9dfc-6d2c-4bd7-b95c-df32ac27a59b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:24.625365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad9dfc-6d2c-4bd7-b95c-df32ac27a59b None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:24.626218 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ad9dfc-6d2c-4bd7-b95c-df32ac27a59b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:24.626533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ad9dfc-6d2c-4bd7-b95c-df32ac27a59b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:24.627998 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ad9dfc-6d2c-4bd7-b95c-df32ac27a59b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:24.633255 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd0afa-8198-4d98-83e3-40c11ccc8e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:24.634022 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd0afa-8198-4d98-83e3-40c11ccc8e83 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:24.634314 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd0afa-8198-4d98-83e3-40c11ccc8e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:24.634596 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd0afa-8198-4d98-83e3-40c11ccc8e83 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:24.635361 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd0afa-8198-4d98-83e3-40c11ccc8e83 None admin] RBAC: Adding query filter params (name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:24.635780 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd0afa-8198-4d98-83e3-40c11ccc8e83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:24.637174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd0afa-8198-4d98-83e3-40c11ccc8e83 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:24.641905 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 305/609] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:41:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:24.647192 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 305/610] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 21 05:41:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:24.652151 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd0afa-8198-4d98-83e3-40c11ccc8e83 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:24.652367 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad9dfc-6d2c-4bd7-b95c-df32ac27a59b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:24.763067 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:24.782612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd0afa-8198-4d98-83e3-40c11ccc8e83 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:24.782950 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad9dfc-6d2c-4bd7-b95c-df32ac27a59b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:24.818550 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd77f72-d7de-4f75-b35e-e35baafc8f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:24.819633 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd77f72-d7de-4f75-b35e-e35baafc8f29 None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:24.819913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd77f72-d7de-4f75-b35e-e35baafc8f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:24.820165 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82548956-4eaa-45ea-b056-f300666317cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:24.820371 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd77f72-d7de-4f75-b35e-e35baafc8f29 None admin] PATH_INFO: `/v3/projects/e64b932ef6bf481cb93a04885a93b4b2/users/51e845d0dc2c4a1fa612556c1aa73ed5/roles/b2f95849039f475c904876eb2958a375` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:24.820868 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82548956-4eaa-45ea-b056-f300666317cd None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:24.821157 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82548956-4eaa-45ea-b056-f300666317cd None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:24.821440 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82548956-4eaa-45ea-b056-f300666317cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:24.834573 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82548956-4eaa-45ea-b056-f300666317cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:24.835976 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82548956-4eaa-45ea-b056-f300666317cd None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:24.836289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd77f72-d7de-4f75-b35e-e35baafc8f29 None admin] RBAC: Authorizing `identity:create_grant(project_id=e64b932ef6bf481cb93a04885a93b4b2, user_id=51e845d0dc2c4a1fa612556c1aa73ed5, role_id=b2f95849039f475c904876eb2958a375)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:24.837757 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd77f72-d7de-4f75-b35e-e35baafc8f29 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:24.852283 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 306/611] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 21 05:41:24 2022] PUT /identity/v3/projects/e64b932ef6bf481cb93a04885a93b4b2/users/51e845d0dc2c4a1fa612556c1aa73ed5/roles/b2f95849039f475c904876eb2958a375 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:41:24.853776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24407c-4524-4a3e-9470-c27da46a9c1e None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:24.854132 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24407c-4524-4a3e-9470-c27da46a9c1e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:24.854422 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24407c-4524-4a3e-9470-c27da46a9c1e None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:24.856168 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 307/612] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:24.860783 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-82548956-4eaa-45ea-b056-f300666317cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:24.860783 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:24.860783 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:24.860783 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:24.860783 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:24.860783 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:24.860783 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:24.860783 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:24.860783 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:24.860783 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:24.860783 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:24.860783 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:24.860783 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:24.860783 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:24.860783 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:24.862842 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:24.862842 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:24.862842 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:24.862842 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:24.862842 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:24.862842 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:24.862842 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:24.862842 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:24.862842 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:24.862842 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:24.862842 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:24.862842 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:24.862842 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:24.862842 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:24.862842 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:24.862842 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:24.862842 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:24.864094 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:24.864094 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:24.864094 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:24.864094 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:24.864094 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 306/613] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:41:24.867739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96bfeb-241a-4a7b-880a-10bbf378366a None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:24.868955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82548956-4eaa-45ea-b056-f300666317cd None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:24.869669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96bfeb-241a-4a7b-880a-10bbf378366a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:24.872369 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96bfeb-241a-4a7b-880a-10bbf378366a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:24.912940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-4f96bfeb-241a-4a7b-880a-10bbf378366a None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:24.915663 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-4f96bfeb-241a-4a7b-880a-10bbf378366a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:24.976222 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:25.053827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82548956-4eaa-45ea-b056-f300666317cd None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:25.065089 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 308/614] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:41:25.113339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96bfeb-241a-4a7b-880a-10bbf378366a None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:25.117241 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f728f4c-cf50-4c3f-81bd-af6d9a2b77b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:25.118180 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f728f4c-cf50-4c3f-81bd-af6d9a2b77b7 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:25.118285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f728f4c-cf50-4c3f-81bd-af6d9a2b77b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:25.118484 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f728f4c-cf50-4c3f-81bd-af6d9a2b77b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:25.119300 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f728f4c-cf50-4c3f-81bd-af6d9a2b77b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:25.119614 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f728f4c-cf50-4c3f-81bd-af6d9a2b77b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:25.121014 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f728f4c-cf50-4c3f-81bd-af6d9a2b77b7 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:25.140930 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:25.158058 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 307/615] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:25.163512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f728f4c-cf50-4c3f-81bd-af6d9a2b77b7 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:25.328722 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96bfeb-241a-4a7b-880a-10bbf378366a None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:25.329320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f728f4c-cf50-4c3f-81bd-af6d9a2b77b7 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:25.366817 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc67f00-e97a-4f55-a784-3458d4396727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:25.367962 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc67f00-e97a-4f55-a784-3458d4396727 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:25.368446 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc67f00-e97a-4f55-a784-3458d4396727 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:25.368983 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc67f00-e97a-4f55-a784-3458d4396727 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:25.377708 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc67f00-e97a-4f55-a784-3458d4396727 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:25.379509 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc67f00-e97a-4f55-a784-3458d4396727 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:25.395681 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-cdc67f00-e97a-4f55-a784-3458d4396727 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 05:41:25.395681 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:25.395681 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:25.395681 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:25.395681 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:25.395681 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:25.395681 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:25.395681 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:25.395681 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:25.395681 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:25.395681 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:25.395681 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:25.395681 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:41:25.395681 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:41:25.395681 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:41:25.395681 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:41:25.396644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:25.396644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:25.396644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:41:25.396644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:25.396644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:41:25.396644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:25.396644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:25.396644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:25.396644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:25.396644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:25.396644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:25.396644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:25.396644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:25.396644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:25.396644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:25.396644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:25.396644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:25.396644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:25.397564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:25.397564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:25.397564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:41:25.397564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:41:25.397564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:41:25.397564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:41:25.397564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:41:25.397564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:41:25.397564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 05:41:25.397564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:25.399425 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 308/616] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:41:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:25.405011 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc67f00-e97a-4f55-a784-3458d4396727 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:25.407224 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f3655-0aa3-4cb7-a203-20ffb1edeb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:25.408274 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f3655-0aa3-4cb7-a203-20ffb1edeb83 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:25.408563 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f3655-0aa3-4cb7-a203-20ffb1edeb83 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:25.408842 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f3655-0aa3-4cb7-a203-20ffb1edeb83 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:25.429631 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f3655-0aa3-4cb7-a203-20ffb1edeb83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:25.447214 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-041f3655-0aa3-4cb7-a203-20ffb1edeb83 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:25.447214 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:25.447214 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:25.447214 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:25.447214 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:25.447214 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:25.447214 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:25.447214 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:25.447214 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:25.447214 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:25.447214 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:25.447214 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:25.447214 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:25.447214 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:25.447214 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:25.447214 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:25.448182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:25.448182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:25.448182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:25.448182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:25.448182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:25.448182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:25.448182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:25.448182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:25.448182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:25.448182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:25.448182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:25.448182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:25.448182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:25.448182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:25.448182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:25.448182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:25.449015 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:25.449015 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:25.449015 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:25.449015 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:25.449015 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:25.449015 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:25.449015 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:25.449015 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:25.449015 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:25.449015 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:25.449015 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:25.449015 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:25.449015 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 309/617] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 21 05:41:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:41:25.455526 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f3655-0aa3-4cb7-a203-20ffb1edeb83 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:25.475122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:25.495554 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:25.520043 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc67f00-e97a-4f55-a784-3458d4396727 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:25.555602 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614f4a7-db26-44a0-afe2-f8b79530b7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:25.556661 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614f4a7-db26-44a0-afe2-f8b79530b7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:25.557152 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614f4a7-db26-44a0-afe2-f8b79530b7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:25.557631 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614f4a7-db26-44a0-afe2-f8b79530b7f9 None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:25.558759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614f4a7-db26-44a0-afe2-f8b79530b7f9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:25.559281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614f4a7-db26-44a0-afe2-f8b79530b7f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:25.560924 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614f4a7-db26-44a0-afe2-f8b79530b7f9 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:25.581260 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 309/618] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Jun 21 05:41:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:41:25.586934 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614f4a7-db26-44a0-afe2-f8b79530b7f9 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:25.689416 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f3655-0aa3-4cb7-a203-20ffb1edeb83 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:25.690806 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614f4a7-db26-44a0-afe2-f8b79530b7f9 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:25.717224 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:25.728317 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fec48e-cd36-4156-a438-1dcb6f98f03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:25.729502 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fec48e-cd36-4156-a438-1dcb6f98f03f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:25.730046 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fec48e-cd36-4156-a438-1dcb6f98f03f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:25.731012 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fec48e-cd36-4156-a438-1dcb6f98f03f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:25.743239 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fec48e-cd36-4156-a438-1dcb6f98f03f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:25.745014 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fec48e-cd36-4156-a438-1dcb6f98f03f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:25.766679 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-83fec48e-cd36-4156-a438-1dcb6f98f03f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:25.766679 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:25.766679 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:25.766679 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:25.766679 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:25.766679 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:25.766679 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:25.766679 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:25.766679 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:25.766679 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:25.766679 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:25.766679 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:25.766679 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:25.766679 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:25.766679 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:25.767793 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:25.767793 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:25.767793 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:25.767793 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:25.767793 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:25.767793 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:25.767793 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:25.767793 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:25.767793 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:25.767793 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:25.767793 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:25.767793 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:25.767793 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:25.767793 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:25.767793 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:25.767793 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:25.767793 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:25.768686 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:25.768686 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:25.768686 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:25.768686 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:25.771276 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 310/619] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:25.777037 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fec48e-cd36-4156-a438-1dcb6f98f03f None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:25.782737 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513722f0-99b3-4f70-9cb6-ed88985f8572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:25.783450 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513722f0-99b3-4f70-9cb6-ed88985f8572 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:25.783765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513722f0-99b3-4f70-9cb6-ed88985f8572 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:25.784013 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513722f0-99b3-4f70-9cb6-ed88985f8572 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:25.784853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513722f0-99b3-4f70-9cb6-ed88985f8572 None admin] RBAC: Adding query filter params (name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:25.785162 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513722f0-99b3-4f70-9cb6-ed88985f8572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:25.789990 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513722f0-99b3-4f70-9cb6-ed88985f8572 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:25.810367 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 310/620] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 21 05:41:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:41:25.811857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513722f0-99b3-4f70-9cb6-ed88985f8572 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:25.965246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:25.970517 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fec48e-cd36-4156-a438-1dcb6f98f03f None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:26.004797 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513722f0-99b3-4f70-9cb6-ed88985f8572 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:26.017616 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2a06e-3d5f-42cd-b637-6ebb3bcaa9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:26.018314 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2a06e-3d5f-42cd-b637-6ebb3bcaa9ba None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:26.018601 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2a06e-3d5f-42cd-b637-6ebb3bcaa9ba None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:26.018878 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2a06e-3d5f-42cd-b637-6ebb3bcaa9ba None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:26.019606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2a06e-3d5f-42cd-b637-6ebb3bcaa9ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:26.019913 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2a06e-3d5f-42cd-b637-6ebb3bcaa9ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:26.021287 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2a06e-3d5f-42cd-b637-6ebb3bcaa9ba None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:26.037533 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 311/621] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:26.038958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857ecac-d61b-4d29-b8bc-56cac54e3fa2 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:26.039308 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857ecac-d61b-4d29-b8bc-56cac54e3fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:26.039595 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857ecac-d61b-4d29-b8bc-56cac54e3fa2 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:26.041564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 312/622] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:26.042636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857ecac-d61b-4d29-b8bc-56cac54e3fa2 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:26.050185 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75f944-d133-4496-a9c7-5b04b56c4859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:26.050997 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75f944-d133-4496-a9c7-5b04b56c4859 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:26.051280 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75f944-d133-4496-a9c7-5b04b56c4859 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:26.051559 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75f944-d133-4496-a9c7-5b04b56c4859 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:26.066345 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75f944-d133-4496-a9c7-5b04b56c4859 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:26.067814 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75f944-d133-4496-a9c7-5b04b56c4859 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:26.074724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:26.090629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-7c75f944-d133-4496-a9c7-5b04b56c4859 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:26.090629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:26.090629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:26.090629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:26.090629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:26.090629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:26.090629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:26.090629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:26.090629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:26.090629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:26.090629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:26.090629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:26.090629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:26.090629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:26.090629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:26.091791 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:26.091791 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:26.091791 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:26.091791 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:26.091791 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:26.091791 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:26.091791 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:26.091791 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:26.091791 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:26.091791 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:26.091791 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:26.091791 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:26.091791 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:26.091791 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:26.091791 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:26.091791 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:26.091791 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:26.092876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:26.092876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:26.092876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:26.092876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:26.101965 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 311/623] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:41:26.103194 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c79e8b-bfa7-4edc-95d7-897a75cdc4f7 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:26.103476 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c79e8b-bfa7-4edc-95d7-897a75cdc4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:26.103756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c79e8b-bfa7-4edc-95d7-897a75cdc4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:26.125648 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-f5c79e8b-bfa7-4edc-95d7-897a75cdc4f7 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:26.126899 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f5c79e8b-bfa7-4edc-95d7-897a75cdc4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:26.163467 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857ecac-d61b-4d29-b8bc-56cac54e3fa2 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:26.202935 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685b2cb-e6fc-46a5-a2d9-d4926ee5baa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:26.204120 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685b2cb-e6fc-46a5-a2d9-d4926ee5baa1 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:26.204567 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685b2cb-e6fc-46a5-a2d9-d4926ee5baa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:26.204991 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685b2cb-e6fc-46a5-a2d9-d4926ee5baa1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:26.207557 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 312/624] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:41:26.208940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c79e8b-bfa7-4edc-95d7-897a75cdc4f7 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:26.213782 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685b2cb-e6fc-46a5-a2d9-d4926ee5baa1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:26.215589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685b2cb-e6fc-46a5-a2d9-d4926ee5baa1 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:26.232263 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-6685b2cb-e6fc-46a5-a2d9-d4926ee5baa1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:26.232263 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:26.232263 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:26.232263 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:26.232263 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:26.232263 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:26.232263 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:26.232263 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:26.232263 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:26.232263 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:26.232263 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:26.232263 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:26.232263 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:41:26.232263 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:41:26.232263 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:41:26.233400 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:41:26.233400 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:26.233400 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:26.233400 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:26.233400 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:26.233400 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:26.233400 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:26.233400 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:26.233400 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:26.233400 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:26.233400 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:26.233400 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:26.233400 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:26.233400 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:26.233400 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:26.233400 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:26.233400 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:26.234930 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:41:26.234930 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:41:26.234930 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:41:26.234930 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:41:26.234930 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:41:26.234930 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:41:26.234930 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:26.234930 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:26.241401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 313/625] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:41:26.242909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685b2cb-e6fc-46a5-a2d9-d4926ee5baa1 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:26.294512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:26.334362 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c79e8b-bfa7-4edc-95d7-897a75cdc4f7 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:26.346483 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:26.363072 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685b2cb-e6fc-46a5-a2d9-d4926ee5baa1 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:26.372759 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c2bb4-cf28-4e8e-adcf-408526534949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:26.373428 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c2bb4-cf28-4e8e-adcf-408526534949 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:26.373714 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c2bb4-cf28-4e8e-adcf-408526534949 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:26.374024 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c2bb4-cf28-4e8e-adcf-408526534949 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:26.374794 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c2bb4-cf28-4e8e-adcf-408526534949 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:26.375101 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c2bb4-cf28-4e8e-adcf-408526534949 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:26.376573 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c2bb4-cf28-4e8e-adcf-408526534949 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:26.392757 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 313/626] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:26.393674 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c2bb4-cf28-4e8e-adcf-408526534949 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:26.404047 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354e6b8-4736-49cd-b458-0e8624f05a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:26.405059 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354e6b8-4736-49cd-b458-0e8624f05a52 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:26.405492 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354e6b8-4736-49cd-b458-0e8624f05a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:26.406613 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354e6b8-4736-49cd-b458-0e8624f05a52 None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:26.407631 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354e6b8-4736-49cd-b458-0e8624f05a52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:26.408136 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354e6b8-4736-49cd-b458-0e8624f05a52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:26.409911 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354e6b8-4736-49cd-b458-0e8624f05a52 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:26.430267 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 314/627] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:41:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:41:26.431497 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354e6b8-4736-49cd-b458-0e8624f05a52 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:26.505980 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c2bb4-cf28-4e8e-adcf-408526534949 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:26.530102 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:26.542762 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7691c-004b-4910-9725-cd9be0ae1366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:26.543496 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7691c-004b-4910-9725-cd9be0ae1366 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:26.543781 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7691c-004b-4910-9725-cd9be0ae1366 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:26.544052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7691c-004b-4910-9725-cd9be0ae1366 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:26.549449 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354e6b8-4736-49cd-b458-0e8624f05a52 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:26.555926 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7691c-004b-4910-9725-cd9be0ae1366 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:26.564194 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-3bf7691c-004b-4910-9725-cd9be0ae1366 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:26.564194 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:26.564194 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:26.564194 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:26.564194 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:26.564194 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:26.564194 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:26.564194 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:26.564194 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:26.564194 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:26.564194 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:26.564194 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:26.564194 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:26.564194 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:26.564194 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:26.564194 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:26.565364 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:26.565364 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:26.565364 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:26.565364 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:26.565364 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:26.565364 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:26.565364 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:26.565364 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:26.565364 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:26.565364 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:26.565364 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:26.565364 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:26.565364 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:26.565364 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:26.565364 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:26.565364 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:26.566427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:26.566427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:26.566427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:26.566427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:26.566427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:26.566427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:26.566427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:26.566427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:26.566427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:26.566427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:26.566427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:26.566427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:26.570145 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 314/628] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 21 05:41:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:26.571125 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7691c-004b-4910-9725-cd9be0ae1366 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:26.591371 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcaf324-6309-45b6-b87b-8e5f13e550f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:26.592550 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcaf324-6309-45b6-b87b-8e5f13e550f7 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:26.593001 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcaf324-6309-45b6-b87b-8e5f13e550f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:26.594223 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcaf324-6309-45b6-b87b-8e5f13e550f7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:26.603457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcaf324-6309-45b6-b87b-8e5f13e550f7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:26.605398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcaf324-6309-45b6-b87b-8e5f13e550f7 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:26.621906 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-3fcaf324-6309-45b6-b87b-8e5f13e550f7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 05:41:26.621906 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:26.621906 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:26.621906 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:26.621906 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:26.621906 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:26.621906 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:26.621906 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:26.621906 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:26.621906 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:26.621906 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:26.621906 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:26.621906 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:41:26.621906 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:41:26.621906 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:41:26.621906 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:41:26.623115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:26.623115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:26.623115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:41:26.623115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:26.623115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:41:26.623115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:26.623115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:26.623115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:26.623115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:26.623115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:26.623115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:26.623115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:26.623115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:26.623115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:26.623115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:26.623115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:26.623115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:26.623115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:26.624199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:26.624199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:26.624199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:41:26.624199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:41:26.624199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:41:26.624199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:41:26.624199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:41:26.624199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:41:26.624199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 05:41:26.624199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:26.626594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 315/629] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jun 21 05:41:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:26.627540 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcaf324-6309-45b6-b87b-8e5f13e550f7 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:26.642348 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:26.694356 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7691c-004b-4910-9725-cd9be0ae1366 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:26.734181 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650df11-8af4-44dc-9059-77402c57c72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:26.735369 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650df11-8af4-44dc-9059-77402c57c72f None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:26.735925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650df11-8af4-44dc-9059-77402c57c72f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:26.736211 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650df11-8af4-44dc-9059-77402c57c72f None admin] PATH_INFO: `/v3/projects/e64b932ef6bf481cb93a04885a93b4b2/users/ac485a336d8b4360bce4f495bd02dbde/roles/b2f95849039f475c904876eb2958a375` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:26.754815 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650df11-8af4-44dc-9059-77402c57c72f None admin] RBAC: Authorizing `identity:create_grant(project_id=e64b932ef6bf481cb93a04885a93b4b2, user_id=ac485a336d8b4360bce4f495bd02dbde, role_id=b2f95849039f475c904876eb2958a375)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:26.756605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650df11-8af4-44dc-9059-77402c57c72f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:26.759474 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcaf324-6309-45b6-b87b-8e5f13e550f7 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:26.774059 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 315/630] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 21 05:41:26 2022] PUT /identity/v3/projects/e64b932ef6bf481cb93a04885a93b4b2/users/ac485a336d8b4360bce4f495bd02dbde/roles/b2f95849039f475c904876eb2958a375 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:41:26.776827 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650df11-8af4-44dc-9059-77402c57c72f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:26.805321 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1cdfc-9864-42d4-b39b-07a93e9860d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:26.806480 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1cdfc-9864-42d4-b39b-07a93e9860d3 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:26.806980 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1cdfc-9864-42d4-b39b-07a93e9860d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:26.807471 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1cdfc-9864-42d4-b39b-07a93e9860d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:26.808475 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1cdfc-9864-42d4-b39b-07a93e9860d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:26.809003 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1cdfc-9864-42d4-b39b-07a93e9860d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:26.810838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1cdfc-9864-42d4-b39b-07a93e9860d3 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:26.814731 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:26.821248 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 316/631] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 21 05:41:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:26.823133 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882770b4-043a-4b9a-bc01-bb59a30a4e0e None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:26.823685 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882770b4-043a-4b9a-bc01-bb59a30a4e0e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:26.824173 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882770b4-043a-4b9a-bc01-bb59a30a4e0e None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:26.831024 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 317/632] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:26.832333 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882770b4-043a-4b9a-bc01-bb59a30a4e0e None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:26.903065 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650df11-8af4-44dc-9059-77402c57c72f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:26.913351 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:26.946437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70536fa2-7763-44a9-b4fe-f2b716a33304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:26.947122 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70536fa2-7763-44a9-b4fe-f2b716a33304 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:26.947908 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70536fa2-7763-44a9-b4fe-f2b716a33304 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:26.947908 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70536fa2-7763-44a9-b4fe-f2b716a33304 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:26.948509 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70536fa2-7763-44a9-b4fe-f2b716a33304 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:26.949153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70536fa2-7763-44a9-b4fe-f2b716a33304 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:26.950420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70536fa2-7763-44a9-b4fe-f2b716a33304 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:26.953922 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882770b4-043a-4b9a-bc01-bb59a30a4e0e None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:26.970224 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 316/633] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jun 21 05:41:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:26.971506 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20a536-5a67-4b67-9bc7-5cfd5cd402d5 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:26.971799 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20a536-5a67-4b67-9bc7-5cfd5cd402d5 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:26.972077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20a536-5a67-4b67-9bc7-5cfd5cd402d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:26.994338 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-eb20a536-5a67-4b67-9bc7-5cfd5cd402d5 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:26.995548 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b50df-818f-47c2-9d44-b35f6afe294e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:26.995697 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-eb20a536-5a67-4b67-9bc7-5cfd5cd402d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:26.996385 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b50df-818f-47c2-9d44-b35f6afe294e None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:26.996681 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b50df-818f-47c2-9d44-b35f6afe294e None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:26.996963 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b50df-818f-47c2-9d44-b35f6afe294e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:27.013350 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b50df-818f-47c2-9d44-b35f6afe294e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:27.016511 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b50df-818f-47c2-9d44-b35f6afe294e None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:27.038075 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-087b50df-818f-47c2-9d44-b35f6afe294e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:27.038075 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:27.038075 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:27.038075 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:27.038075 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:27.038075 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:27.038075 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:27.038075 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:27.038075 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:27.038075 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:27.038075 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:27.038075 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:27.038075 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:27.038075 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:27.038075 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:27.039044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:27.039044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:27.039044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:27.039044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:27.039044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:27.039044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:27.039044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:27.039044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:27.039044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:27.039044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:27.039044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:27.039044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:27.039044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:27.039044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:27.039044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:27.039044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:27.039044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:27.039956 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:27.039956 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:27.039956 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:27.039956 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:27.039956 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 318/634] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:27.041557 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b50df-818f-47c2-9d44-b35f6afe294e None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:27.070191 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 317/635] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:41:27.071077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20a536-5a67-4b67-9bc7-5cfd5cd402d5 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:27.102364 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:27.171074 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b50df-818f-47c2-9d44-b35f6afe294e None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:27.196650 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:27.204352 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20a536-5a67-4b67-9bc7-5cfd5cd402d5 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:27.211506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11620e9-3da3-4f9c-98f3-63b4d8e01a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:27.212167 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11620e9-3da3-4f9c-98f3-63b4d8e01a72 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:27.212451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11620e9-3da3-4f9c-98f3-63b4d8e01a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:27.212722 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11620e9-3da3-4f9c-98f3-63b4d8e01a72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:27.244274 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da76791-a245-4016-b1c7-3d03582d1b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:27.244940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da76791-a245-4016-b1c7-3d03582d1b80 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:27.245221 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da76791-a245-4016-b1c7-3d03582d1b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:27.245522 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da76791-a245-4016-b1c7-3d03582d1b80 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:27.246254 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da76791-a245-4016-b1c7-3d03582d1b80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:27.246569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da76791-a245-4016-b1c7-3d03582d1b80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:27.247925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da76791-a245-4016-b1c7-3d03582d1b80 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:27.259899 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 318/636] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:27.260713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da76791-a245-4016-b1c7-3d03582d1b80 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:27.291226 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11620e9-3da3-4f9c-98f3-63b4d8e01a72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:27.292557 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11620e9-3da3-4f9c-98f3-63b4d8e01a72 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:27.348805 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:27.373038 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da76791-a245-4016-b1c7-3d03582d1b80 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:27.405281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 319/637] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:41:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:41:27.407050 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b9296-cc3b-4a6d-866d-3bd492fac3fb None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:27.407404 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b9296-cc3b-4a6d-866d-3bd492fac3fb None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:27.407752 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b9296-cc3b-4a6d-866d-3bd492fac3fb None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:27.409254 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 320/638] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:27.411281 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3fe4a-ed4e-4e30-87bc-bd488decb0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:27.412119 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3fe4a-ed4e-4e30-87bc-bd488decb0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:27.412404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3fe4a-ed4e-4e30-87bc-bd488decb0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:27.412684 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3fe4a-ed4e-4e30-87bc-bd488decb0f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:27.413892 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b9296-cc3b-4a6d-866d-3bd492fac3fb None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:27.426154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3fe4a-ed4e-4e30-87bc-bd488decb0f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:27.434748 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-faa3fe4a-ed4e-4e30-87bc-bd488decb0f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:27.434748 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:27.434748 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:27.434748 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:27.434748 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:27.434748 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:27.434748 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:27.434748 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:27.434748 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:27.434748 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:27.434748 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:27.434748 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:27.434748 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:27.434748 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:27.434748 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:27.434748 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:27.435736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:27.435736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:27.435736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:27.435736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:27.435736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:27.435736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:27.435736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:27.435736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:27.435736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:27.435736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:27.435736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:27.435736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:27.435736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:27.435736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:27.435736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:27.435736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:27.436572 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:27.436572 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:27.436572 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:27.436572 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:27.436572 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:27.436572 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:27.436572 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:27.436572 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:27.436572 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:27.436572 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:27.436572 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:27.436572 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:27.438733 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 319/639] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 21 05:41:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:27.439552 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3fe4a-ed4e-4e30-87bc-bd488decb0f8 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:27.440587 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:27.528509 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b9296-cc3b-4a6d-866d-3bd492fac3fb None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:27.565150 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3fe4a-ed4e-4e30-87bc-bd488decb0f8 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:27.566439 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c06cbe-4f82-47a0-ac2b-7239165956b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:27.567241 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c06cbe-4f82-47a0-ac2b-7239165956b9 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:27.567525 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c06cbe-4f82-47a0-ac2b-7239165956b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:27.567807 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c06cbe-4f82-47a0-ac2b-7239165956b9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:27.575619 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c06cbe-4f82-47a0-ac2b-7239165956b9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:27.577054 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c06cbe-4f82-47a0-ac2b-7239165956b9 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:27.594615 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-40c06cbe-4f82-47a0-ac2b-7239165956b9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 21 05:41:27.594615 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:27.594615 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:27.594615 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:27.594615 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:27.594615 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:27.594615 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:27.594615 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:27.594615 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:27.594615 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:27.594615 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:27.594615 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:27.594615 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:41:27.594615 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:41:27.594615 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:41:27.594615 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:41:27.595648 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:27.595648 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:27.595648 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:41:27.595648 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:27.595648 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:41:27.595648 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:27.595648 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:27.595648 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:27.595648 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:27.595648 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:27.595648 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:27.595648 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:27.595648 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:27.595648 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:27.595648 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:27.595648 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:27.595648 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:27.595648 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:27.596595 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:27.596595 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:27.596595 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:41:27.596595 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:41:27.596595 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:41:27.596595 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:41:27.596595 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:41:27.596595 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:41:27.596595 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 21 05:41:27.596595 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:27.596595 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 321/640] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:41:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:27.597205 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607bf19-7209-4316-aaae-121aa3f0ea94 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:27.597655 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607bf19-7209-4316-aaae-121aa3f0ea94 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:27.597655 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607bf19-7209-4316-aaae-121aa3f0ea94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:27.607080 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab936d2-7502-4fc9-b48a-db28e3ff2930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:27.608188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab936d2-7502-4fc9-b48a-db28e3ff2930 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:27.608671 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab936d2-7502-4fc9-b48a-db28e3ff2930 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:27.609656 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab936d2-7502-4fc9-b48a-db28e3ff2930 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:27.615426 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-b607bf19-7209-4316-aaae-121aa3f0ea94 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:27.616615 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b607bf19-7209-4316-aaae-121aa3f0ea94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:27.620814 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:27.623109 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab936d2-7502-4fc9-b48a-db28e3ff2930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:27.625770 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab936d2-7502-4fc9-b48a-db28e3ff2930 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:27.644830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-8ab936d2-7502-4fc9-b48a-db28e3ff2930 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:27.644830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:27.644830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:27.644830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:27.644830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:27.644830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:27.644830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:27.644830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:27.644830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:27.644830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:27.644830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:27.644830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:27.644830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:27.644830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:27.644830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:27.646060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:27.646060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:27.646060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:27.646060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:27.646060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:27.646060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:27.646060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:27.646060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:27.646060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:27.646060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:27.646060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:27.646060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:27.646060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:27.646060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:27.646060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:27.646060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:27.646060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:27.647443 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:27.647443 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:27.647443 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:27.647443 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:27.647443 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 320/641] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:27.647443 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab936d2-7502-4fc9-b48a-db28e3ff2930 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:27.697738 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 322/642] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:41:27.699059 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607bf19-7209-4316-aaae-121aa3f0ea94 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:27.719301 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:27.769259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab936d2-7502-4fc9-b48a-db28e3ff2930 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:27.805013 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb5608-0750-40a5-8d44-5ca30fc58d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:27.805677 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb5608-0750-40a5-8d44-5ca30fc58d45 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:27.805980 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb5608-0750-40a5-8d44-5ca30fc58d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:27.806259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb5608-0750-40a5-8d44-5ca30fc58d45 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:27.807005 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb5608-0750-40a5-8d44-5ca30fc58d45 None admin] RBAC: Adding query filter params (name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:27.807323 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb5608-0750-40a5-8d44-5ca30fc58d45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:27.808694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb5608-0750-40a5-8d44-5ca30fc58d45 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:27.809378 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607bf19-7209-4316-aaae-121aa3f0ea94 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:27.817206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 321/643] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 21 05:41:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:27.817770 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb5608-0750-40a5-8d44-5ca30fc58d45 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:27.851870 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077819df-f718-4068-ac1b-41a32f5998e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:27.852560 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077819df-f718-4068-ac1b-41a32f5998e1 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:27.852852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077819df-f718-4068-ac1b-41a32f5998e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:27.853136 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077819df-f718-4068-ac1b-41a32f5998e1 None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:27.854017 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077819df-f718-4068-ac1b-41a32f5998e1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:27.854334 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077819df-f718-4068-ac1b-41a32f5998e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:27.855863 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077819df-f718-4068-ac1b-41a32f5998e1 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:27.883015 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 323/644] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Jun 21 05:41:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:27.883557 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:27.884020 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077819df-f718-4068-ac1b-41a32f5998e1 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:27.938070 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb5608-0750-40a5-8d44-5ca30fc58d45 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:27.959802 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:27.974155 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d4074-866b-4f80-9967-abee83ef2eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:27.974828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d4074-866b-4f80-9967-abee83ef2eec None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:27.975107 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d4074-866b-4f80-9967-abee83ef2eec None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:27.975386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d4074-866b-4f80-9967-abee83ef2eec None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:27.976122 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d4074-866b-4f80-9967-abee83ef2eec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:27.976522 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d4074-866b-4f80-9967-abee83ef2eec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:27.977869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d4074-866b-4f80-9967-abee83ef2eec None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:27.994045 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 322/645] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:27.995151 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d4074-866b-4f80-9967-abee83ef2eec None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:28.004357 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077819df-f718-4068-ac1b-41a32f5998e1 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:28.043099 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88293e-ce10-4833-a7c6-bbc0682aa780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:28.043905 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88293e-ce10-4833-a7c6-bbc0682aa780 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:28.044193 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88293e-ce10-4833-a7c6-bbc0682aa780 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:28.044472 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88293e-ce10-4833-a7c6-bbc0682aa780 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:28.055226 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a88293e-ce10-4833-a7c6-bbc0682aa780 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:28.063026 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-8a88293e-ce10-4833-a7c6-bbc0682aa780 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:28.063026 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:28.063026 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:28.063026 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:28.063026 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:28.063026 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:28.063026 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:28.063026 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:28.063026 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:28.063026 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:28.063026 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:28.063026 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:28.063026 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:28.063026 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:28.063026 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:28.063026 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:28.063964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:28.063964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:28.063964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:28.063964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:28.063964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:28.063964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:28.063964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:28.063964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:28.063964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:28.063964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:28.063964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:28.063964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:28.063964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:28.063964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:28.063964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:28.063964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:28.064951 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:28.064951 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:28.064951 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:28.064951 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:28.064951 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:28.064951 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:28.064951 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:28.064951 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:28.064951 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:28.064951 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:28.064951 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:28.064951 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:28.064951 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 324/646] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 21 05:41:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:28.065714 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88293e-ce10-4833-a7c6-bbc0682aa780 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:28.123639 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d4074-866b-4f80-9967-abee83ef2eec None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:28.138472 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:28.175085 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccffc3-9864-444c-a9ab-885a7e9579ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:28.175988 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccffc3-9864-444c-a9ab-885a7e9579ce None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:28.176277 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccffc3-9864-444c-a9ab-885a7e9579ce None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:28.176563 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccffc3-9864-444c-a9ab-885a7e9579ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:28.184323 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88293e-ce10-4833-a7c6-bbc0682aa780 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:28.188488 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ccffc3-9864-444c-a9ab-885a7e9579ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:28.189990 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ccffc3-9864-444c-a9ab-885a7e9579ce None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:28.208658 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-e3ccffc3-9864-444c-a9ab-885a7e9579ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:28.208658 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:28.208658 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:28.208658 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:28.208658 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:28.208658 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:28.208658 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:28.208658 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:28.208658 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:28.208658 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:28.208658 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:28.208658 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:28.208658 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:28.208658 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:28.208658 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:28.209586 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:28.209586 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:28.209586 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:28.209586 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:28.209586 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:28.209586 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:28.209586 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:28.209586 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:28.209586 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:28.209586 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:28.209586 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:28.209586 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:28.209586 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:28.209586 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:28.209586 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:28.209586 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:28.209586 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:28.210895 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:28.210895 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:28.210895 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:28.210895 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:28.210895 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 323/647] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:28.210895 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccffc3-9864-444c-a9ab-885a7e9579ce None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:28.221121 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:28.228829 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9b4eb-15f8-4914-a6d2-eb3a6a8647c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:28.229494 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9b4eb-15f8-4914-a6d2-eb3a6a8647c9 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:28.229784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9b4eb-15f8-4914-a6d2-eb3a6a8647c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:28.230098 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9b4eb-15f8-4914-a6d2-eb3a6a8647c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:28.311153 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9b4eb-15f8-4914-a6d2-eb3a6a8647c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:28.312645 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9b4eb-15f8-4914-a6d2-eb3a6a8647c9 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:28.331227 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccffc3-9864-444c-a9ab-885a7e9579ce None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:28.376830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95138f95-b1f0-4d0d-b559-213756cffe0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:28.377538 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95138f95-b1f0-4d0d-b559-213756cffe0f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:28.377826 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95138f95-b1f0-4d0d-b559-213756cffe0f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:28.378149 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95138f95-b1f0-4d0d-b559-213756cffe0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:28.385316 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95138f95-b1f0-4d0d-b559-213756cffe0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:28.386868 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95138f95-b1f0-4d0d-b559-213756cffe0f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:28.401765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-95138f95-b1f0-4d0d-b559-213756cffe0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:28.401765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:28.401765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:28.401765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:28.401765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:28.401765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:28.401765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:28.401765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:28.401765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:28.401765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:28.401765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:28.401765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:28.401765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:41:28.401765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:41:28.401765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:41:28.402816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:41:28.402816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:28.402816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:28.402816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:28.402816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:28.402816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:28.402816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:28.402816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:28.402816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:28.402816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:28.402816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:28.402816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:28.402816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:28.402816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:28.402816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:28.402816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:28.402816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:28.403754 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:41:28.403754 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:41:28.403754 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:41:28.403754 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:41:28.403754 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:41:28.403754 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:41:28.403754 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:28.403754 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:28.403754 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 324/648] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:28.404245 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95138f95-b1f0-4d0d-b559-213756cffe0f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:28.433737 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 325/649] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:41:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:41:28.434975 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9b4eb-15f8-4914-a6d2-eb3a6a8647c9 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:28.443373 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:28.467919 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:28.539942 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95138f95-b1f0-4d0d-b559-213756cffe0f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:28.560200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9b4eb-15f8-4914-a6d2-eb3a6a8647c9 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:28.585169 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85050d7-5abd-4854-a7b0-a37c4f62b76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:28.586239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85050d7-5abd-4854-a7b0-a37c4f62b76a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:28.586756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85050d7-5abd-4854-a7b0-a37c4f62b76a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:28.587247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85050d7-5abd-4854-a7b0-a37c4f62b76a None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:28.588202 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85050d7-5abd-4854-a7b0-a37c4f62b76a None admin] RBAC: Adding query filter params (name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:28.588712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85050d7-5abd-4854-a7b0-a37c4f62b76a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:28.590325 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85050d7-5abd-4854-a7b0-a37c4f62b76a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:28.600078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 325/650] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 21 05:41:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:28.603868 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c100bf-d386-4174-9492-a99cac10315a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:28.605448 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c100bf-d386-4174-9492-a99cac10315a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:28.605448 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c100bf-d386-4174-9492-a99cac10315a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:28.605448 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c100bf-d386-4174-9492-a99cac10315a None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:28.605758 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85050d7-5abd-4854-a7b0-a37c4f62b76a None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:28.606646 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c100bf-d386-4174-9492-a99cac10315a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:28.606646 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c100bf-d386-4174-9492-a99cac10315a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:28.607917 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c100bf-d386-4174-9492-a99cac10315a None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:28.621621 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 326/651] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:28.622309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c100bf-d386-4174-9492-a99cac10315a None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:28.719024 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:28.738785 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85050d7-5abd-4854-a7b0-a37c4f62b76a None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:28.746805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:28.758386 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c100bf-d386-4174-9492-a99cac10315a None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:28.778322 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9ee0f-bd7f-40a4-a4c1-7705d65162c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:28.779054 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9ee0f-bd7f-40a4-a4c1-7705d65162c5 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:28.779418 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9ee0f-bd7f-40a4-a4c1-7705d65162c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:28.779689 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9ee0f-bd7f-40a4-a4c1-7705d65162c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:28.780477 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9ee0f-bd7f-40a4-a4c1-7705d65162c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:28.781349 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9ee0f-bd7f-40a4-a4c1-7705d65162c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:28.782819 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9ee0f-bd7f-40a4-a4c1-7705d65162c5 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:28.797311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 326/652] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:41:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:28.797913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9ee0f-bd7f-40a4-a4c1-7705d65162c5 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:28.808492 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bda18-71c9-46eb-aca0-28a94d579031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:28.809293 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bda18-71c9-46eb-aca0-28a94d579031 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:28.809583 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bda18-71c9-46eb-aca0-28a94d579031 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:28.809858 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bda18-71c9-46eb-aca0-28a94d579031 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:28.821311 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1bda18-71c9-46eb-aca0-28a94d579031 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:28.822817 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1bda18-71c9-46eb-aca0-28a94d579031 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:28.841311 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-6d1bda18-71c9-46eb-aca0-28a94d579031 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:28.841311 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:28.841311 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:28.841311 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:28.841311 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:28.841311 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:28.841311 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:28.841311 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:28.841311 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:28.841311 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:28.841311 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:28.841311 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:28.841311 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:28.841311 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:28.841311 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:28.842393 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:28.842393 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:28.842393 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:28.842393 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:28.842393 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:28.842393 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:28.842393 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:28.842393 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:28.842393 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:28.842393 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:28.842393 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:28.842393 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:28.842393 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:28.842393 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:28.842393 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:28.842393 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:28.842393 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:28.843876 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:28.843876 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:28.843876 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:28.843876 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:28.843876 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 327/653] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:28.844151 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bda18-71c9-46eb-aca0-28a94d579031 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:28.929438 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9ee0f-bd7f-40a4-a4c1-7705d65162c5 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:28.956358 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bda18-71c9-46eb-aca0-28a94d579031 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:28.963535 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e31b83-1f18-458b-bbf5-8b7fc7e693fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:28.964334 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e31b83-1f18-458b-bbf5-8b7fc7e693fa None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:28.964617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e31b83-1f18-458b-bbf5-8b7fc7e693fa None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:28.964895 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e31b83-1f18-458b-bbf5-8b7fc7e693fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:28.976156 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e31b83-1f18-458b-bbf5-8b7fc7e693fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:28.977539 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e31b83-1f18-458b-bbf5-8b7fc7e693fa None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:28.986421 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:28.997583 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2257698-1c02-408d-bd23-f74bf5a8d4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:28.997772 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-e3e31b83-1f18-458b-bbf5-8b7fc7e693fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:28.997772 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:28.997772 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:28.997772 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:28.997772 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:28.997772 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:28.997772 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:28.997772 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:28.997772 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:28.997772 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:28.997772 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:28.997772 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:28.997772 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:28.997772 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:28.997772 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:28.999511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:28.999511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:28.999511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:28.999511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:28.999511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:28.999511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:28.999511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:28.999511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:28.999511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:28.999511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:28.999511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:28.999511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:28.999511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:28.999511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:28.999511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:28.999511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:28.999511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:29.000623 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:29.000623 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:29.000623 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:29.000623 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:29.000902 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2257698-1c02-408d-bd23-f74bf5a8d4ff None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:29.000902 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2257698-1c02-408d-bd23-f74bf5a8d4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:29.000902 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2257698-1c02-408d-bd23-f74bf5a8d4ff None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:29.002249 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 327/654] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:29.003131 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e31b83-1f18-458b-bbf5-8b7fc7e693fa None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:29.009146 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2257698-1c02-408d-bd23-f74bf5a8d4ff None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:29.010631 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2257698-1c02-408d-bd23-f74bf5a8d4ff None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:29.028813 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-f2257698-1c02-408d-bd23-f74bf5a8d4ff None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 05:41:29.028813 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:29.028813 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:29.028813 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:29.028813 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:29.028813 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:29.028813 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:29.028813 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:29.028813 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:29.028813 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:29.028813 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:29.028813 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:29.028813 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:41:29.028813 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:41:29.028813 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:41:29.028813 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:41:29.029982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:29.029982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:29.029982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:41:29.029982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:29.029982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:41:29.029982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:29.029982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:29.029982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:29.029982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:29.029982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:29.029982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:29.029982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:29.029982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:29.029982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:29.029982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:29.029982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:29.029982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:29.029982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:29.031490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:29.031490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:29.031490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:41:29.031490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:41:29.031490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:41:29.031490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:41:29.031490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:41:29.031490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:41:29.031490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 05:41:29.031490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:29.031490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 328/655] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:41:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:29.031490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2257698-1c02-408d-bd23-f74bf5a8d4ff None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:29.035079 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:29.116491 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e31b83-1f18-458b-bbf5-8b7fc7e693fa None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:29.143949 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2257698-1c02-408d-bd23-f74bf5a8d4ff None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:29.158317 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2397f-1414-4415-acbd-19d45712a814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:29.159110 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2397f-1414-4415-acbd-19d45712a814 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:29.159569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2397f-1414-4415-acbd-19d45712a814 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:29.160032 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2397f-1414-4415-acbd-19d45712a814 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:29.161482 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2397f-1414-4415-acbd-19d45712a814 None admin] RBAC: Adding query filter params (role.id=b2f95849039f475c904876eb2958a375, scope.project.id=e64b932ef6bf481cb93a04885a93b4b2, user.id=f702830987ba4548a4c2ee3d0e302d02) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:29.161838 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2397f-1414-4415-acbd-19d45712a814 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:29.163654 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2397f-1414-4415-acbd-19d45712a814 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:29.171316 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 328/656] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:41:29 2022] GET /identity/v3/role_assignments?user.id=f702830987ba4548a4c2ee3d0e302d02&scope.project.id=e64b932ef6bf481cb93a04885a93b4b2&role.id=b2f95849039f475c904876eb2958a375 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:29.171316 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7daccb-8b98-4aee-b52a-8febf6ed6436 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:29.171316 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7daccb-8b98-4aee-b52a-8febf6ed6436 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:29.171666 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7daccb-8b98-4aee-b52a-8febf6ed6436 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:29.172775 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 329/657] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:29.173489 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7daccb-8b98-4aee-b52a-8febf6ed6436 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:29.184933 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0bde02-78ba-4140-9702-8ba18ce898d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:29.185777 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bde02-78ba-4140-9702-8ba18ce898d7 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:29.186131 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bde02-78ba-4140-9702-8ba18ce898d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:29.186503 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bde02-78ba-4140-9702-8ba18ce898d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:29.187800 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0bde02-78ba-4140-9702-8ba18ce898d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:29.188113 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0bde02-78ba-4140-9702-8ba18ce898d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:29.190555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0bde02-78ba-4140-9702-8ba18ce898d7 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:29.210215 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 329/658] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:29.211217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0bde02-78ba-4140-9702-8ba18ce898d7 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:29.261542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:29.298585 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:29.310578 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7daccb-8b98-4aee-b52a-8febf6ed6436 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:29.354676 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0bde02-78ba-4140-9702-8ba18ce898d7 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:29.357846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c793a5-0e27-43bb-beb8-d814138f6e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:29.359377 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c793a5-0e27-43bb-beb8-d814138f6e28 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:29.359377 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c793a5-0e27-43bb-beb8-d814138f6e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:29.359377 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c793a5-0e27-43bb-beb8-d814138f6e28 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:29.359854 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c793a5-0e27-43bb-beb8-d814138f6e28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:29.360970 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c793a5-0e27-43bb-beb8-d814138f6e28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:29.361551 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c793a5-0e27-43bb-beb8-d814138f6e28 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:29.381070 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 330/659] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:29.382422 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fef89-4d25-4a09-a325-a2c1f7b26f65 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:29.382722 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fef89-4d25-4a09-a325-a2c1f7b26f65 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:29.382997 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fef89-4d25-4a09-a325-a2c1f7b26f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:29.402219 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-fd4fef89-4d25-4a09-a325-a2c1f7b26f65 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:29.402528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0d5e5-f273-4f5c-b3cf-6a301bf5db0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:29.403182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0d5e5-f273-4f5c-b3cf-6a301bf5db0a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:29.403437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-fd4fef89-4d25-4a09-a325-a2c1f7b26f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:29.403541 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0d5e5-f273-4f5c-b3cf-6a301bf5db0a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:29.403965 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0d5e5-f273-4f5c-b3cf-6a301bf5db0a None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:29.404561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0d5e5-f273-4f5c-b3cf-6a301bf5db0a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:29.404876 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0d5e5-f273-4f5c-b3cf-6a301bf5db0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:29.406371 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0d5e5-f273-4f5c-b3cf-6a301bf5db0a None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:29.437963 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 330/660] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Jun 21 05:41:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:29.438887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0d5e5-f273-4f5c-b3cf-6a301bf5db0a None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:29.494168 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 331/661] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:41:29.494168 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fef89-4d25-4a09-a325-a2c1f7b26f65 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:29.565559 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:29.573513 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0d5e5-f273-4f5c-b3cf-6a301bf5db0a None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:29.595647 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:29.612146 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584662d2-addd-4802-8b4f-4ea1e162bdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:29.612978 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584662d2-addd-4802-8b4f-4ea1e162bdb2 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:29.613256 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584662d2-addd-4802-8b4f-4ea1e162bdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:29.613526 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584662d2-addd-4802-8b4f-4ea1e162bdb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:29.621118 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584662d2-addd-4802-8b4f-4ea1e162bdb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:29.621283 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fef89-4d25-4a09-a325-a2c1f7b26f65 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:29.622677 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584662d2-addd-4802-8b4f-4ea1e162bdb2 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:29.637542 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-584662d2-addd-4802-8b4f-4ea1e162bdb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:29.637542 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:29.637542 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:29.637542 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:29.637542 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:29.637542 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:29.637542 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:29.637542 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:29.637542 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:29.637542 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:29.637542 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:29.637542 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:29.637542 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:41:29.637542 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:41:29.637542 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:41:29.638535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:41:29.638535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:29.638535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:29.638535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:29.638535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:29.638535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:29.638535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:29.638535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:29.638535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:29.638535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:29.638535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:29.638535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:29.638535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:29.638535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:29.638535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:29.638535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:29.638535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:29.639451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:41:29.639451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:41:29.639451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:41:29.639451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:41:29.639451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:41:29.639451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:41:29.639451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:29.639451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:29.643508 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 331/662] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:29.644376 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584662d2-addd-4802-8b4f-4ea1e162bdb2 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:29.662937 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba2cc4-f117-47dc-89fa-f22689ce86cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:29.663862 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba2cc4-f117-47dc-89fa-f22689ce86cc None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:29.664151 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba2cc4-f117-47dc-89fa-f22689ce86cc None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:29.664424 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba2cc4-f117-47dc-89fa-f22689ce86cc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:29.672670 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba2cc4-f117-47dc-89fa-f22689ce86cc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:29.674193 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba2cc4-f117-47dc-89fa-f22689ce86cc None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:29.690065 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-4eba2cc4-f117-47dc-89fa-f22689ce86cc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 05:41:29.690065 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:29.690065 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:29.690065 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:29.690065 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:29.690065 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:29.690065 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:29.690065 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:29.690065 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:29.690065 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:29.690065 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:29.690065 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:29.690065 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:41:29.690065 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:41:29.690065 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:41:29.690065 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:41:29.691252 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:29.691252 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:29.691252 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:41:29.691252 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:29.691252 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:41:29.691252 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:29.691252 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:29.691252 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:29.691252 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:29.691252 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:29.691252 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:29.691252 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:29.691252 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:29.691252 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:29.691252 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:29.691252 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:29.691252 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:29.691252 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:29.692493 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:29.692493 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:29.692493 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:41:29.692493 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:41:29.692493 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:41:29.692493 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:41:29.692493 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:41:29.692493 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:41:29.692493 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 05:41:29.692493 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:29.695806 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 332/663] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 21 05:41:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:29.696733 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba2cc4-f117-47dc-89fa-f22689ce86cc None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:29.768745 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584662d2-addd-4802-8b4f-4ea1e162bdb2 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:29.805620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba2cc4-f117-47dc-89fa-f22689ce86cc None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:29.807437 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07f63e-454a-4cad-9076-0d133d9c0c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:29.808073 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07f63e-454a-4cad-9076-0d133d9c0c95 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:29.808360 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07f63e-454a-4cad-9076-0d133d9c0c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:29.808641 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07f63e-454a-4cad-9076-0d133d9c0c95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:29.822192 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:29.845693 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca86f3-4e69-45fc-868f-709fd08ad610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:29.846523 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca86f3-4e69-45fc-868f-709fd08ad610 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:29.846805 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca86f3-4e69-45fc-868f-709fd08ad610 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:29.847077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca86f3-4e69-45fc-868f-709fd08ad610 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:29.857895 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca86f3-4e69-45fc-868f-709fd08ad610 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:29.861554 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:29.866991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-0aca86f3-4e69-45fc-868f-709fd08ad610 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:29.866991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:29.866991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:29.866991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:29.866991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:29.866991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:29.866991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:29.866991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:29.866991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:29.866991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:29.866991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:29.866991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:29.866991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:29.866991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:29.866991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:29.866991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:29.867959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:29.867959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:29.867959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:29.867959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:29.867959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:29.867959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:29.867959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:29.867959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:29.867959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:29.867959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:29.867959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:29.867959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:29.867959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:29.867959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:29.867959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:29.867959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:29.868798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:29.868798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:29.868798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:29.868798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:29.868798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:29.868798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:29.868798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:29.868798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:29.868798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:29.868798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:29.868798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:29.868798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:29.868798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 333/664] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 21 05:41:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:29.869480 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca86f3-4e69-45fc-868f-709fd08ad610 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:29.889635 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07f63e-454a-4cad-9076-0d133d9c0c95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:29.891317 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07f63e-454a-4cad-9076-0d133d9c0c95 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:29.978803 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca86f3-4e69-45fc-868f-709fd08ad610 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:30.006522 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 332/665] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:41:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:41:30.007458 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07f63e-454a-4cad-9076-0d133d9c0c95 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:30.013784 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3d0ed-effe-44b3-9c3c-aadc81565683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:30.014481 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3d0ed-effe-44b3-9c3c-aadc81565683 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:30.014766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3d0ed-effe-44b3-9c3c-aadc81565683 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:30.015122 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3d0ed-effe-44b3-9c3c-aadc81565683 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:30.015885 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3d0ed-effe-44b3-9c3c-aadc81565683 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:30.016186 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3d0ed-effe-44b3-9c3c-aadc81565683 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:30.017630 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3d0ed-effe-44b3-9c3c-aadc81565683 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:30.030396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 334/666] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:41:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:30.031782 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3d0ed-effe-44b3-9c3c-aadc81565683 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:30.070115 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:30.104344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:30.131146 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07f63e-454a-4cad-9076-0d133d9c0c95 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:30.145688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3d0ed-effe-44b3-9c3c-aadc81565683 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:30.166784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390e9be-117e-442d-ac79-3feaef5ef2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:30.167460 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390e9be-117e-442d-ac79-3feaef5ef2ad None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:30.167746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390e9be-117e-442d-ac79-3feaef5ef2ad None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:30.168024 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390e9be-117e-442d-ac79-3feaef5ef2ad None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:30.168863 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390e9be-117e-442d-ac79-3feaef5ef2ad None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:30.169175 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390e9be-117e-442d-ac79-3feaef5ef2ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:30.170630 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390e9be-117e-442d-ac79-3feaef5ef2ad None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:30.187364 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46500187-b369-4ded-97f4-6549f2217c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:30.188033 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46500187-b369-4ded-97f4-6549f2217c63 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:30.188316 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46500187-b369-4ded-97f4-6549f2217c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:30.193125 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46500187-b369-4ded-97f4-6549f2217c63 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:30.193275 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 333/667] 10.222.0.18 () {56 vars in 1139 bytes} [Tue Jun 21 05:41:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:30.193661 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46500187-b369-4ded-97f4-6549f2217c63 None admin] RBAC: Adding query filter params (name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:30.193750 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390e9be-117e-442d-ac79-3feaef5ef2ad None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:30.193833 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46500187-b369-4ded-97f4-6549f2217c63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:30.193833 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46500187-b369-4ded-97f4-6549f2217c63 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:30.205679 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 335/668] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 21 05:41:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:30.205679 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46500187-b369-4ded-97f4-6549f2217c63 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:30.294573 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390e9be-117e-442d-ac79-3feaef5ef2ad None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:30.299905 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:30.306945 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46500187-b369-4ded-97f4-6549f2217c63 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:30.330118 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07c3c6-c5fb-47a0-a466-8c7aa4234916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:30.331020 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07c3c6-c5fb-47a0-a466-8c7aa4234916 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:30.331293 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07c3c6-c5fb-47a0-a466-8c7aa4234916 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:30.331576 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07c3c6-c5fb-47a0-a466-8c7aa4234916 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:30.338969 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:30.341611 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c4866-fa16-49c4-8e57-78d7ad7a2d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:30.342308 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c4866-fa16-49c4-8e57-78d7ad7a2d73 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:30.342599 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c4866-fa16-49c4-8e57-78d7ad7a2d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:30.342872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c4866-fa16-49c4-8e57-78d7ad7a2d73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:30.344272 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c4866-fa16-49c4-8e57-78d7ad7a2d73 None admin] RBAC: Adding query filter params (role.id=b2f95849039f475c904876eb2958a375, scope.project.id=e64b932ef6bf481cb93a04885a93b4b2, user.id=d44776834b134ae98fa28d4741cc4ec3) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:30.344642 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c4866-fa16-49c4-8e57-78d7ad7a2d73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:30.346067 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c4866-fa16-49c4-8e57-78d7ad7a2d73 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:30.346187 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07c3c6-c5fb-47a0-a466-8c7aa4234916 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:30.347556 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07c3c6-c5fb-47a0-a466-8c7aa4234916 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:30.354759 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 336/669] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:41:30 2022] GET /identity/v3/role_assignments?user.id=d44776834b134ae98fa28d4741cc4ec3&scope.project.id=e64b932ef6bf481cb93a04885a93b4b2&role.id=b2f95849039f475c904876eb2958a375 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:30.355421 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c4866-fa16-49c4-8e57-78d7ad7a2d73 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:30.368097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-cc07c3c6-c5fb-47a0-a466-8c7aa4234916 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:30.368097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:30.368097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:30.368097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:30.368097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:30.368097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:30.368097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:30.368097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:30.368097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:30.368097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:30.368097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:30.368097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:30.368097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:30.368097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:30.368097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:30.369052 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:30.369052 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:30.369052 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:30.369052 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:30.369052 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:30.369052 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:30.369052 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:30.369052 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:30.369052 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:30.369052 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:30.369052 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:30.369052 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:30.369052 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:30.369052 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:30.369052 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:30.369052 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:30.369052 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:30.370083 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:30.370083 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:30.370083 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:30.370083 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:30.376655 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 334/670] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:30.377875 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07c3c6-c5fb-47a0-a466-8c7aa4234916 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:30.487701 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c4866-fa16-49c4-8e57-78d7ad7a2d73 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:30.508938 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07c3c6-c5fb-47a0-a466-8c7aa4234916 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:30.534953 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c535925-35a0-4b8e-a37d-244f20c8612c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:30.536183 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c535925-35a0-4b8e-a37d-244f20c8612c None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:30.536469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c535925-35a0-4b8e-a37d-244f20c8612c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:30.538067 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c535925-35a0-4b8e-a37d-244f20c8612c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:30.557318 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90044d59-fcbe-457c-ba55-66d19d0af385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:30.558334 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90044d59-fcbe-457c-ba55-66d19d0af385 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:30.558614 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90044d59-fcbe-457c-ba55-66d19d0af385 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:30.558885 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90044d59-fcbe-457c-ba55-66d19d0af385 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:30.572796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90044d59-fcbe-457c-ba55-66d19d0af385 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:30.574772 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90044d59-fcbe-457c-ba55-66d19d0af385 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:30.577359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:30.599457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-90044d59-fcbe-457c-ba55-66d19d0af385 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:30.599457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:30.599457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:30.599457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:30.599457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:30.599457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:30.599457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:30.599457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:30.599457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:30.599457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:30.599457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:30.599457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:30.599457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:30.599457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:30.599457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:30.600443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:30.600443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:30.600443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:30.600443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:30.600443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:30.600443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:30.600443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:30.600443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:30.600443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:30.600443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:30.600443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:30.600443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:30.600443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:30.600443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:30.600443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:30.600443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:30.600443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:30.601346 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:30.601346 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:30.601346 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:30.601346 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:30.601346 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 335/671] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:30.602138 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90044d59-fcbe-457c-ba55-66d19d0af385 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:30.643300 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c535925-35a0-4b8e-a37d-244f20c8612c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:30.644768 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c535925-35a0-4b8e-a37d-244f20c8612c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:30.683289 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:30.741766 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90044d59-fcbe-457c-ba55-66d19d0af385 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:30.756507 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 337/672] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:41:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:41:30.757377 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c535925-35a0-4b8e-a37d-244f20c8612c None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:30.783370 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46d6ee-7a3d-4586-a089-98742d18748d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:30.784352 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46d6ee-7a3d-4586-a089-98742d18748d None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:30.784858 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46d6ee-7a3d-4586-a089-98742d18748d None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:30.785332 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46d6ee-7a3d-4586-a089-98742d18748d None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:30.786308 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46d6ee-7a3d-4586-a089-98742d18748d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:30.786804 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46d6ee-7a3d-4586-a089-98742d18748d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:30.788445 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46d6ee-7a3d-4586-a089-98742d18748d None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:30.801776 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 336/673] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:30.803050 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46d6ee-7a3d-4586-a089-98742d18748d None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:30.836014 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:30.881872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c535925-35a0-4b8e-a37d-244f20c8612c None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:30.914254 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46d6ee-7a3d-4586-a089-98742d18748d None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:30.916445 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:30.917881 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b144d-bc98-4d1c-9387-4d65378e4cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:30.919292 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b144d-bc98-4d1c-9387-4d65378e4cdc None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:30.919292 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b144d-bc98-4d1c-9387-4d65378e4cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:30.919292 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b144d-bc98-4d1c-9387-4d65378e4cdc None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:30.919868 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b144d-bc98-4d1c-9387-4d65378e4cdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:30.921635 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b144d-bc98-4d1c-9387-4d65378e4cdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:30.921635 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b144d-bc98-4d1c-9387-4d65378e4cdc None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:30.939097 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 338/674] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:30.939979 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b144d-bc98-4d1c-9387-4d65378e4cdc None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:30.957434 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd4cc9-9946-46da-96bf-18666132fcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:30.958616 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd4cc9-9946-46da-96bf-18666132fcd2 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:30.959085 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd4cc9-9946-46da-96bf-18666132fcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:30.959544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd4cc9-9946-46da-96bf-18666132fcd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:30.971675 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd4cc9-9946-46da-96bf-18666132fcd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:30.973466 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd4cc9-9946-46da-96bf-18666132fcd2 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:30.993510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-f4fd4cc9-9946-46da-96bf-18666132fcd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:30.993510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:30.993510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:30.993510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:30.993510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:30.993510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:30.993510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:30.993510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:30.993510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:30.993510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:30.993510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:30.993510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:30.993510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:30.993510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:30.993510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:30.994726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:30.994726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:30.994726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:30.994726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:30.994726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:30.994726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:30.994726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:30.994726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:30.994726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:30.994726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:30.994726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:30.994726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:30.994726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:30.994726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:30.994726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:30.994726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:30.994726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:30.995629 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:30.995629 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:30.995629 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:30.995629 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:30.998118 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 337/675] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:30.999192 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd4cc9-9946-46da-96bf-18666132fcd2 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:31.052619 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b144d-bc98-4d1c-9387-4d65378e4cdc None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:31.073738 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:31.089643 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b277ac-5e9f-402b-adc3-70ef9b467af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:31.090768 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b277ac-5e9f-402b-adc3-70ef9b467af0 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:31.090942 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b277ac-5e9f-402b-adc3-70ef9b467af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:31.091286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b277ac-5e9f-402b-adc3-70ef9b467af0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:31.104523 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b277ac-5e9f-402b-adc3-70ef9b467af0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:31.106130 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b277ac-5e9f-402b-adc3-70ef9b467af0 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:31.118233 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd4cc9-9946-46da-96bf-18666132fcd2 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:31.125958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-f3b277ac-5e9f-402b-adc3-70ef9b467af0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:31.125958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:31.125958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:31.125958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:31.125958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:31.125958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:31.125958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:31.125958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:31.125958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:31.125958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:31.125958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:31.125958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:31.125958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:41:31.125958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:41:31.125958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:41:31.127079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:41:31.127079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:31.127079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:31.127079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:31.127079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:31.127079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:31.127079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:31.127079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:31.127079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:31.127079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:31.127079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:31.127079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:31.127079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:31.127079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:31.127079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:31.127079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:31.127079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:31.128185 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:41:31.128185 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:41:31.128185 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:41:31.128185 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:41:31.128185 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:41:31.128185 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:41:31.128185 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:31.128185 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:31.129457 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 339/676] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:31.130438 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b277ac-5e9f-402b-adc3-70ef9b467af0 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:31.162458 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad9851-6d7f-43ee-a6ea-2c9ae3cff7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:31.163618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad9851-6d7f-43ee-a6ea-2c9ae3cff7df None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:31.164086 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad9851-6d7f-43ee-a6ea-2c9ae3cff7df None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:31.164655 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad9851-6d7f-43ee-a6ea-2c9ae3cff7df None admin] PATH_INFO: `/v3/users/swift` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:31.174080 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad9851-6d7f-43ee-a6ea-2c9ae3cff7df None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:31.175970 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad9851-6d7f-43ee-a6ea-2c9ae3cff7df None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:31.192949 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-b9ad9851-6d7f-43ee-a6ea-2c9ae3cff7df None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 05:41:31.192949 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:31.192949 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:31.192949 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:31.192949 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:31.192949 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:31.192949 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:31.192949 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:31.192949 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:31.192949 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:31.192949 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:31.192949 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:31.192949 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:41:31.192949 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:41:31.192949 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:41:31.192949 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:41:31.194452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:31.194452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:31.194452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:41:31.194452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:31.194452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:41:31.194452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:31.194452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:31.194452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:31.194452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:31.194452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:31.194452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:31.194452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:31.194452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:31.194452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:31.194452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:31.194452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:31.194452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:31.194452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:31.195396 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:31.195396 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:31.195396 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:41:31.195396 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:41:31.195396 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:41:31.195396 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:41:31.195396 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:41:31.195396 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:41:31.195396 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 05:41:31.195396 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:31.198244 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 338/677] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:41:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:31.199369 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad9851-6d7f-43ee-a6ea-2c9ae3cff7df None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:31.218150 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:31.255922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b277ac-5e9f-402b-adc3-70ef9b467af0 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:31.293923 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933905fa-0321-49f2-817d-21650a59e29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:31.294612 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933905fa-0321-49f2-817d-21650a59e29f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:31.295025 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933905fa-0321-49f2-817d-21650a59e29f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:31.295267 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933905fa-0321-49f2-817d-21650a59e29f None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:31.295989 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933905fa-0321-49f2-817d-21650a59e29f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:31.297205 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933905fa-0321-49f2-817d-21650a59e29f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:31.298429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933905fa-0321-49f2-817d-21650a59e29f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:31.315911 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 340/678] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:31.316816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933905fa-0321-49f2-817d-21650a59e29f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:31.317685 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad9851-6d7f-43ee-a6ea-2c9ae3cff7df None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:31.355266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3233c-270d-4634-999c-2278278b6c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:31.356504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3233c-270d-4634-999c-2278278b6c0d None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:31.357000 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3233c-270d-4634-999c-2278278b6c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:31.357456 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3233c-270d-4634-999c-2278278b6c0d None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:31.358459 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3233c-270d-4634-999c-2278278b6c0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:31.359478 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3233c-270d-4634-999c-2278278b6c0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:31.361243 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3233c-270d-4634-999c-2278278b6c0d None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:31.362280 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:31.376504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 339/679] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:41:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:31.378242 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3233c-270d-4634-999c-2278278b6c0d None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:31.432598 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933905fa-0321-49f2-817d-21650a59e29f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:31.460687 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:31.478269 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a54985-aa36-4d27-8b24-847845bdeffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:31.479068 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a54985-aa36-4d27-8b24-847845bdeffc None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:31.479511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a54985-aa36-4d27-8b24-847845bdeffc None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:31.479799 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a54985-aa36-4d27-8b24-847845bdeffc None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:31.480653 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a54985-aa36-4d27-8b24-847845bdeffc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:31.480963 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a54985-aa36-4d27-8b24-847845bdeffc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:31.482924 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a54985-aa36-4d27-8b24-847845bdeffc None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:31.485887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3233c-270d-4634-999c-2278278b6c0d None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:31.502665 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 341/680] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Jun 21 05:41:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:31.503935 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e76b53-ee9b-409e-90d5-42d505454bc4 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:31.504433 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e76b53-ee9b-409e-90d5-42d505454bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:31.504919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e76b53-ee9b-409e-90d5-42d505454bc4 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:31.510070 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 342/681] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:31.510070 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e76b53-ee9b-409e-90d5-42d505454bc4 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:31.528747 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f42a24-829c-4efa-9149-e9296e2a0f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:31.529556 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f42a24-829c-4efa-9149-e9296e2a0f11 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:31.529892 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f42a24-829c-4efa-9149-e9296e2a0f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:31.530204 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f42a24-829c-4efa-9149-e9296e2a0f11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:31.537881 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f42a24-829c-4efa-9149-e9296e2a0f11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:31.539351 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f42a24-829c-4efa-9149-e9296e2a0f11 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:31.553827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-80f42a24-829c-4efa-9149-e9296e2a0f11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:31.553827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:31.553827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:31.553827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:31.553827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:31.553827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:31.553827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:31.553827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:31.553827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:31.553827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:31.553827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:31.553827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:31.553827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:41:31.553827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:41:31.553827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:41:31.554883 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:41:31.554883 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:31.554883 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:31.554883 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:31.554883 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:31.554883 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:31.554883 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:31.554883 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:31.554883 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:31.554883 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:31.554883 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:31.554883 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:31.554883 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:31.554883 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:31.554883 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:31.554883 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:31.554883 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:31.555997 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:41:31.555997 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:41:31.555997 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:41:31.555997 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:41:31.555997 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:41:31.555997 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:41:31.555997 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:31.555997 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:31.559654 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 340/682] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:31.560585 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f42a24-829c-4efa-9149-e9296e2a0f11 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:31.635421 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:31.641208 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e76b53-ee9b-409e-90d5-42d505454bc4 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:31.670634 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f42a24-829c-4efa-9149-e9296e2a0f11 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:31.677502 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e2c43-997a-4094-b1dd-9039d610fa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:31.678189 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e2c43-997a-4094-b1dd-9039d610fa6a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:31.678479 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e2c43-997a-4094-b1dd-9039d610fa6a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:31.678755 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e2c43-997a-4094-b1dd-9039d610fa6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:31.679651 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e2c43-997a-4094-b1dd-9039d610fa6a None admin] RBAC: Adding query filter params (role.id=b2f95849039f475c904876eb2958a375, scope.project.id=e64b932ef6bf481cb93a04885a93b4b2, user.id=5c13a614e6b04b3a93247e3790f96240) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:31.679969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e2c43-997a-4094-b1dd-9039d610fa6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:31.681403 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e2c43-997a-4094-b1dd-9039d610fa6a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:31.687513 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 343/683] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:41:31 2022] GET /identity/v3/role_assignments?user.id=5c13a614e6b04b3a93247e3790f96240&scope.project.id=e64b932ef6bf481cb93a04885a93b4b2&role.id=b2f95849039f475c904876eb2958a375 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:31.688657 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acbf5f-a8f8-486f-ba04-9d88393b05f5 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:31.688946 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acbf5f-a8f8-486f-ba04-9d88393b05f5 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:31.689223 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acbf5f-a8f8-486f-ba04-9d88393b05f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:31.709884 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-89acbf5f-a8f8-486f-ba04-9d88393b05f5 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:31.711184 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-89acbf5f-a8f8-486f-ba04-9d88393b05f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:31.724434 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b58620-4439-494f-baa7-68f9da368dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:31.725467 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b58620-4439-494f-baa7-68f9da368dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:31.725997 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b58620-4439-494f-baa7-68f9da368dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:31.726481 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b58620-4439-494f-baa7-68f9da368dd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:31.738158 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:31.791510 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 344/684] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:41:31.792391 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acbf5f-a8f8-486f-ba04-9d88393b05f5 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:31.818248 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b58620-4439-494f-baa7-68f9da368dd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:31.819826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b58620-4439-494f-baa7-68f9da368dd5 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:31.899136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:31.911022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acbf5f-a8f8-486f-ba04-9d88393b05f5 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:31.946835 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 341/685] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:41:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:41:31.947621 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b58620-4439-494f-baa7-68f9da368dd5 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:31.956019 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f4b28-9416-43ff-88bd-60809b757164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:31.957089 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f4b28-9416-43ff-88bd-60809b757164 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:31.957599 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f4b28-9416-43ff-88bd-60809b757164 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:31.958148 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f4b28-9416-43ff-88bd-60809b757164 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:31.959270 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f4b28-9416-43ff-88bd-60809b757164 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:31.959653 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f4b28-9416-43ff-88bd-60809b757164 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:31.961313 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f4b28-9416-43ff-88bd-60809b757164 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:31.979085 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 345/686] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:41:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:31.980183 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f4b28-9416-43ff-88bd-60809b757164 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:31.992763 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:32.081089 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b58620-4439-494f-baa7-68f9da368dd5 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:32.113252 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f4b28-9416-43ff-88bd-60809b757164 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:32.138411 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfc9bf-7d3b-4fb8-9c84-35ad2a2b1ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:32.139222 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfc9bf-7d3b-4fb8-9c84-35ad2a2b1ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:32.139510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfc9bf-7d3b-4fb8-9c84-35ad2a2b1ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:32.139790 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfc9bf-7d3b-4fb8-9c84-35ad2a2b1ff1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:32.157719 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfc9bf-7d3b-4fb8-9c84-35ad2a2b1ff1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:32.159672 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d998eaa-af18-42f8-93ca-fb1067f56877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:32.160930 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d998eaa-af18-42f8-93ca-fb1067f56877 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:32.161467 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d998eaa-af18-42f8-93ca-fb1067f56877 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:32.162042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d998eaa-af18-42f8-93ca-fb1067f56877 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:32.168285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-31dfc9bf-7d3b-4fb8-9c84-35ad2a2b1ff1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:41:32.168285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:32.168285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:32.168285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:32.168285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:32.168285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:32.168285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:32.168285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:32.168285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:32.168285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:32.168285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:32.168285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:32.168285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:32.168285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:32.168285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:32.168285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:32.169293 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:32.169293 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:32.169293 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:32.169293 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:32.169293 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:32.169293 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:32.169293 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:32.169293 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:32.169293 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:32.169293 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:32.169293 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:32.169293 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:32.169293 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:32.169293 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:32.169293 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:32.169293 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:32.170185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:32.170185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:32.170185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:32.170185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:32.170185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:32.170185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:32.170185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:32.170185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:32.170185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:32.170185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:32.170185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:41:32.170185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:32.173093 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 342/687] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:41:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:32.175257 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfc9bf-7d3b-4fb8-9c84-35ad2a2b1ff1 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:32.181313 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d998eaa-af18-42f8-93ca-fb1067f56877 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:32.183837 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d998eaa-af18-42f8-93ca-fb1067f56877 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:32.203690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-7d998eaa-af18-42f8-93ca-fb1067f56877 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:32.203690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:32.203690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:32.203690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:32.203690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:32.203690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:32.203690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:32.203690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:32.203690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:32.203690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:32.203690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:32.203690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:32.203690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:32.203690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:32.203690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:32.204763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:32.204763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:32.204763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:32.204763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:32.204763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:32.204763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:32.204763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:32.204763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:32.204763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:32.204763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:32.204763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:32.204763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:32.204763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:32.204763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:32.204763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:32.204763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:32.204763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:32.205671 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:32.205671 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:32.205671 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:32.205671 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:32.206206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 346/688] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:32.207191 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d998eaa-af18-42f8-93ca-fb1067f56877 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:32.212168 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:32.321814 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:32.331139 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d998eaa-af18-42f8-93ca-fb1067f56877 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:32.333449 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfc9bf-7d3b-4fb8-9c84-35ad2a2b1ff1 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:32.369471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b67d53-61e6-4217-b1eb-cddb2427827a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:32.370437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b67d53-61e6-4217-b1eb-cddb2427827a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:32.370848 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b67d53-61e6-4217-b1eb-cddb2427827a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:32.371303 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b67d53-61e6-4217-b1eb-cddb2427827a None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:32.372157 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b67d53-61e6-4217-b1eb-cddb2427827a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:32.372568 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b67d53-61e6-4217-b1eb-cddb2427827a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:32.374192 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b67d53-61e6-4217-b1eb-cddb2427827a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:32.381451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa67a5-1d5c-43a0-8960-a4544e79e421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:32.382622 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa67a5-1d5c-43a0-8960-a4544e79e421 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:32.383060 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa67a5-1d5c-43a0-8960-a4544e79e421 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:32.383486 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa67a5-1d5c-43a0-8960-a4544e79e421 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:32.384468 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa67a5-1d5c-43a0-8960-a4544e79e421 None admin] RBAC: Adding query filter params (role.id=b2f95849039f475c904876eb2958a375, scope.project.id=e64b932ef6bf481cb93a04885a93b4b2, user.id=51e845d0dc2c4a1fa612556c1aa73ed5) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:32.384836 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 347/689] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:41:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:32.385172 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa67a5-1d5c-43a0-8960-a4544e79e421 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:32.385894 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b67d53-61e6-4217-b1eb-cddb2427827a None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:32.387182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa67a5-1d5c-43a0-8960-a4544e79e421 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:32.402390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 343/690] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:41:32 2022] GET /identity/v3/role_assignments?user.id=51e845d0dc2c4a1fa612556c1aa73ed5&scope.project.id=e64b932ef6bf481cb93a04885a93b4b2&role.id=b2f95849039f475c904876eb2958a375 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:32.402390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa67a5-1d5c-43a0-8960-a4544e79e421 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:32.523596 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:32.601241 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b67d53-61e6-4217-b1eb-cddb2427827a None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:32.615516 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa67a5-1d5c-43a0-8960-a4544e79e421 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:32.653793 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15eddc-9982-4a7f-b766-212d24bdc242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:32.654511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15eddc-9982-4a7f-b766-212d24bdc242 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:32.654795 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15eddc-9982-4a7f-b766-212d24bdc242 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:32.655082 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15eddc-9982-4a7f-b766-212d24bdc242 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:32.656364 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15eddc-9982-4a7f-b766-212d24bdc242 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:32.656676 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15eddc-9982-4a7f-b766-212d24bdc242 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:32.656785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96faa06e-9989-41ee-a355-1e71d5a6015f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:32.657539 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faa06e-9989-41ee-a355-1e71d5a6015f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:32.657832 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faa06e-9989-41ee-a355-1e71d5a6015f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:32.658094 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15eddc-9982-4a7f-b766-212d24bdc242 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:32.658189 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faa06e-9989-41ee-a355-1e71d5a6015f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:32.670429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96faa06e-9989-41ee-a355-1e71d5a6015f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:32.671947 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96faa06e-9989-41ee-a355-1e71d5a6015f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:32.672422 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 348/691] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:32.673872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a0e67-3a68-4343-a078-c4e3c31a8d52 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:32.674135 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a0e67-3a68-4343-a078-c4e3c31a8d52 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:32.674393 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a0e67-3a68-4343-a078-c4e3c31a8d52 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:32.676761 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 349/692] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:32.679765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a0e67-3a68-4343-a078-c4e3c31a8d52 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:32.697272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-96faa06e-9989-41ee-a355-1e71d5a6015f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:32.697272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:32.697272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:32.697272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:32.697272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:32.697272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:32.697272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:32.697272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:32.697272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:32.697272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:32.697272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:32.697272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:32.697272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:32.697272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:32.697272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:32.698368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:32.698368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:32.698368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:32.698368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:32.698368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:32.698368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:32.698368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:32.698368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:32.698368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:32.698368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:32.698368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:32.698368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:32.698368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:32.698368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:32.698368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:32.698368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:32.698368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:32.699302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:32.699302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:32.699302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:32.699302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:32.699302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 344/693] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:32.699940 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42aa754-9587-497d-b87a-9e6884a1a6b5 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:32.700037 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42aa754-9587-497d-b87a-9e6884a1a6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:32.700338 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42aa754-9587-497d-b87a-9e6884a1a6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:32.726334 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-f42aa754-9587-497d-b87a-9e6884a1a6b5 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:32.727943 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f42aa754-9587-497d-b87a-9e6884a1a6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:32.731609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:32.803436 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a0e67-3a68-4343-a078-c4e3c31a8d52 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:32.818092 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 345/694] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:41:32.819529 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42aa754-9587-497d-b87a-9e6884a1a6b5 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:32.834921 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:32.841297 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee985b-064a-4cca-840e-57faf57af5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:32.851478 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee985b-064a-4cca-840e-57faf57af5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:32.851773 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee985b-064a-4cca-840e-57faf57af5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:32.852058 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee985b-064a-4cca-840e-57faf57af5a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:32.863074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee985b-064a-4cca-840e-57faf57af5a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:32.864553 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee985b-064a-4cca-840e-57faf57af5a6 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:32.880636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-3fee985b-064a-4cca-840e-57faf57af5a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:32.880636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:32.880636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:32.880636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:32.880636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:32.880636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:32.880636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:32.880636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:32.880636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:32.880636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:32.880636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:32.880636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:32.880636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:41:32.880636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:41:32.880636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:41:32.881620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:41:32.881620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:32.881620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:32.881620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:32.881620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:32.881620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:32.881620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:32.881620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:32.881620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:32.881620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:32.881620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:32.881620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:32.881620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:32.881620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:32.881620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:32.881620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:32.881620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:32.882638 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:41:32.882638 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:41:32.882638 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:41:32.882638 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:41:32.882638 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:41:32.882638 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:41:32.882638 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:32.882638 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:32.882638 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 350/695] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:32.883629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee985b-064a-4cca-840e-57faf57af5a6 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:32.953584 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42aa754-9587-497d-b87a-9e6884a1a6b5 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:32.991574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775c145-c331-406d-97f8-0fa7a4e44927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:32.992245 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775c145-c331-406d-97f8-0fa7a4e44927 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:32.992525 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775c145-c331-406d-97f8-0fa7a4e44927 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:32.992800 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775c145-c331-406d-97f8-0fa7a4e44927 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:32.993598 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775c145-c331-406d-97f8-0fa7a4e44927 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:32.993910 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775c145-c331-406d-97f8-0fa7a4e44927 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:32.995368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775c145-c331-406d-97f8-0fa7a4e44927 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:33.004217 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee985b-064a-4cca-840e-57faf57af5a6 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:33.004527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:33.008233 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 346/696] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:33.009246 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775c145-c331-406d-97f8-0fa7a4e44927 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:33.046793 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea56e7a-8d2c-437f-8592-d2eaea4824c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:33.047608 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea56e7a-8d2c-437f-8592-d2eaea4824c9 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:33.047893 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea56e7a-8d2c-437f-8592-d2eaea4824c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:33.048169 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea56e7a-8d2c-437f-8592-d2eaea4824c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:33.060143 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea56e7a-8d2c-437f-8592-d2eaea4824c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:33.061540 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea56e7a-8d2c-437f-8592-d2eaea4824c9 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:33.081226 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-4ea56e7a-8d2c-437f-8592-d2eaea4824c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:33.081226 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:33.081226 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:33.081226 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:33.081226 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:33.081226 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:33.081226 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:33.081226 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:33.081226 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:33.081226 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:33.081226 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:33.081226 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:33.081226 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:33.081226 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:33.081226 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:33.082216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:33.082216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:33.082216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:33.082216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:33.082216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:33.082216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:33.082216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:33.082216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:33.082216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:33.082216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:33.082216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:33.082216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:33.082216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:33.082216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:33.082216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:33.082216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:33.082216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:33.083149 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:33.083149 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:33.083149 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:33.083149 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:33.087533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 351/697] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:33.088436 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea56e7a-8d2c-437f-8592-d2eaea4824c9 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:33.122480 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775c145-c331-406d-97f8-0fa7a4e44927 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:33.150431 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:33.159150 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac9582-ab73-4dbc-a359-2f87d8ff23d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:33.160113 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac9582-ab73-4dbc-a359-2f87d8ff23d8 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:33.160586 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac9582-ab73-4dbc-a359-2f87d8ff23d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:33.161042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac9582-ab73-4dbc-a359-2f87d8ff23d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:33.162124 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac9582-ab73-4dbc-a359-2f87d8ff23d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:33.162612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac9582-ab73-4dbc-a359-2f87d8ff23d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:33.164246 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac9582-ab73-4dbc-a359-2f87d8ff23d8 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:33.182909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 347/698] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:41:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:33.184099 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac9582-ab73-4dbc-a359-2f87d8ff23d8 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:33.207491 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea56e7a-8d2c-437f-8592-d2eaea4824c9 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:33.254529 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:33.255971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292cc9dd-14f5-4455-90cb-0a6619ce9d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:33.256993 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cc9dd-14f5-4455-90cb-0a6619ce9d17 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:33.257453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cc9dd-14f5-4455-90cb-0a6619ce9d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:33.257905 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cc9dd-14f5-4455-90cb-0a6619ce9d17 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:33.267389 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292cc9dd-14f5-4455-90cb-0a6619ce9d17 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:33.269092 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292cc9dd-14f5-4455-90cb-0a6619ce9d17 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:33.284967 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-292cc9dd-14f5-4455-90cb-0a6619ce9d17 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 05:41:33.284967 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:33.284967 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:33.284967 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:33.284967 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:33.284967 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:33.284967 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:33.284967 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:33.284967 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:33.284967 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:33.284967 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:33.284967 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:33.284967 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:41:33.284967 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:41:33.284967 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:41:33.284967 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:41:33.285979 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:33.285979 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:33.285979 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:41:33.285979 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:33.285979 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:41:33.285979 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:33.285979 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:33.285979 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:33.285979 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:33.285979 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:33.285979 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:33.285979 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:33.285979 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:33.285979 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:33.285979 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:33.285979 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:33.285979 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:33.285979 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:33.286927 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:33.286927 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:33.286927 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:41:33.286927 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:41:33.286927 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:41:33.286927 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:41:33.286927 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:41:33.286927 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:41:33.286927 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 05:41:33.286927 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:33.289678 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 352/699] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jun 21 05:41:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:33.290743 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292cc9dd-14f5-4455-90cb-0a6619ce9d17 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:33.306244 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac9582-ab73-4dbc-a359-2f87d8ff23d8 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:33.358775 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f6416-2de1-4039-ab32-a783fa61c7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:33.359564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f6416-2de1-4039-ab32-a783fa61c7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:33.359751 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f6416-2de1-4039-ab32-a783fa61c7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:33.360037 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f6416-2de1-4039-ab32-a783fa61c7f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:33.360773 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f6416-2de1-4039-ab32-a783fa61c7f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:33.361086 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f6416-2de1-4039-ab32-a783fa61c7f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:33.362514 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f6416-2de1-4039-ab32-a783fa61c7f6 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:33.377122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 348/700] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:33.378305 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f6416-2de1-4039-ab32-a783fa61c7f6 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:33.414647 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:33.420066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292cc9dd-14f5-4455-90cb-0a6619ce9d17 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:33.470537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d9b05-dff2-4f10-b6bf-2bc7491ca893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:33.471456 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d9b05-dff2-4f10-b6bf-2bc7491ca893 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:33.471748 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d9b05-dff2-4f10-b6bf-2bc7491ca893 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:33.472030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d9b05-dff2-4f10-b6bf-2bc7491ca893 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:33.473371 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d9b05-dff2-4f10-b6bf-2bc7491ca893 None admin] RBAC: Adding query filter params (role.id=b2f95849039f475c904876eb2958a375, scope.project.id=e64b932ef6bf481cb93a04885a93b4b2, user.id=ac485a336d8b4360bce4f495bd02dbde) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:33.473695 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d9b05-dff2-4f10-b6bf-2bc7491ca893 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:33.475478 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d9b05-dff2-4f10-b6bf-2bc7491ca893 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:33.489958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 353/701] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:41:33 2022] GET /identity/v3/role_assignments?user.id=ac485a336d8b4360bce4f495bd02dbde&scope.project.id=e64b932ef6bf481cb93a04885a93b4b2&role.id=b2f95849039f475c904876eb2958a375 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:33.489958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d9b05-dff2-4f10-b6bf-2bc7491ca893 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:33.506448 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f6416-2de1-4039-ab32-a783fa61c7f6 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:33.561973 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:33.607663 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e2020-f2cf-4da1-b00e-d16d733bb9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:33.608885 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e2020-f2cf-4da1-b00e-d16d733bb9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:33.609419 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e2020-f2cf-4da1-b00e-d16d733bb9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:33.610039 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e2020-f2cf-4da1-b00e-d16d733bb9c0 None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:33.611111 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e2020-f2cf-4da1-b00e-d16d733bb9c0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:33.611633 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e2020-f2cf-4da1-b00e-d16d733bb9c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:33.613308 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e2020-f2cf-4da1-b00e-d16d733bb9c0 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:33.620466 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d9b05-dff2-4f10-b6bf-2bc7491ca893 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:33.652850 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 349/702] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jun 21 05:41:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:33.661203 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e2020-f2cf-4da1-b00e-d16d733bb9c0 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:33.694789 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74eed3-96cd-4d47-a1d0-0442ea48b5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:33.695494 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74eed3-96cd-4d47-a1d0-0442ea48b5c6 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:33.695784 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74eed3-96cd-4d47-a1d0-0442ea48b5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:33.696063 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74eed3-96cd-4d47-a1d0-0442ea48b5c6 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:33.696790 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74eed3-96cd-4d47-a1d0-0442ea48b5c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:33.698296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74eed3-96cd-4d47-a1d0-0442ea48b5c6 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:33.730502 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 354/703] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 21 05:41:33 2022] POST /identity/v3/users => generated 254 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:41:33.806271 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e2020-f2cf-4da1-b00e-d16d733bb9c0 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:33.847955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c045a-c2a4-42d6-b119-85de05d1a2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:33.848707 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c045a-c2a4-42d6-b119-85de05d1a2cf None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:33.848996 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c045a-c2a4-42d6-b119-85de05d1a2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:33.849282 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c045a-c2a4-42d6-b119-85de05d1a2cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:33.903898 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:33.929266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c045a-c2a4-42d6-b119-85de05d1a2cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:33.930757 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c045a-c2a4-42d6-b119-85de05d1a2cf None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:33.982837 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5173c74-7e36-4d22-839c-f1b6495be666 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:33.983296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5173c74-7e36-4d22-839c-f1b6495be666 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:33.983621 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5173c74-7e36-4d22-839c-f1b6495be666 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:33.985142 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 355/704] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:33.991051 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54f8ef-64b1-4109-b895-e6b914ed7df0 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:33.991379 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54f8ef-64b1-4109-b895-e6b914ed7df0 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:33.991623 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54f8ef-64b1-4109-b895-e6b914ed7df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:34.019432 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-2b54f8ef-64b1-4109-b895-e6b914ed7df0 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:34.020925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-2b54f8ef-64b1-4109-b895-e6b914ed7df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:34.044737 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:34.055439 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 350/705] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:41:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:41:34.060960 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c045a-c2a4-42d6-b119-85de05d1a2cf None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:34.141888 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 356/706] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 05:41:34.181985 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:34.183632 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54f8ef-64b1-4109-b895-e6b914ed7df0 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:34.236535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c045a-c2a4-42d6-b119-85de05d1a2cf None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:34.275961 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba0dc6-3ca9-4d3b-beb6-17342efcc282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:34.277130 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba0dc6-3ca9-4d3b-beb6-17342efcc282 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:34.277624 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba0dc6-3ca9-4d3b-beb6-17342efcc282 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:34.278288 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba0dc6-3ca9-4d3b-beb6-17342efcc282 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:34.291332 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba0dc6-3ca9-4d3b-beb6-17342efcc282 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:34.293120 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba0dc6-3ca9-4d3b-beb6-17342efcc282 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:34.314683 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-c9ba0dc6-3ca9-4d3b-beb6-17342efcc282 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:34.314683 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:34.314683 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:34.314683 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:34.314683 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:34.314683 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:34.314683 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:34.314683 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:34.314683 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:34.314683 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:34.314683 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:34.314683 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:34.314683 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:34.314683 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:34.314683 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:34.315715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:34.315715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:34.315715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:34.315715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:34.315715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:34.315715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:34.315715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:34.315715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:34.315715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:34.315715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:34.315715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:34.315715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:34.315715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:34.315715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:34.315715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:34.315715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:34.315715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:34.316637 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:34.316637 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:34.316637 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:34.316637 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:34.319136 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 351/707] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:41:34.324202 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba0dc6-3ca9-4d3b-beb6-17342efcc282 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:34.376669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54f8ef-64b1-4109-b895-e6b914ed7df0 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:34.424285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48ee6a-fb27-4b20-aa27-62263bd72f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:34.426042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48ee6a-fb27-4b20-aa27-62263bd72f69 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:34.426580 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48ee6a-fb27-4b20-aa27-62263bd72f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:34.427066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48ee6a-fb27-4b20-aa27-62263bd72f69 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:34.428035 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48ee6a-fb27-4b20-aa27-62263bd72f69 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:34.429675 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48ee6a-fb27-4b20-aa27-62263bd72f69 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:34.462633 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-7f48ee6a-fb27-4b20-aa27-62263bd72f69 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 05:41:34.462633 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:34.462633 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 05:41:34.462633 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 05:41:34.462633 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 05:41:34.462633 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 05:41:34.462633 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 05:41:34.462633 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:41:34.462633 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 05:41:34.462633 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:34.462633 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:41:34.462633 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:34.462633 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:34.462633 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:34.462633 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:34.462633 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:34.463687 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:34.463687 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:34.463687 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:34.463687 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:34.463687 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:34.463687 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:34.463687 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:34.463687 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 05:41:34.463687 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 05:41:34.463687 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 05:41:34.463687 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 05:41:34.463687 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:34.463687 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:34.463687 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:34.463687 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:34.463687 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:34.464544 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:34.464544 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:34.464544 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:34.464544 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:34.464544 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:34.464544 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:34.464544 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:34.464544 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:34.464544 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:34.464544 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:34.464544 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:34.464544 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 05:41:34.464544 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:41:34.464544 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 05:41:34.464544 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:34.464544 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 357/708] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Jun 21 05:41:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:41:34.471112 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48ee6a-fb27-4b20-aa27-62263bd72f69 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:34.471387 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba0dc6-3ca9-4d3b-beb6-17342efcc282 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:34.502130 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:34.505517 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:34.509564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74cd30-9d62-485a-b19d-dd5c632c64a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:34.510284 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74cd30-9d62-485a-b19d-dd5c632c64a1 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:34.510572 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74cd30-9d62-485a-b19d-dd5c632c64a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:34.510850 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74cd30-9d62-485a-b19d-dd5c632c64a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:34.511588 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74cd30-9d62-485a-b19d-dd5c632c64a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:34.511898 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74cd30-9d62-485a-b19d-dd5c632c64a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:34.513469 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74cd30-9d62-485a-b19d-dd5c632c64a1 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:34.526218 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 352/709] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:34.531436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74cd30-9d62-485a-b19d-dd5c632c64a1 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:34.682369 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48ee6a-fb27-4b20-aa27-62263bd72f69 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:34.730330 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74cd30-9d62-485a-b19d-dd5c632c64a1 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:34.755141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a527f91-4026-4e4a-a2ec-117baf26dd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:34.755821 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a527f91-4026-4e4a-a2ec-117baf26dd1f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:34.756104 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a527f91-4026-4e4a-a2ec-117baf26dd1f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:34.756382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a527f91-4026-4e4a-a2ec-117baf26dd1f None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:34.757103 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a527f91-4026-4e4a-a2ec-117baf26dd1f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:34.757410 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a527f91-4026-4e4a-a2ec-117baf26dd1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:34.758842 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a527f91-4026-4e4a-a2ec-117baf26dd1f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:34.775089 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 358/710] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Jun 21 05:41:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:34.781490 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a527f91-4026-4e4a-a2ec-117baf26dd1f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:34.802673 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fefcd-b276-458b-9cd7-7259ecc88078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:34.803482 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fefcd-b276-458b-9cd7-7259ecc88078 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:34.803764 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fefcd-b276-458b-9cd7-7259ecc88078 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:34.804039 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fefcd-b276-458b-9cd7-7259ecc88078 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:34.811567 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499fefcd-b276-458b-9cd7-7259ecc88078 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:34.813050 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499fefcd-b276-458b-9cd7-7259ecc88078 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:34.828958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-499fefcd-b276-458b-9cd7-7259ecc88078 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:34.828958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:34.828958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:34.828958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:34.828958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:34.828958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:34.828958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:34.828958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:34.828958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:34.828958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:34.828958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:34.828958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:34.828958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:41:34.828958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:41:34.828958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:41:34.829894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:41:34.829894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:34.829894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:34.829894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:34.829894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:34.829894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:34.829894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:34.829894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:34.829894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:34.829894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:34.829894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:34.829894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:34.829894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:34.829894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:34.829894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:34.829894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:34.829894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:34.830824 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:41:34.830824 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:41:34.830824 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:41:34.830824 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:41:34.830824 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:41:34.830824 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:41:34.830824 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:34.830824 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:34.830824 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 353/711] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:41:34.831872 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d231fa7-8c6a-4c0a-99f5-cd34278004db None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:34.832166 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d231fa7-8c6a-4c0a-99f5-cd34278004db None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:34.832445 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d231fa7-8c6a-4c0a-99f5-cd34278004db None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:34.837728 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 354/712] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:34.837728 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d231fa7-8c6a-4c0a-99f5-cd34278004db None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:34.882917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:34.892082 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:34.910679 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a527f91-4026-4e4a-a2ec-117baf26dd1f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:34.949095 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d231fa7-8c6a-4c0a-99f5-cd34278004db None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:34.949871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b86d2c-4c8e-411a-bde5-8e881eae5eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:34.950949 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b86d2c-4c8e-411a-bde5-8e881eae5eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:34.951534 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b86d2c-4c8e-411a-bde5-8e881eae5eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:34.952030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b86d2c-4c8e-411a-bde5-8e881eae5eb7 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:34.953583 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b86d2c-4c8e-411a-bde5-8e881eae5eb7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:34.954202 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b86d2c-4c8e-411a-bde5-8e881eae5eb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:34.955840 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b86d2c-4c8e-411a-bde5-8e881eae5eb7 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:34.963741 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 359/713] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Jun 21 05:41:34 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:34.966459 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962477a2-66ae-49d4-a00b-4b03fda08659 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:34.967118 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962477a2-66ae-49d4-a00b-4b03fda08659 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:34.967628 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962477a2-66ae-49d4-a00b-4b03fda08659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:34.989123 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-962477a2-66ae-49d4-a00b-4b03fda08659 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:34.989739 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa15222-6758-433f-b400-0f74e3fafe68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:34.990459 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa15222-6758-433f-b400-0f74e3fafe68 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:34.990744 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa15222-6758-433f-b400-0f74e3fafe68 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:34.991040 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa15222-6758-433f-b400-0f74e3fafe68 None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:34.991719 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-962477a2-66ae-49d4-a00b-4b03fda08659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:34.991853 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa15222-6758-433f-b400-0f74e3fafe68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:34.992151 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa15222-6758-433f-b400-0f74e3fafe68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:34.993629 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa15222-6758-433f-b400-0f74e3fafe68 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:35.009118 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 355/714] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:41:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:35.014676 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa15222-6758-433f-b400-0f74e3fafe68 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:35.129867 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 360/715] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:41:35.159836 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962477a2-66ae-49d4-a00b-4b03fda08659 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:35.214116 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa15222-6758-433f-b400-0f74e3fafe68 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:35.226848 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:35.242397 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:35.255364 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d69ab-d73c-4605-b7fe-81227fa86189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:35.256034 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d69ab-d73c-4605-b7fe-81227fa86189 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:35.256322 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d69ab-d73c-4605-b7fe-81227fa86189 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:35.256761 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d69ab-d73c-4605-b7fe-81227fa86189 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:35.257620 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d69ab-d73c-4605-b7fe-81227fa86189 None admin] RBAC: Adding query filter params (role.id=24aa6040c86049f996560e477e83886f, scope.project.id=e64b932ef6bf481cb93a04885a93b4b2, user.id=f702830987ba4548a4c2ee3d0e302d02) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:35.257956 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d69ab-d73c-4605-b7fe-81227fa86189 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:35.259465 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d69ab-d73c-4605-b7fe-81227fa86189 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:35.266926 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 356/716] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:41:35 2022] GET /identity/v3/role_assignments?user.id=f702830987ba4548a4c2ee3d0e302d02&scope.project.id=e64b932ef6bf481cb93a04885a93b4b2&role.id=24aa6040c86049f996560e477e83886f => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:35.294346 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962477a2-66ae-49d4-a00b-4b03fda08659 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:35.356742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64079bca-4b09-45df-87f8-834fe8968439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:35.357540 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64079bca-4b09-45df-87f8-834fe8968439 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:35.357825 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64079bca-4b09-45df-87f8-834fe8968439 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:35.358120 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64079bca-4b09-45df-87f8-834fe8968439 None admin] PATH_INFO: `/v3/services/network` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:35.359357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64079bca-4b09-45df-87f8-834fe8968439 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:35.360729 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64079bca-4b09-45df-87f8-834fe8968439 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:35.378332 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-64079bca-4b09-45df-87f8-834fe8968439 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 05:41:35.378332 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:35.378332 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 05:41:35.378332 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 05:41:35.378332 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 05:41:35.378332 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 05:41:35.378332 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 05:41:35.378332 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:41:35.378332 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 05:41:35.378332 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:35.378332 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:41:35.378332 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:35.378332 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:35.378332 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:35.378332 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:35.378332 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:35.378332 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:35.379420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:35.379420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:35.379420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:35.379420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:35.379420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:35.379420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:35.379420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 05:41:35.379420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 05:41:35.379420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 05:41:35.379420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 05:41:35.379420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:35.379420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:35.379420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:35.379420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:35.379420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:35.379420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:35.380339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:35.380339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:35.380339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:35.380339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:35.380339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:35.380339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:35.380339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:35.380339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:35.380339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:35.380339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:35.380339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 05:41:35.380339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:41:35.380339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 05:41:35.380339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:35.380339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 361/717] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:35 2022] GET /identity/v3/services/network => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:35.385831 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d69ab-d73c-4605-b7fe-81227fa86189 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:35.532039 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d69ab-d73c-4605-b7fe-81227fa86189 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:35.567535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84f2b0-b2b1-4df7-968e-9517b9b980bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:35.568212 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84f2b0-b2b1-4df7-968e-9517b9b980bb None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:35.568498 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84f2b0-b2b1-4df7-968e-9517b9b980bb None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:35.568780 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84f2b0-b2b1-4df7-968e-9517b9b980bb None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:35.569496 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e84f2b0-b2b1-4df7-968e-9517b9b980bb None admin] RBAC: Adding query filter params (name=network) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:35.569801 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e84f2b0-b2b1-4df7-968e-9517b9b980bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:35.571321 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e84f2b0-b2b1-4df7-968e-9517b9b980bb None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:35.576796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 357/718] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jun 21 05:41:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:35.582236 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64079bca-4b09-45df-87f8-834fe8968439 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:35.687408 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64079bca-4b09-45df-87f8-834fe8968439 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:35.723453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71ad67-dbdc-4eb2-b3d2-5f9c67278303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:35.724127 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71ad67-dbdc-4eb2-b3d2-5f9c67278303 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:35.724412 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71ad67-dbdc-4eb2-b3d2-5f9c67278303 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:35.724690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71ad67-dbdc-4eb2-b3d2-5f9c67278303 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:35.725399 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71ad67-dbdc-4eb2-b3d2-5f9c67278303 None admin] RBAC: Adding query filter params (type=network) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:35.725709 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71ad67-dbdc-4eb2-b3d2-5f9c67278303 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:35.727231 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71ad67-dbdc-4eb2-b3d2-5f9c67278303 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:35.728557 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:35.732821 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 362/719] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jun 21 05:41:35 2022] GET /identity/v3/services?type=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:41:36.241922 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fbd0d-3729-49db-a2b1-296e3d4428fa None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:36.242315 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fbd0d-3729-49db-a2b1-296e3d4428fa None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:36.242553 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fbd0d-3729-49db-a2b1-296e3d4428fa None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:36.244149 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 358/720] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:36.250262 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885e346-b935-4593-9055-cb3c477556e9 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:36.250555 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885e346-b935-4593-9055-cb3c477556e9 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:36.250834 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885e346-b935-4593-9055-cb3c477556e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:36.274951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-e885e346-b935-4593-9055-cb3c477556e9 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:36.276167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e885e346-b935-4593-9055-cb3c477556e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:36.292600 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e8d7e-9888-42bf-aba2-b3e02433fbc3 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:36.293173 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e8d7e-9888-42bf-aba2-b3e02433fbc3 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:36.293464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e8d7e-9888-42bf-aba2-b3e02433fbc3 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:36.295289 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 359/721] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:36.302509 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edacb851-1b57-4f52-bd96-6afbbe0f34be None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:36.302803 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edacb851-1b57-4f52-bd96-6afbbe0f34be None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:36.303088 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edacb851-1b57-4f52-bd96-6afbbe0f34be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:36.337871 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-edacb851-1b57-4f52-bd96-6afbbe0f34be None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:36.340328 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-edacb851-1b57-4f52-bd96-6afbbe0f34be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:36.390277 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 363/722] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:41:36.410205 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885e346-b935-4593-9055-cb3c477556e9 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:36.411282 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:36.495840 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 360/723] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 05:41:36.537823 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edacb851-1b57-4f52-bd96-6afbbe0f34be None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:36.572683 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885e346-b935-4593-9055-cb3c477556e9 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:36.600594 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:36.619422 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9437d-4f44-4b83-af28-0f3f7948f397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:36.620250 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9437d-4f44-4b83-af28-0f3f7948f397 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:36.620535 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9437d-4f44-4b83-af28-0f3f7948f397 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:36.620817 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9437d-4f44-4b83-af28-0f3f7948f397 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:36.662654 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9437d-4f44-4b83-af28-0f3f7948f397 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:36.670355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-b8d9437d-4f44-4b83-af28-0f3f7948f397 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:36.670355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:36.670355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:36.670355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:36.670355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:36.670355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:36.670355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:36.670355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:36.670355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:36.670355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:36.670355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:36.670355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:36.670355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:36.670355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:36.670355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:36.670355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:36.673036 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:36.673036 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:36.673036 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:36.673036 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:36.673036 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:36.673036 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:36.673036 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:36.673036 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:36.673036 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:36.673036 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:36.673036 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:36.673036 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:36.673036 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:36.673036 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:36.673036 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:36.673036 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:36.674990 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:36.674990 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:36.674990 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:36.674990 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:36.674990 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:36.674990 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:36.674990 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:36.674990 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:36.674990 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:36.674990 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:36.674990 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:36.674990 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:36.674990 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 364/724] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 21 05:41:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:36.679673 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9437d-4f44-4b83-af28-0f3f7948f397 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:36.701273 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edacb851-1b57-4f52-bd96-6afbbe0f34be None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:36.770224 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6f6a9-b608-4d55-a177-f08e2c42903e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:36.772279 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6f6a9-b608-4d55-a177-f08e2c42903e None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:36.772279 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6f6a9-b608-4d55-a177-f08e2c42903e None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:36.772279 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6f6a9-b608-4d55-a177-f08e2c42903e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:36.792081 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef6f6a9-b608-4d55-a177-f08e2c42903e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:36.808455 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-7ef6f6a9-b608-4d55-a177-f08e2c42903e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:41:36.808455 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:36.808455 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:36.808455 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:36.808455 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:36.808455 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:36.808455 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:36.808455 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:36.808455 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:36.808455 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:36.808455 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:36.808455 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:36.808455 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:36.808455 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:36.808455 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:36.808455 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:36.810713 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:36.810713 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:36.810713 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:36.810713 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:36.810713 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:36.810713 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:36.810713 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:36.810713 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:36.810713 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:36.810713 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:36.810713 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:36.810713 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:36.810713 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:36.810713 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:36.810713 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:36.810713 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:36.812811 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:36.812811 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:36.812811 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:36.812811 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:36.812811 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:36.812811 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:36.812811 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:36.812811 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:36.812811 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:36.812811 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:36.812811 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:41:36.812811 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:36.812811 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 361/725] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:41:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:41:36.817969 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6f6a9-b608-4d55-a177-f08e2c42903e None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:36.841416 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9437d-4f44-4b83-af28-0f3f7948f397 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:36.874204 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:36.915379 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344254f-8cad-4e04-9701-8af6adcfcd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:36.915379 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344254f-8cad-4e04-9701-8af6adcfcd7c None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:36.915379 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344254f-8cad-4e04-9701-8af6adcfcd7c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:36.915379 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344254f-8cad-4e04-9701-8af6adcfcd7c None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:36.916139 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344254f-8cad-4e04-9701-8af6adcfcd7c None admin] RBAC: Adding query filter params (name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:36.916139 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344254f-8cad-4e04-9701-8af6adcfcd7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:36.917407 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344254f-8cad-4e04-9701-8af6adcfcd7c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:36.926938 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 365/726] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 21 05:41:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:36.932088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344254f-8cad-4e04-9701-8af6adcfcd7c None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:37.011133 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6f6a9-b608-4d55-a177-f08e2c42903e None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:37.059688 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d493d6-e8cc-46d3-977c-1a8b917c9e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:37.060784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d493d6-e8cc-46d3-977c-1a8b917c9e0c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:37.061294 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d493d6-e8cc-46d3-977c-1a8b917c9e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:37.061672 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d493d6-e8cc-46d3-977c-1a8b917c9e0c None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:37.062318 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:37.062614 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d493d6-e8cc-46d3-977c-1a8b917c9e0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:37.063003 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d493d6-e8cc-46d3-977c-1a8b917c9e0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:37.064467 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d493d6-e8cc-46d3-977c-1a8b917c9e0c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:37.074991 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 362/727] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:41:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:37.080445 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d493d6-e8cc-46d3-977c-1a8b917c9e0c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:37.117795 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344254f-8cad-4e04-9701-8af6adcfcd7c None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:37.195969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce926077-5b8c-4ab7-9c11-566d23d34dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:37.196690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce926077-5b8c-4ab7-9c11-566d23d34dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:37.196978 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce926077-5b8c-4ab7-9c11-566d23d34dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:37.197256 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce926077-5b8c-4ab7-9c11-566d23d34dd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:37.224362 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce926077-5b8c-4ab7-9c11-566d23d34dd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:37.225858 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce926077-5b8c-4ab7-9c11-566d23d34dd7 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:37.256340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-ce926077-5b8c-4ab7-9c11-566d23d34dd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:37.256340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:37.256340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:37.256340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:37.256340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:37.256340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:37.256340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:37.256340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:37.256340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:37.256340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:37.256340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:37.256340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:37.256340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:37.256340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:37.256340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:37.257344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:37.257344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:37.257344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:37.257344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:37.257344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:37.257344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:37.257344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:37.257344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:37.257344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:37.257344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:37.257344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:37.257344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:37.257344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:37.257344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:37.257344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:37.257344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:37.257344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:37.258258 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:37.258258 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:37.258258 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:37.258258 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:37.266092 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 366/728] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:37.266659 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:37.266992 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce926077-5b8c-4ab7-9c11-566d23d34dd7 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:37.272848 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d493d6-e8cc-46d3-977c-1a8b917c9e0c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:37.310949 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c7584-e1b4-4578-8909-d7af572eba86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:37.311795 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c7584-e1b4-4578-8909-d7af572eba86 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:37.312084 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c7584-e1b4-4578-8909-d7af572eba86 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:37.312364 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c7584-e1b4-4578-8909-d7af572eba86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:37.330616 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c7584-e1b4-4578-8909-d7af572eba86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:37.332011 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c7584-e1b4-4578-8909-d7af572eba86 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:37.351246 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-b45c7584-e1b4-4578-8909-d7af572eba86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:37.351246 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:37.351246 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:37.351246 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:37.351246 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:37.351246 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:37.351246 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:37.351246 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:37.351246 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:37.351246 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:37.351246 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:37.351246 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:37.351246 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:37.351246 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:37.351246 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:37.352208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:37.352208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:37.352208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:37.352208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:37.352208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:37.352208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:37.352208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:37.352208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:37.352208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:37.352208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:37.352208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:37.352208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:37.352208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:37.352208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:37.352208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:37.352208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:37.352208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:37.353127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:37.353127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:37.353127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:37.353127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:37.353127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 363/729] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:41:37.358492 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c7584-e1b4-4578-8909-d7af572eba86 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:37.415305 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce926077-5b8c-4ab7-9c11-566d23d34dd7 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:37.438537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:37.461362 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074cc03-b20d-493b-92cc-0101e94631c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:37.461984 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074cc03-b20d-493b-92cc-0101e94631c2 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:37.462277 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074cc03-b20d-493b-92cc-0101e94631c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:37.462557 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074cc03-b20d-493b-92cc-0101e94631c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:37.467205 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074cc03-b20d-493b-92cc-0101e94631c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:37.467539 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074cc03-b20d-493b-92cc-0101e94631c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:37.469036 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074cc03-b20d-493b-92cc-0101e94631c2 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:37.472925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c7584-e1b4-4578-8909-d7af572eba86 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:37.496663 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 367/730] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:37.502517 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074cc03-b20d-493b-92cc-0101e94631c2 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:37.533032 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851591a0-9011-41d3-84da-36c2e5b36dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:37.533794 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851591a0-9011-41d3-84da-36c2e5b36dab None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:37.534568 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851591a0-9011-41d3-84da-36c2e5b36dab None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:37.534854 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851591a0-9011-41d3-84da-36c2e5b36dab None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:37.535870 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851591a0-9011-41d3-84da-36c2e5b36dab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:37.536188 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851591a0-9011-41d3-84da-36c2e5b36dab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:37.538118 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851591a0-9011-41d3-84da-36c2e5b36dab None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:37.553387 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 364/731] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:41:37.554746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000597a7-8375-4d22-b33d-1fa100562272 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:37.555037 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000597a7-8375-4d22-b33d-1fa100562272 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:37.555320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000597a7-8375-4d22-b33d-1fa100562272 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:37.561147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 365/732] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:37.562564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000597a7-8375-4d22-b33d-1fa100562272 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:37.566106 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:37.636398 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074cc03-b20d-493b-92cc-0101e94631c2 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:37.672033 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53004bd-3c88-4f1b-b3aa-42f881bdc24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:37.672860 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53004bd-3c88-4f1b-b3aa-42f881bdc24c None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:37.673138 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53004bd-3c88-4f1b-b3aa-42f881bdc24c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:37.673418 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53004bd-3c88-4f1b-b3aa-42f881bdc24c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:37.680968 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53004bd-3c88-4f1b-b3aa-42f881bdc24c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:37.682475 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53004bd-3c88-4f1b-b3aa-42f881bdc24c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:37.697647 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000597a7-8375-4d22-b33d-1fa100562272 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:37.698538 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-b53004bd-3c88-4f1b-b3aa-42f881bdc24c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 05:41:37.698538 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:37.698538 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:37.698538 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:37.698538 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:37.698538 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:37.698538 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:37.698538 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:37.698538 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:37.698538 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:37.698538 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:37.698538 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:37.698538 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:41:37.698538 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:41:37.698538 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:41:37.698538 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:41:37.700603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:37.700603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:37.700603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:41:37.700603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:37.700603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:41:37.700603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:37.700603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:37.700603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:37.700603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:37.700603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:37.700603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:37.700603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:37.700603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:37.700603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:37.700603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:37.700603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:37.700603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:37.700603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:37.703359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:37.703359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:37.703359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:41:37.703359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:41:37.703359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:41:37.703359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:41:37.703359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:41:37.703359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:41:37.703359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 05:41:37.703359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:37.703359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 368/733] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jun 21 05:41:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:37.703359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11afdab-775e-4c97-b37c-cd7b9f4dd558 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:37.703359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11afdab-775e-4c97-b37c-cd7b9f4dd558 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:37.704873 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11afdab-775e-4c97-b37c-cd7b9f4dd558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:37.721150 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-c11afdab-775e-4c97-b37c-cd7b9f4dd558 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:37.722400 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c11afdab-775e-4c97-b37c-cd7b9f4dd558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:37.740711 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488488a-e3c5-438f-bf39-94b4d63be021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:37.741625 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488488a-e3c5-438f-bf39-94b4d63be021 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:37.742015 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488488a-e3c5-438f-bf39-94b4d63be021 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:37.742362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488488a-e3c5-438f-bf39-94b4d63be021 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:37.750305 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:37.751200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488488a-e3c5-438f-bf39-94b4d63be021 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:37.752780 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488488a-e3c5-438f-bf39-94b4d63be021 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:37.769038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-0488488a-e3c5-438f-bf39-94b4d63be021 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 05:41:37.769038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:37.769038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:37.769038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:37.769038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:37.769038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:37.769038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:37.769038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:37.769038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:37.769038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:37.769038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:37.769038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:37.769038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:41:37.769038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:41:37.769038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:41:37.769038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:41:37.771412 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:37.771412 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:37.771412 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:41:37.771412 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:37.771412 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:41:37.771412 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:37.771412 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:37.771412 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:37.771412 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:37.771412 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:37.771412 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:37.771412 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:37.771412 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:37.771412 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:37.771412 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:37.771412 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:37.771412 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:37.771412 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:37.772894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:37.772894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:37.772894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:41:37.772894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:41:37.772894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:41:37.772894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:41:37.772894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:41:37.772894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:41:37.772894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 05:41:37.772894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:37.772894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 366/734] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:41:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:37.772894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488488a-e3c5-438f-bf39-94b4d63be021 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:37.804453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 369/735] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:41:37.805867 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0304df-3d65-41a4-8c82-962468a0483c None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:37.806203 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0304df-3d65-41a4-8c82-962468a0483c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:37.806483 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0304df-3d65-41a4-8c82-962468a0483c None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:37.810049 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 370/736] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:37.810981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0304df-3d65-41a4-8c82-962468a0483c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:37.851914 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:37.893100 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488488a-e3c5-438f-bf39-94b4d63be021 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:37.928866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0304df-3d65-41a4-8c82-962468a0483c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:37.932238 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce2c0b-da61-4771-8aa1-f92bb97ac1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:37.933155 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce2c0b-da61-4771-8aa1-f92bb97ac1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:37.933622 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce2c0b-da61-4771-8aa1-f92bb97ac1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:37.934111 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce2c0b-da61-4771-8aa1-f92bb97ac1b8 None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:37.935138 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce2c0b-da61-4771-8aa1-f92bb97ac1b8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:37.935629 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce2c0b-da61-4771-8aa1-f92bb97ac1b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:37.937977 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce2c0b-da61-4771-8aa1-f92bb97ac1b8 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:37.962090 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 367/737] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Jun 21 05:41:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:37.963583 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496459a-6484-4564-b47b-c45e55b6d941 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:37.963889 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496459a-6484-4564-b47b-c45e55b6d941 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:37.964168 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496459a-6484-4564-b47b-c45e55b6d941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:37.965545 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183c6c9-f9ae-401e-a300-18df7760c227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:37.966261 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183c6c9-f9ae-401e-a300-18df7760c227 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:37.966547 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183c6c9-f9ae-401e-a300-18df7760c227 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:37.966824 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183c6c9-f9ae-401e-a300-18df7760c227 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:37.967666 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183c6c9-f9ae-401e-a300-18df7760c227 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:37.968010 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183c6c9-f9ae-401e-a300-18df7760c227 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:37.969464 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183c6c9-f9ae-401e-a300-18df7760c227 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:37.982038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-2496459a-6484-4564-b47b-c45e55b6d941 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:37.983179 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-2496459a-6484-4564-b47b-c45e55b6d941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:37.992373 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 371/738] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Jun 21 05:41:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:37.992373 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183c6c9-f9ae-401e-a300-18df7760c227 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:38.005568 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:38.058228 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 368/739] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:41:38.059119 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496459a-6484-4564-b47b-c45e55b6d941 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:38.116389 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183c6c9-f9ae-401e-a300-18df7760c227 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:38.125585 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:38.152387 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133af024-572c-4e1a-a439-a20745428639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:38.153056 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133af024-572c-4e1a-a439-a20745428639 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:38.153755 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133af024-572c-4e1a-a439-a20745428639 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:38.154070 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133af024-572c-4e1a-a439-a20745428639 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:38.154800 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133af024-572c-4e1a-a439-a20745428639 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:38.157059 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133af024-572c-4e1a-a439-a20745428639 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:38.173498 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 372/740] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jun 21 05:41:37 2022] POST /identity/v3/services => generated 251 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:41:38.174335 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133af024-572c-4e1a-a439-a20745428639 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:38.190089 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496459a-6484-4564-b47b-c45e55b6d941 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:38.255227 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371d7d5-8d70-4280-95d7-33d9983c2704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:38.256281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371d7d5-8d70-4280-95d7-33d9983c2704 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:38.256754 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371d7d5-8d70-4280-95d7-33d9983c2704 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:38.257219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371d7d5-8d70-4280-95d7-33d9983c2704 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:38.263173 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:38.299176 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133af024-572c-4e1a-a439-a20745428639 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:38.339377 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe92ef7-b45b-4470-b99e-7bd80a0f89fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:38.340145 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe92ef7-b45b-4470-b99e-7bd80a0f89fd None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:38.340433 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe92ef7-b45b-4470-b99e-7bd80a0f89fd None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:38.340718 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe92ef7-b45b-4470-b99e-7bd80a0f89fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:38.346324 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371d7d5-8d70-4280-95d7-33d9983c2704 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:38.347832 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371d7d5-8d70-4280-95d7-33d9983c2704 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:38.398607 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:38.424733 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe92ef7-b45b-4470-b99e-7bd80a0f89fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:38.426482 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe92ef7-b45b-4470-b99e-7bd80a0f89fd None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:38.454755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 369/741] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:41:38 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:41:38.455614 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371d7d5-8d70-4280-95d7-33d9983c2704 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:38.501298 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:38.537620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 373/742] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:41:38 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 05:41:38.538985 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a53fc-98f8-4338-b729-08f5b7c6193c None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:38.539276 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a53fc-98f8-4338-b729-08f5b7c6193c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:38.539557 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a53fc-98f8-4338-b729-08f5b7c6193c None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:38.541030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 374/743] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:38.541554 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a53fc-98f8-4338-b729-08f5b7c6193c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:38.570220 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371d7d5-8d70-4280-95d7-33d9983c2704 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:38.612049 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94adcf-7b2b-409c-b425-16f4571a1590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:38.612856 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94adcf-7b2b-409c-b425-16f4571a1590 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:38.613139 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94adcf-7b2b-409c-b425-16f4571a1590 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:38.613416 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94adcf-7b2b-409c-b425-16f4571a1590 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:38.627023 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c94adcf-7b2b-409c-b425-16f4571a1590 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:38.634843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-0c94adcf-7b2b-409c-b425-16f4571a1590 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:41:38.634843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:38.634843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:38.634843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:38.634843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:38.634843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:38.634843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:38.634843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:38.634843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:38.634843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:38.634843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:38.634843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:38.634843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:38.634843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:38.634843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:38.634843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:38.635899 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:38.635899 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:38.635899 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:38.635899 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:38.635899 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:38.635899 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:38.635899 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:38.635899 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:38.635899 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:38.635899 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:38.635899 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:38.635899 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:38.635899 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:38.635899 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:38.635899 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:38.635899 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:38.636778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:38.636778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:38.636778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:38.636778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:38.636778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:38.636778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:38.636778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:38.636778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:38.636778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:38.636778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:38.636778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:41:38.636778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:38.636778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 370/744] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:41:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:38.637497 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94adcf-7b2b-409c-b425-16f4571a1590 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:38.647267 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:38.662559 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a53fc-98f8-4338-b729-08f5b7c6193c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:38.704555 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e115b3-36a0-44d8-abcc-9ccd24c255ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:38.705347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e115b3-36a0-44d8-abcc-9ccd24c255ad None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:38.705621 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e115b3-36a0-44d8-abcc-9ccd24c255ad None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:38.705890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e115b3-36a0-44d8-abcc-9ccd24c255ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:38.716481 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e115b3-36a0-44d8-abcc-9ccd24c255ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:38.718039 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e115b3-36a0-44d8-abcc-9ccd24c255ad None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:38.736685 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-a3e115b3-36a0-44d8-abcc-9ccd24c255ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:38.736685 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:38.736685 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:38.736685 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:38.736685 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:38.736685 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:38.736685 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:38.736685 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:38.736685 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:38.736685 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:38.736685 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:38.736685 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:38.736685 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:38.736685 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:38.736685 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:38.737713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:38.737713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:38.737713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:38.737713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:38.737713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:38.737713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:38.737713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:38.737713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:38.737713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:38.737713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:38.737713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:38.737713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:38.737713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:38.737713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:38.737713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:38.737713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:38.737713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:38.738667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:38.738667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:38.738667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:38.738667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:38.742366 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 375/745] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:38.743838 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84870aa-3db6-43b7-8466-38babc83aea9 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:38.743959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84870aa-3db6-43b7-8466-38babc83aea9 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:38.744238 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84870aa-3db6-43b7-8466-38babc83aea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:38.760955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94adcf-7b2b-409c-b425-16f4571a1590 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:38.764112 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-b84870aa-3db6-43b7-8466-38babc83aea9 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:38.765384 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b84870aa-3db6-43b7-8466-38babc83aea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:38.785305 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:38.818350 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e3b89-1a80-4f56-b61a-7f9dce978286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:38.819544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e3b89-1a80-4f56-b61a-7f9dce978286 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:38.820035 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e3b89-1a80-4f56-b61a-7f9dce978286 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:38.820516 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e3b89-1a80-4f56-b61a-7f9dce978286 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:38.834453 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e3b89-1a80-4f56-b61a-7f9dce978286 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:38.836341 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e3b89-1a80-4f56-b61a-7f9dce978286 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:38.850968 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 376/746] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:38 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 05:41:38.852177 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84870aa-3db6-43b7-8466-38babc83aea9 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:38.854745 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-311e3b89-1a80-4f56-b61a-7f9dce978286 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:38.854745 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:38.854745 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:38.854745 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:38.854745 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:38.854745 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:38.854745 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:38.854745 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:38.854745 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:38.854745 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:38.854745 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:38.854745 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:38.854745 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:38.854745 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:38.854745 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:38.855702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:38.855702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:38.855702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:38.855702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:38.855702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:38.855702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:38.855702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:38.855702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:38.855702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:38.855702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:38.855702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:38.855702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:38.855702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:38.855702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:38.855702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:38.855702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:38.855702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:38.856870 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:38.856870 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:38.856870 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:38.856870 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:38.856870 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 371/747] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:38.857840 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e3b89-1a80-4f56-b61a-7f9dce978286 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:38.933594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:38.981998 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e3b89-1a80-4f56-b61a-7f9dce978286 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:38.982374 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84870aa-3db6-43b7-8466-38babc83aea9 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:39.020150 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609794ae-8c85-4a52-9a86-f3e8c9719a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:39.020384 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ce033-9df7-4235-ab06-b7ef757c4f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:39.020815 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ce033-9df7-4235-ab06-b7ef757c4f10 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:39.020917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609794ae-8c85-4a52-9a86-f3e8c9719a94 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:39.021094 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ce033-9df7-4235-ab06-b7ef757c4f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:39.021187 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609794ae-8c85-4a52-9a86-f3e8c9719a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:39.021375 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609794ae-8c85-4a52-9a86-f3e8c9719a94 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:39.021468 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ce033-9df7-4235-ab06-b7ef757c4f10 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:39.022134 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ce033-9df7-4235-ab06-b7ef757c4f10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:39.022244 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609794ae-8c85-4a52-9a86-f3e8c9719a94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:39.022453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609794ae-8c85-4a52-9a86-f3e8c9719a94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:39.022618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ce033-9df7-4235-ab06-b7ef757c4f10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:39.023834 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609794ae-8c85-4a52-9a86-f3e8c9719a94 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:39.023927 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ce033-9df7-4235-ab06-b7ef757c4f10 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:39.033280 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 377/748] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:41:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:39.033956 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609794ae-8c85-4a52-9a86-f3e8c9719a94 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:39.045887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 372/749] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:39.045887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ce033-9df7-4235-ab06-b7ef757c4f10 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:39.055419 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:39.147766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609794ae-8c85-4a52-9a86-f3e8c9719a94 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:39.158061 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ce033-9df7-4235-ab06-b7ef757c4f10 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:39.177233 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:39.184586 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6159ba06-a3f7-4792-b55a-3c45225ed7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:39.185257 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159ba06-a3f7-4792-b55a-3c45225ed7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:39.185541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159ba06-a3f7-4792-b55a-3c45225ed7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:39.185820 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159ba06-a3f7-4792-b55a-3c45225ed7f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:39.186635 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6159ba06-a3f7-4792-b55a-3c45225ed7f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:39.186946 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6159ba06-a3f7-4792-b55a-3c45225ed7f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:39.188403 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6159ba06-a3f7-4792-b55a-3c45225ed7f2 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:39.195815 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ea70e-0219-4976-91a7-e58b76e42cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:39.196504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ea70e-0219-4976-91a7-e58b76e42cd1 None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:39.196784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ea70e-0219-4976-91a7-e58b76e42cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:39.197064 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ea70e-0219-4976-91a7-e58b76e42cd1 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:39.197794 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ea70e-0219-4976-91a7-e58b76e42cd1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:39.199225 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ea70e-0219-4976-91a7-e58b76e42cd1 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:39.201555 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 378/750] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:39.206371 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6159ba06-a3f7-4792-b55a-3c45225ed7f2 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:39.225315 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 373/751] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jun 21 05:41:39 2022] POST /identity/v3/services => generated 240 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:41:39.226568 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ea70e-0219-4976-91a7-e58b76e42cd1 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:39.316069 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:39.346252 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6159ba06-a3f7-4792-b55a-3c45225ed7f2 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:39.375132 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ea70e-0219-4976-91a7-e58b76e42cd1 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:39.392219 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6a92a-72cf-4633-a78f-b0299bb80112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:39.393297 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6a92a-72cf-4633-a78f-b0299bb80112 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:39.393920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6a92a-72cf-4633-a78f-b0299bb80112 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:39.394381 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6a92a-72cf-4633-a78f-b0299bb80112 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:39.408545 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f6a92a-72cf-4633-a78f-b0299bb80112 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:39.410322 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f6a92a-72cf-4633-a78f-b0299bb80112 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:39.418945 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2887884-33b2-4628-8bd7-7380d050fd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:39.419854 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2887884-33b2-4628-8bd7-7380d050fd0b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:39.420208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2887884-33b2-4628-8bd7-7380d050fd0b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:39.420552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2887884-33b2-4628-8bd7-7380d050fd0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:39.429463 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2887884-33b2-4628-8bd7-7380d050fd0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:39.430975 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2887884-33b2-4628-8bd7-7380d050fd0b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:39.431413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-e8f6a92a-72cf-4633-a78f-b0299bb80112 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:39.431413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:39.431413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:39.431413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:39.431413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:39.431413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:39.431413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:39.431413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:39.431413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:39.431413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:39.431413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:39.431413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:39.431413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:39.431413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:39.431413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:39.432264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:39.432264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:39.432264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:39.432264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:39.432264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:39.432264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:39.432264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:39.432264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:39.432264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:39.432264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:39.432264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:39.432264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:39.432264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:39.432264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:39.432264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:39.432264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:39.432264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:39.433153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:39.433153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:39.433153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:39.433153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:39.433153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 379/752] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:39.433425 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6a92a-72cf-4633-a78f-b0299bb80112 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:39.453438 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-c2887884-33b2-4628-8bd7-7380d050fd0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:39.453438 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:39.453438 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:39.453438 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:39.453438 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:39.453438 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:39.453438 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:39.453438 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:39.453438 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:39.453438 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:39.453438 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:39.453438 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:39.453438 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:41:39.453438 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:41:39.453438 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:41:39.454429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:41:39.454429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:39.454429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:39.454429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:39.454429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:39.454429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:39.454429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:39.454429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:39.454429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:39.454429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:39.454429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:39.454429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:39.454429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:39.454429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:39.454429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:39.454429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:39.454429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:39.455324 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:41:39.455324 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:41:39.455324 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:41:39.455324 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:41:39.455324 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:41:39.455324 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:41:39.455324 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:39.455324 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:39.455324 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 374/753] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:39.456275 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2887884-33b2-4628-8bd7-7380d050fd0b None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:39.495959 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:39.577597 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6a92a-72cf-4633-a78f-b0299bb80112 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:39.598945 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2887884-33b2-4628-8bd7-7380d050fd0b None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:39.610964 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:39.622049 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d377f-7c9f-45c8-96a5-cecf4eaa6c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:39.622934 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d377f-7c9f-45c8-96a5-cecf4eaa6c91 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:39.623278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d377f-7c9f-45c8-96a5-cecf4eaa6c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:39.623617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d377f-7c9f-45c8-96a5-cecf4eaa6c91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:39.635740 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d377f-7c9f-45c8-96a5-cecf4eaa6c91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:39.637449 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d377f-7c9f-45c8-96a5-cecf4eaa6c91 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:39.648729 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b069aa-84f9-4711-83c5-153967ad97f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:39.649494 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b069aa-84f9-4711-83c5-153967ad97f3 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:39.649852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b069aa-84f9-4711-83c5-153967ad97f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:39.650224 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b069aa-84f9-4711-83c5-153967ad97f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:39.651036 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b069aa-84f9-4711-83c5-153967ad97f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:39.651417 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b069aa-84f9-4711-83c5-153967ad97f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:39.652856 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b069aa-84f9-4711-83c5-153967ad97f3 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:39.653971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-877d377f-7c9f-45c8-96a5-cecf4eaa6c91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:39.653971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:39.653971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:39.653971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:39.653971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:39.653971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:39.653971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:39.653971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:39.653971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:39.653971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:39.653971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:39.653971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:39.653971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:41:39.653971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:41:39.653971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:41:39.655053 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:41:39.655053 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:39.655053 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:39.655053 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:39.655053 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:39.655053 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:39.655053 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:39.655053 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:39.655053 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:39.655053 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:39.655053 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:39.655053 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:39.655053 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:39.655053 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:39.655053 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:39.655053 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:39.655053 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:39.655975 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:41:39.655975 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:41:39.655975 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:41:39.655975 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:41:39.655975 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:41:39.655975 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:41:39.655975 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:39.655975 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:39.661085 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 380/754] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:39.662009 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d377f-7c9f-45c8-96a5-cecf4eaa6c91 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:39.667025 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 375/755] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:39.667922 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b069aa-84f9-4711-83c5-153967ad97f3 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:39.771176 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:39.773721 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d377f-7c9f-45c8-96a5-cecf4eaa6c91 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:39.778349 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b069aa-84f9-4711-83c5-153967ad97f3 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:39.813680 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e707ab-fc0a-4b92-a32b-57a7981fe1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:39.814732 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e707ab-fc0a-4b92-a32b-57a7981fe1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:39.815162 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e707ab-fc0a-4b92-a32b-57a7981fe1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:39.815594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32c4e2-8f28-4270-9ded-de1636cbb395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:39.815738 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e707ab-fc0a-4b92-a32b-57a7981fe1c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:39.816386 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32c4e2-8f28-4270-9ded-de1636cbb395 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:39.816758 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32c4e2-8f28-4270-9ded-de1636cbb395 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:39.817006 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e707ab-fc0a-4b92-a32b-57a7981fe1c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:39.817115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32c4e2-8f28-4270-9ded-de1636cbb395 None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:39.817594 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e707ab-fc0a-4b92-a32b-57a7981fe1c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:39.817989 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32c4e2-8f28-4270-9ded-de1636cbb395 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:39.818310 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32c4e2-8f28-4270-9ded-de1636cbb395 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:39.819074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e707ab-fc0a-4b92-a32b-57a7981fe1c5 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:39.819731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32c4e2-8f28-4270-9ded-de1636cbb395 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:39.832960 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 381/756] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:41:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:39.833270 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 376/757] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:41:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:39.838549 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e707ab-fc0a-4b92-a32b-57a7981fe1c5 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:39.838763 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32c4e2-8f28-4270-9ded-de1636cbb395 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:39.898741 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:39.946759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32c4e2-8f28-4270-9ded-de1636cbb395 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:39.976417 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e707ab-fc0a-4b92-a32b-57a7981fe1c5 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:39.986037 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6961ed-10ea-49c4-8089-b6a85a8a3dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:39.987080 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6961ed-10ea-49c4-8089-b6a85a8a3dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:39.987570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6961ed-10ea-49c4-8089-b6a85a8a3dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:39.988054 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6961ed-10ea-49c4-8089-b6a85a8a3dd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:39.989159 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6961ed-10ea-49c4-8089-b6a85a8a3dd9 None admin] RBAC: Adding query filter params (role.id=24aa6040c86049f996560e477e83886f, scope.project.id=e64b932ef6bf481cb93a04885a93b4b2, user.id=ac485a336d8b4360bce4f495bd02dbde) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:39.989715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6961ed-10ea-49c4-8089-b6a85a8a3dd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:39.991488 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6961ed-10ea-49c4-8089-b6a85a8a3dd9 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:39.998362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 377/758] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:41:39 2022] GET /identity/v3/role_assignments?user.id=ac485a336d8b4360bce4f495bd02dbde&scope.project.id=e64b932ef6bf481cb93a04885a93b4b2&role.id=24aa6040c86049f996560e477e83886f => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:40.000060 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6961ed-10ea-49c4-8089-b6a85a8a3dd9 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:40.040391 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:40.045549 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48209b-845a-478f-8429-de36aeb39372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:40.047094 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48209b-845a-478f-8429-de36aeb39372 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:40.047384 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48209b-845a-478f-8429-de36aeb39372 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:40.047664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48209b-845a-478f-8429-de36aeb39372 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:40.056462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48209b-845a-478f-8429-de36aeb39372 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:40.062028 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48209b-845a-478f-8429-de36aeb39372 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:40.087828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-4c48209b-845a-478f-8429-de36aeb39372 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 05:41:40.087828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:40.087828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:40.087828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:40.087828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:40.087828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:40.087828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:40.087828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:40.087828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:40.087828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:40.087828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:40.087828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:40.087828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:41:40.087828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:41:40.087828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:41:40.087828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:41:40.089030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:40.089030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:40.089030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:41:40.089030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:40.089030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:41:40.089030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:40.089030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:40.089030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:40.089030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:40.089030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:40.089030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:40.089030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:40.089030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:40.089030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:40.089030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:40.089030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:40.089030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:40.089030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:40.090241 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:40.090241 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:40.090241 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:41:40.090241 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:41:40.090241 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:41:40.090241 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:41:40.090241 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:41:40.090241 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:41:40.090241 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 05:41:40.090241 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:40.096370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 382/759] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jun 21 05:41:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:40.100138 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48209b-845a-478f-8429-de36aeb39372 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:40.222892 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6961ed-10ea-49c4-8089-b6a85a8a3dd9 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:40.263234 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09545e6a-b31b-4d44-9a72-99a1156b6092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:40.264167 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09545e6a-b31b-4d44-9a72-99a1156b6092 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:40.264706 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09545e6a-b31b-4d44-9a72-99a1156b6092 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:40.265187 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09545e6a-b31b-4d44-9a72-99a1156b6092 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:40.267169 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09545e6a-b31b-4d44-9a72-99a1156b6092 None admin] RBAC: Adding query filter params (role.id=b2f95849039f475c904876eb2958a375, scope.project.id=e64b932ef6bf481cb93a04885a93b4b2, user.id=af8e0eb5ff8c40ae848929780d99e72d) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:40.267697 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09545e6a-b31b-4d44-9a72-99a1156b6092 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:40.269343 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09545e6a-b31b-4d44-9a72-99a1156b6092 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:40.276544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 378/760] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:41:39 2022] GET /identity/v3/role_assignments?user.id=af8e0eb5ff8c40ae848929780d99e72d&scope.project.id=e64b932ef6bf481cb93a04885a93b4b2&role.id=b2f95849039f475c904876eb2958a375 => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:40.276722 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48209b-845a-478f-8429-de36aeb39372 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:40.287063 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:40.317095 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d504cf-b585-4df5-b5f7-146ea219e0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:40.317893 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d504cf-b585-4df5-b5f7-146ea219e0fc None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:40.318268 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d504cf-b585-4df5-b5f7-146ea219e0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:40.318611 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d504cf-b585-4df5-b5f7-146ea219e0fc None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:40.319526 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d504cf-b585-4df5-b5f7-146ea219e0fc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:40.319902 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d504cf-b585-4df5-b5f7-146ea219e0fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:40.321412 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d504cf-b585-4df5-b5f7-146ea219e0fc None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:40.332378 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705dd9d-cf5c-4c75-ab73-e08f1e3c82df None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:40.332711 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705dd9d-cf5c-4c75-ab73-e08f1e3c82df None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:40.332954 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705dd9d-cf5c-4c75-ab73-e08f1e3c82df None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:40.334811 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 379/761] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:40.341459 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65918ebb-17ee-4d66-8c40-4efe368f4484 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:40.342114 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65918ebb-17ee-4d66-8c40-4efe368f4484 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:40.342637 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65918ebb-17ee-4d66-8c40-4efe368f4484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:40.347170 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 383/762] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jun 21 05:41:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:40.352531 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d504cf-b585-4df5-b5f7-146ea219e0fc None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:40.364721 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-65918ebb-17ee-4d66-8c40-4efe368f4484 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:40.366393 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-65918ebb-17ee-4d66-8c40-4efe368f4484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:40.458285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 380/763] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 05:41:40.479617 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65918ebb-17ee-4d66-8c40-4efe368f4484 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:40.498320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:40.557713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d504cf-b585-4df5-b5f7-146ea219e0fc None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:40.623605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e830b3-e794-450b-b359-c2cc0f7a0789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:40.624818 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e830b3-e794-450b-b359-c2cc0f7a0789 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:40.625387 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e830b3-e794-450b-b359-c2cc0f7a0789 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:40.625870 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e830b3-e794-450b-b359-c2cc0f7a0789 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:40.644649 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e830b3-e794-450b-b359-c2cc0f7a0789 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:40.646576 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65918ebb-17ee-4d66-8c40-4efe368f4484 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:40.654242 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e830b3-e794-450b-b359-c2cc0f7a0789 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:40.684357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-a9e830b3-e794-450b-b359-c2cc0f7a0789 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:40.684357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:40.684357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:40.684357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:40.684357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:40.684357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:40.684357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:40.684357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:40.684357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:40.684357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:40.684357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:40.684357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:40.684357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:40.684357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:40.684357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:40.685304 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:40.685304 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:40.685304 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:40.685304 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:40.685304 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:40.685304 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:40.685304 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:40.685304 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:40.685304 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:40.685304 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:40.685304 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:40.685304 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:40.685304 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:40.685304 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:40.685304 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:40.685304 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:40.685304 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:40.686229 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:40.686229 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:40.686229 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:40.686229 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:40.686486 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa4923-5b5f-40b7-8932-6a204d75021c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:40.686486 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa4923-5b5f-40b7-8932-6a204d75021c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:40.686486 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa4923-5b5f-40b7-8932-6a204d75021c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:40.686695 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 384/764] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:40.686762 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa4923-5b5f-40b7-8932-6a204d75021c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:40.687307 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa4923-5b5f-40b7-8932-6a204d75021c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:40.688295 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa4923-5b5f-40b7-8932-6a204d75021c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:40.696558 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e830b3-e794-450b-b359-c2cc0f7a0789 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:40.718590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-55fa4923-5b5f-40b7-8932-6a204d75021c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 05:41:40.718590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:40.718590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 05:41:40.718590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 05:41:40.718590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 05:41:40.718590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 05:41:40.718590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 05:41:40.718590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:41:40.718590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 05:41:40.718590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:40.718590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:41:40.718590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:40.718590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:40.718590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:40.718590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:40.718590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:40.719589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:40.719589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:40.719589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:40.719589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:40.719589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:40.719589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:40.719589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:40.719589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 05:41:40.719589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 05:41:40.719589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 05:41:40.719589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 05:41:40.719589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:40.719589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:40.719589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:40.719589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:40.719589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:40.720457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:40.720457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:40.720457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:40.720457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:40.720457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:40.720457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:40.720457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:40.720457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:40.720457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:40.720457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:40.720457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:40.720457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 05:41:40.720457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:41:40.720457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 05:41:40.720457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:40.724765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 381/765] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Jun 21 05:41:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:41:40.726034 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa4923-5b5f-40b7-8932-6a204d75021c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:40.751800 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:40.814069 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:40.855557 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa4923-5b5f-40b7-8932-6a204d75021c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:40.907305 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04246738-2cdb-4502-907f-bde0041eb306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:40.907981 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04246738-2cdb-4502-907f-bde0041eb306 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:40.908267 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04246738-2cdb-4502-907f-bde0041eb306 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:40.908545 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04246738-2cdb-4502-907f-bde0041eb306 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:40.909266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04246738-2cdb-4502-907f-bde0041eb306 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:40.909575 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04246738-2cdb-4502-907f-bde0041eb306 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:40.910992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04246738-2cdb-4502-907f-bde0041eb306 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:40.927711 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e830b3-e794-450b-b359-c2cc0f7a0789 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:40.929600 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 382/766] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Jun 21 05:41:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:40.931823 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04246738-2cdb-4502-907f-bde0041eb306 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:41.008196 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adf63a-ea9d-4e44-9e33-4b7c1c10fff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:41.008797 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adf63a-ea9d-4e44-9e33-4b7c1c10fff3 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:41.009082 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adf63a-ea9d-4e44-9e33-4b7c1c10fff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:41.009360 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adf63a-ea9d-4e44-9e33-4b7c1c10fff3 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:41.010114 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adf63a-ea9d-4e44-9e33-4b7c1c10fff3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:41.010427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adf63a-ea9d-4e44-9e33-4b7c1c10fff3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:41.011815 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adf63a-ea9d-4e44-9e33-4b7c1c10fff3 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:41.035846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 385/767] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:41.040874 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adf63a-ea9d-4e44-9e33-4b7c1c10fff3 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:41.043633 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04246738-2cdb-4502-907f-bde0041eb306 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:41.080800 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f54771-5297-47cc-9622-7e96214fac8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:41.081519 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f54771-5297-47cc-9622-7e96214fac8e None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:41.081812 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f54771-5297-47cc-9622-7e96214fac8e None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:41.082122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f54771-5297-47cc-9622-7e96214fac8e None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:41.082955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f54771-5297-47cc-9622-7e96214fac8e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:41.083268 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f54771-5297-47cc-9622-7e96214fac8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:41.084639 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f54771-5297-47cc-9622-7e96214fac8e None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:41.096757 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 383/768] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Jun 21 05:41:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:41:41.098182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f54771-5297-47cc-9622-7e96214fac8e None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:41.102309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:41.212293 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f54771-5297-47cc-9622-7e96214fac8e None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:41.252305 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43532fe8-d23a-4635-ae02-90193994ed12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:41.253356 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43532fe8-d23a-4635-ae02-90193994ed12 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:41.253846 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43532fe8-d23a-4635-ae02-90193994ed12 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:41.254451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43532fe8-d23a-4635-ae02-90193994ed12 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:41.255470 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43532fe8-d23a-4635-ae02-90193994ed12 None admin] RBAC: Adding query filter params (interface=public, service_id=137dffe94e224cceb158be76c3f8535b, region_id=RegionOne) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:41.256008 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43532fe8-d23a-4635-ae02-90193994ed12 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:41.257642 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43532fe8-d23a-4635-ae02-90193994ed12 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:41.260248 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:41.273325 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 384/769] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jun 21 05:41:41 2022] GET /identity/v3/endpoints?service_id=137dffe94e224cceb158be76c3f8535b&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:41.274931 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43532fe8-d23a-4635-ae02-90193994ed12 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:41.320144 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adf63a-ea9d-4e44-9e33-4b7c1c10fff3 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:41.361965 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:41.390644 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4969fc9-c9b6-49de-abc2-2a83240f3c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:41.391450 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4969fc9-c9b6-49de-abc2-2a83240f3c55 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:41.391732 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4969fc9-c9b6-49de-abc2-2a83240f3c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:41.392005 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4969fc9-c9b6-49de-abc2-2a83240f3c55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:41.405763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4969fc9-c9b6-49de-abc2-2a83240f3c55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:41.407267 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4969fc9-c9b6-49de-abc2-2a83240f3c55 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:41.433305 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43532fe8-d23a-4635-ae02-90193994ed12 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:41.435891 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-c4969fc9-c9b6-49de-abc2-2a83240f3c55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:41.435891 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:41.435891 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:41.435891 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:41.435891 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:41.435891 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:41.435891 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:41.435891 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:41.435891 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:41.435891 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:41.435891 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:41.435891 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:41.435891 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:41:41.435891 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:41:41.435891 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:41:41.437361 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:41:41.437361 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:41.437361 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:41.437361 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:41.437361 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:41.437361 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:41.437361 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:41.437361 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:41.437361 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:41.437361 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:41.437361 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:41.437361 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:41.437361 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:41.437361 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:41.437361 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:41.437361 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:41.437361 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:41.438499 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:41:41.438499 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:41:41.438499 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:41:41.438499 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:41:41.438499 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:41:41.438499 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:41:41.438499 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:41.438499 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:41.438499 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 386/770] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:41:41.445779 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4969fc9-c9b6-49de-abc2-2a83240f3c55 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:41.493086 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109da96-9d79-450d-a6ed-cb05194bc25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:41.493772 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109da96-9d79-450d-a6ed-cb05194bc25b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:41.494088 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109da96-9d79-450d-a6ed-cb05194bc25b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:41.494372 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109da96-9d79-450d-a6ed-cb05194bc25b None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:41.495073 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a109da96-9d79-450d-a6ed-cb05194bc25b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:41.496462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a109da96-9d79-450d-a6ed-cb05194bc25b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:41.506687 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 385/771] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jun 21 05:41:41 2022] GET /identity/v3/services => generated 772 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:41:41.600425 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4969fc9-c9b6-49de-abc2-2a83240f3c55 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:41.648159 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efcbfb-ad50-4db6-bedb-a1cfa9e2c41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:41.648848 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efcbfb-ad50-4db6-bedb-a1cfa9e2c41f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:41.649142 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efcbfb-ad50-4db6-bedb-a1cfa9e2c41f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:41.649424 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efcbfb-ad50-4db6-bedb-a1cfa9e2c41f None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:41.650257 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3efcbfb-ad50-4db6-bedb-a1cfa9e2c41f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:41.650572 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3efcbfb-ad50-4db6-bedb-a1cfa9e2c41f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:41.652130 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3efcbfb-ad50-4db6-bedb-a1cfa9e2c41f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:41.659439 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:41.671548 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 387/772] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:41:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:41.677056 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109da96-9d79-450d-a6ed-cb05194bc25b None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:41.717559 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee475f5-3299-4e06-b434-ca994a3735c2 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:41.717893 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee475f5-3299-4e06-b434-ca994a3735c2 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:41.718197 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee475f5-3299-4e06-b434-ca994a3735c2 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:41.719589 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 388/773] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 05:41:41.726928 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd58ed7-d901-428c-a25c-bab224876f20 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:41.726928 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd58ed7-d901-428c-a25c-bab224876f20 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:41.726928 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd58ed7-d901-428c-a25c-bab224876f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:41.752163 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-fcd58ed7-d901-428c-a25c-bab224876f20 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:41.754464 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-fcd58ed7-d901-428c-a25c-bab224876f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:41.825688 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109da96-9d79-450d-a6ed-cb05194bc25b None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:41.851970 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 389/774] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 05:41:41.876432 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:41.886936 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7851b-75aa-4de0-9240-e0548e046ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:41.887894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7851b-75aa-4de0-9240-e0548e046ad8 None admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:41.888236 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7851b-75aa-4de0-9240-e0548e046ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:41.888522 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7851b-75aa-4de0-9240-e0548e046ad8 None admin] PATH_INFO: `/v3/projects/e64b932ef6bf481cb93a04885a93b4b2/users/f702830987ba4548a4c2ee3d0e302d02/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:41.890884 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7851b-75aa-4de0-9240-e0548e046ad8 None admin] RBAC: Authorizing `identity:create_grant(project_id=e64b932ef6bf481cb93a04885a93b4b2, user_id=f702830987ba4548a4c2ee3d0e302d02, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:41.892393 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7851b-75aa-4de0-9240-e0548e046ad8 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:41.908205 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd58ed7-d901-428c-a25c-bab224876f20 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:41.936520 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 386/775] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 21 05:41:41 2022] PUT /identity/v3/projects/e64b932ef6bf481cb93a04885a93b4b2/users/f702830987ba4548a4c2ee3d0e302d02/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:41:42.070056 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd58ed7-d901-428c-a25c-bab224876f20 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:42.126321 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:42.140691 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1dc78-c61f-48d5-ba45-e61560d3c47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:42.141512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1dc78-c61f-48d5-ba45-e61560d3c47b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:42.141786 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1dc78-c61f-48d5-ba45-e61560d3c47b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:42.142089 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1dc78-c61f-48d5-ba45-e61560d3c47b None admin] PATH_INFO: `/v3/services/network` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:42.142768 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1dc78-c61f-48d5-ba45-e61560d3c47b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:42.144188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1dc78-c61f-48d5-ba45-e61560d3c47b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:42.166466 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-fef1dc78-c61f-48d5-ba45-e61560d3c47b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 05:41:42.166466 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:42.166466 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 05:41:42.166466 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 05:41:42.166466 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 05:41:42.166466 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 05:41:42.166466 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 05:41:42.166466 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:41:42.166466 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 05:41:42.166466 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:42.166466 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:41:42.166466 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:42.166466 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:42.166466 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:42.166466 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:42.166466 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:42.166466 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:42.167537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:42.167537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:42.167537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:42.167537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:42.167537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:42.167537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:42.167537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 05:41:42.167537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 05:41:42.167537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 05:41:42.167537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 05:41:42.167537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:42.167537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:42.167537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:42.167537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:42.167537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:42.167537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:42.168387 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:42.168387 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:42.168387 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:42.168387 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:42.168387 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:42.168387 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:42.168387 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:42.168387 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:42.168387 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:42.168387 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:42.168387 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 05:41:42.168387 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:41:42.168387 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 05:41:42.168387 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:42.168387 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 390/776] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:41 2022] GET /identity/v3/services/network => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:42.175870 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7851b-75aa-4de0-9240-e0548e046ad8 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:42.304010 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7851b-75aa-4de0-9240-e0548e046ad8 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:42.339892 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe734e-ea0d-4f37-924b-8f58f793249c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:42.340570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe734e-ea0d-4f37-924b-8f58f793249c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:42.340851 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe734e-ea0d-4f37-924b-8f58f793249c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:42.341129 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe734e-ea0d-4f37-924b-8f58f793249c None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:42.341849 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe734e-ea0d-4f37-924b-8f58f793249c None admin] RBAC: Adding query filter params (name=network) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:42.342195 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe734e-ea0d-4f37-924b-8f58f793249c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:42.344141 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe734e-ea0d-4f37-924b-8f58f793249c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:42.349575 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 387/777] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jun 21 05:41:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:42.355069 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1dc78-c61f-48d5-ba45-e61560d3c47b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:42.498966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1dc78-c61f-48d5-ba45-e61560d3c47b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:42.541617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35032dff-774b-4ad1-a7f0-6ceb8e5c1ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:42.542691 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35032dff-774b-4ad1-a7f0-6ceb8e5c1ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:42.543207 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35032dff-774b-4ad1-a7f0-6ceb8e5c1ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:42.543715 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35032dff-774b-4ad1-a7f0-6ceb8e5c1ab9 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:42.544636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35032dff-774b-4ad1-a7f0-6ceb8e5c1ab9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:42.545153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35032dff-774b-4ad1-a7f0-6ceb8e5c1ab9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:42.547377 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35032dff-774b-4ad1-a7f0-6ceb8e5c1ab9 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:42.555061 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 391/778] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jun 21 05:41:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:42.561109 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe734e-ea0d-4f37-924b-8f58f793249c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:42.642692 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:42.687391 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7b90d-76e7-4667-b20d-fe2d2f990615 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:42.688025 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7b90d-76e7-4667-b20d-fe2d2f990615 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:42.688527 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7b90d-76e7-4667-b20d-fe2d2f990615 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:42.690525 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 392/779] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 05:41:42.699408 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98372911-d7fb-4b47-afca-712e851832fb None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:42.700008 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98372911-d7fb-4b47-afca-712e851832fb None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:42.700501 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98372911-d7fb-4b47-afca-712e851832fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:42.705971 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe734e-ea0d-4f37-924b-8f58f793249c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:42.743103 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-98372911-d7fb-4b47-afca-712e851832fb None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:42.744574 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-98372911-d7fb-4b47-afca-712e851832fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:42.762647 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc6d6c-691c-4b18-acf4-e35d7bf973d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:42.763662 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc6d6c-691c-4b18-acf4-e35d7bf973d3 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:42.764145 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc6d6c-691c-4b18-acf4-e35d7bf973d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:42.765202 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc6d6c-691c-4b18-acf4-e35d7bf973d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:42.766226 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc6d6c-691c-4b18-acf4-e35d7bf973d3 None admin] RBAC: Adding query filter params (interface=public, service_id=d90c381fafe34ba6bcc6ac1e0df81e21, region_id=RegionOne) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:42.767968 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc6d6c-691c-4b18-acf4-e35d7bf973d3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:42.769552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc6d6c-691c-4b18-acf4-e35d7bf973d3 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:42.781654 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 388/780] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jun 21 05:41:42 2022] GET /identity/v3/endpoints?service_id=d90c381fafe34ba6bcc6ac1e0df81e21&interface=public®ion_id=RegionOne => generated 194 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:42.787834 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc6d6c-691c-4b18-acf4-e35d7bf973d3 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:42.845224 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:42.893958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 393/781] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:41:42.895429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ddc9e1-809f-48ae-8dee-bc0c3a2ac7db None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:42.895647 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ddc9e1-809f-48ae-8dee-bc0c3a2ac7db None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:42.895927 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ddc9e1-809f-48ae-8dee-bc0c3a2ac7db None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:42.897565 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 394/782] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:42.908699 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc6d6c-691c-4b18-acf4-e35d7bf973d3 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:42.915536 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c065f03-5859-4c43-a7d4-10a57cf8e300 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:42.915821 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c065f03-5859-4c43-a7d4-10a57cf8e300 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:42.916106 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c065f03-5859-4c43-a7d4-10a57cf8e300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:42.932918 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:42.938767 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-4c065f03-5859-4c43-a7d4-10a57cf8e300 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:42.940162 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-4c065f03-5859-4c43-a7d4-10a57cf8e300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:42.950289 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccbe84-f4ad-41fb-a4ad-730d06c9d304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:42.951203 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccbe84-f4ad-41fb-a4ad-730d06c9d304 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:42.951668 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccbe84-f4ad-41fb-a4ad-730d06c9d304 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:42.952697 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccbe84-f4ad-41fb-a4ad-730d06c9d304 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:42.953529 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cccbe84-f4ad-41fb-a4ad-730d06c9d304 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:42.955182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cccbe84-f4ad-41fb-a4ad-730d06c9d304 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:42.961789 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 389/783] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jun 21 05:41:42 2022] GET /identity/v3/services => generated 772 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:42.962987 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccbe84-f4ad-41fb-a4ad-730d06c9d304 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:43.023558 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 395/784] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 05:41:43.061083 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c065f03-5859-4c43-a7d4-10a57cf8e300 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:43.079582 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccbe84-f4ad-41fb-a4ad-730d06c9d304 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:43.128186 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f651da-8132-49c1-a725-8052a1d972d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:43.129106 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f651da-8132-49c1-a725-8052a1d972d9 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:43.129395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f651da-8132-49c1-a725-8052a1d972d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:43.129672 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f651da-8132-49c1-a725-8052a1d972d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:43.152263 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f651da-8132-49c1-a725-8052a1d972d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:43.166816 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-b9f651da-8132-49c1-a725-8052a1d972d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:41:43.166816 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:43.166816 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:43.166816 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:43.166816 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:43.166816 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:43.166816 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:43.166816 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:43.166816 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:43.166816 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:43.166816 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:43.166816 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:43.166816 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:43.166816 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:43.166816 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:43.166816 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:43.167852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:43.167852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:43.167852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:43.167852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:43.167852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:43.167852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:43.167852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:43.167852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:43.167852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:43.167852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:43.167852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:43.167852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:43.167852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:43.167852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:43.167852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:43.167852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:43.168746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:43.168746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:43.168746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:43.168746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:43.168746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:43.168746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:43.168746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:43.168746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:43.168746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:43.168746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:43.168746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:41:43.168746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:43.168746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 390/785] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:41:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:43.176488 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f651da-8132-49c1-a725-8052a1d972d9 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:43.177277 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c065f03-5859-4c43-a7d4-10a57cf8e300 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:43.210340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:43.219871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0db4be-1bf7-43e7-9ed1-69eedcbdcbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:43.221019 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0db4be-1bf7-43e7-9ed1-69eedcbdcbde None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:43.221478 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0db4be-1bf7-43e7-9ed1-69eedcbdcbde None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:43.221909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0db4be-1bf7-43e7-9ed1-69eedcbdcbde None admin] PATH_INFO: `/v3/roles/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:43.236445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0db4be-1bf7-43e7-9ed1-69eedcbdcbde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:43.241452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:43.247833 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-5a0db4be-1bf7-43e7-9ed1-69eedcbdcbde None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:43.247833 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:43.247833 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:43.247833 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:43.247833 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:43.247833 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:43.247833 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:43.247833 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:43.247833 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:43.247833 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:43.247833 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:43.247833 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:43.247833 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:43.247833 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:43.247833 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:43.247833 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:43.249830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:43.249830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:43.249830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:43.249830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:43.249830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:43.249830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:43.249830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:43.249830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:43.249830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:43.249830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:43.249830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:43.249830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:43.249830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:43.249830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:43.249830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:43.249830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:43.251460 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:43.251460 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:43.251460 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:43.251460 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:43.251460 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:43.251460 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:43.251460 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:43.251460 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:43.251460 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:43.251460 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:43.251460 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:43.251460 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:43.254349 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 396/786] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 21 05:41:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:43.260637 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0db4be-1bf7-43e7-9ed1-69eedcbdcbde None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:43.309039 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f651da-8132-49c1-a725-8052a1d972d9 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:43.369211 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64119065-2424-43aa-afb6-9460e78f7a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:43.370098 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64119065-2424-43aa-afb6-9460e78f7a55 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:43.370457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64119065-2424-43aa-afb6-9460e78f7a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:43.370909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64119065-2424-43aa-afb6-9460e78f7a55 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:43.371734 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64119065-2424-43aa-afb6-9460e78f7a55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:43.372418 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64119065-2424-43aa-afb6-9460e78f7a55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:43.374381 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64119065-2424-43aa-afb6-9460e78f7a55 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:43.379474 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0db4be-1bf7-43e7-9ed1-69eedcbdcbde None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:43.400149 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 391/787] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:41:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:41:43.418745 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64119065-2424-43aa-afb6-9460e78f7a55 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:43.427550 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d29f0-b533-4566-bf18-c96f64d0b811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:43.428497 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d29f0-b533-4566-bf18-c96f64d0b811 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:43.430666 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d29f0-b533-4566-bf18-c96f64d0b811 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:43.431140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d29f0-b533-4566-bf18-c96f64d0b811 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:43.432142 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d29f0-b533-4566-bf18-c96f64d0b811 None admin] RBAC: Adding query filter params (name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:43.436218 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d29f0-b533-4566-bf18-c96f64d0b811 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:43.437879 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d29f0-b533-4566-bf18-c96f64d0b811 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:43.451444 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 397/788] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 21 05:41:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:41:43.457264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d29f0-b533-4566-bf18-c96f64d0b811 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:43.501870 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:43.547081 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64119065-2424-43aa-afb6-9460e78f7a55 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:43.558287 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:43.590018 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3c248-777c-4718-a564-3faa0bdfaf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:43.590826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3c248-777c-4718-a564-3faa0bdfaf3f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:43.591124 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3c248-777c-4718-a564-3faa0bdfaf3f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:43.591392 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3c248-777c-4718-a564-3faa0bdfaf3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:43.617227 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d29f0-b533-4566-bf18-c96f64d0b811 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:43.619169 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3c248-777c-4718-a564-3faa0bdfaf3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:43.620784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3c248-777c-4718-a564-3faa0bdfaf3f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:43.653170 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f900d-63ca-46cb-9a47-9bc41d36a85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:43.653992 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f900d-63ca-46cb-9a47-9bc41d36a85b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:43.654279 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f900d-63ca-46cb-9a47-9bc41d36a85b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:43.654556 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f900d-63ca-46cb-9a47-9bc41d36a85b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:43.658820 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-97f3c248-777c-4718-a564-3faa0bdfaf3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:43.658820 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:43.658820 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:43.658820 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:43.658820 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:43.658820 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:43.658820 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:43.658820 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:43.658820 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:43.658820 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:43.658820 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:43.658820 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:43.658820 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:43.658820 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:43.658820 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:43.659705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:43.659705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:43.659705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:43.659705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:43.659705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:43.659705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:43.659705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:43.659705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:43.659705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:43.659705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:43.659705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:43.659705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:43.659705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:43.659705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:43.659705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:43.659705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:43.659705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:43.660588 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:43.660588 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:43.660588 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:43.660588 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:43.660588 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 392/789] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:43.666748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3c248-777c-4718-a564-3faa0bdfaf3f None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:43.666893 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f900d-63ca-46cb-9a47-9bc41d36a85b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:43.668285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f900d-63ca-46cb-9a47-9bc41d36a85b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:43.688225 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-fa7f900d-63ca-46cb-9a47-9bc41d36a85b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:43.688225 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:43.688225 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:43.688225 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:43.688225 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:43.688225 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:43.688225 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:43.688225 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:43.688225 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:43.688225 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:43.688225 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:43.688225 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:43.688225 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:43.688225 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:43.688225 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:43.689251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:43.689251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:43.689251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:43.689251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:43.689251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:43.689251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:43.689251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:43.689251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:43.689251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:43.689251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:43.689251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:43.689251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:43.689251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:43.689251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:43.689251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:43.689251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:43.689251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:43.690192 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:43.690192 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:43.690192 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:43.690192 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:43.690192 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 398/790] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:41:43.694966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f900d-63ca-46cb-9a47-9bc41d36a85b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:43.803851 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3c248-777c-4718-a564-3faa0bdfaf3f None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:43.864281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fb83e-14ab-444e-8080-adfb19ffcaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:43.864960 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fb83e-14ab-444e-8080-adfb19ffcaf9 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:43.865243 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fb83e-14ab-444e-8080-adfb19ffcaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:43.865520 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fb83e-14ab-444e-8080-adfb19ffcaf9 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:43.866283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fb83e-14ab-444e-8080-adfb19ffcaf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:43.866589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fb83e-14ab-444e-8080-adfb19ffcaf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:43.867975 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fb83e-14ab-444e-8080-adfb19ffcaf9 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:43.877603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:43.898548 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 393/791] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:43.901303 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f900d-63ca-46cb-9a47-9bc41d36a85b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:43.906175 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fb83e-14ab-444e-8080-adfb19ffcaf9 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:43.950316 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:43.970383 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac7bc9-d891-4f20-8a5f-bb13d54548fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:43.971044 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac7bc9-d891-4f20-8a5f-bb13d54548fa None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:43.971329 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac7bc9-d891-4f20-8a5f-bb13d54548fa None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:43.971610 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac7bc9-d891-4f20-8a5f-bb13d54548fa None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:43.972346 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac7bc9-d891-4f20-8a5f-bb13d54548fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:43.972655 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac7bc9-d891-4f20-8a5f-bb13d54548fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:43.974694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac7bc9-d891-4f20-8a5f-bb13d54548fa None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:44.001065 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 399/792] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:41:44.006277 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac7bc9-d891-4f20-8a5f-bb13d54548fa None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:44.121970 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fb83e-14ab-444e-8080-adfb19ffcaf9 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:44.163801 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06147653-a8d4-47e9-926e-7c15ef561d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:44.165114 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06147653-a8d4-47e9-926e-7c15ef561d2f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:44.165645 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06147653-a8d4-47e9-926e-7c15ef561d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:44.166164 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06147653-a8d4-47e9-926e-7c15ef561d2f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:44.175056 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac7bc9-d891-4f20-8a5f-bb13d54548fa None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:44.175550 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06147653-a8d4-47e9-926e-7c15ef561d2f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:44.177366 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06147653-a8d4-47e9-926e-7c15ef561d2f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:44.194320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-06147653-a8d4-47e9-926e-7c15ef561d2f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 05:41:44.194320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:44.194320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:44.194320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:44.194320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:44.194320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:44.194320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:44.194320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:44.194320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:44.194320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:44.194320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:44.194320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:44.194320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:41:44.194320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:41:44.194320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:41:44.194320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:41:44.195312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:44.195312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:44.195312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:41:44.195312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:44.195312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:41:44.195312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:44.195312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:44.195312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:44.195312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:44.195312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:44.195312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:44.195312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:44.195312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:44.195312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:44.195312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:44.195312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:44.195312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:44.195312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:44.196269 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:44.196269 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:44.196269 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:41:44.196269 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:41:44.196269 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:41:44.196269 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:41:44.196269 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:41:44.196269 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:41:44.196269 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 05:41:44.196269 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:44.198974 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 394/793] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:41:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:44.200481 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287cd5f-9bdc-40e8-a1e8-4bfcf73a185d None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:44.200984 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287cd5f-9bdc-40e8-a1e8-4bfcf73a185d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:44.201474 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287cd5f-9bdc-40e8-a1e8-4bfcf73a185d None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:44.207089 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 395/794] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:44.207089 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287cd5f-9bdc-40e8-a1e8-4bfcf73a185d None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:44.223485 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d9274-b611-41ce-bac2-808e5bf12e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:44.225521 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d9274-b611-41ce-bac2-808e5bf12e6f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:44.226072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d9274-b611-41ce-bac2-808e5bf12e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:44.226551 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d9274-b611-41ce-bac2-808e5bf12e6f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:44.237131 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d9274-b611-41ce-bac2-808e5bf12e6f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:44.239358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d9274-b611-41ce-bac2-808e5bf12e6f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:44.258247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-5c8d9274-b611-41ce-bac2-808e5bf12e6f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 05:41:44.258247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:44.258247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:44.258247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:44.258247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:44.258247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:44.258247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:44.258247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:44.258247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:44.258247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:44.258247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:44.258247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:44.258247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:41:44.258247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:41:44.258247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:41:44.258247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:41:44.259206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:44.259206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:44.259206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:41:44.259206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:44.259206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:41:44.259206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:44.259206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:44.259206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:44.259206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:44.259206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:44.259206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:44.259206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:44.259206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:44.259206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:44.259206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:44.259206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:44.259206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:44.259206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:44.260149 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:44.260149 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:44.260149 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:41:44.260149 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:41:44.260149 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:41:44.260149 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:41:44.260149 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:41:44.260149 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:41:44.260149 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 05:41:44.260149 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:44.262941 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 400/795] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jun 21 05:41:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:44.264445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25d288-02d4-4a86-b437-c2cefc03dbe0 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:44.265071 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25d288-02d4-4a86-b437-c2cefc03dbe0 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:44.265673 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25d288-02d4-4a86-b437-c2cefc03dbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:44.288835 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-0e25d288-02d4-4a86-b437-c2cefc03dbe0 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:44.290858 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-0e25d288-02d4-4a86-b437-c2cefc03dbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:44.293326 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:44.309596 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:44.335684 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287cd5f-9bdc-40e8-a1e8-4bfcf73a185d None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:44.378039 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 401/796] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:41:44.378039 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25d288-02d4-4a86-b437-c2cefc03dbe0 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:44.395946 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54a1e3-c994-42f5-ae3b-7b387dc67131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:44.396631 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54a1e3-c994-42f5-ae3b-7b387dc67131 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:44.396922 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54a1e3-c994-42f5-ae3b-7b387dc67131 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:44.397207 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54a1e3-c994-42f5-ae3b-7b387dc67131 None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:44.398095 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54a1e3-c994-42f5-ae3b-7b387dc67131 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:44.398408 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54a1e3-c994-42f5-ae3b-7b387dc67131 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:44.399870 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54a1e3-c994-42f5-ae3b-7b387dc67131 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:44.419519 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 396/797] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Jun 21 05:41:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:44.425435 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54a1e3-c994-42f5-ae3b-7b387dc67131 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:44.493391 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25d288-02d4-4a86-b437-c2cefc03dbe0 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:44.528431 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5a0c5-af2c-4363-903b-4703f80c6a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:44.529100 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5a0c5-af2c-4363-903b-4703f80c6a6c None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:44.529383 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5a0c5-af2c-4363-903b-4703f80c6a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:44.529660 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5a0c5-af2c-4363-903b-4703f80c6a6c None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:44.531098 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5a0c5-af2c-4363-903b-4703f80c6a6c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:44.531705 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5a0c5-af2c-4363-903b-4703f80c6a6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:44.533155 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5a0c5-af2c-4363-903b-4703f80c6a6c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:44.541293 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:44.542176 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54a1e3-c994-42f5-ae3b-7b387dc67131 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:44.553610 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 402/798] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Jun 21 05:41:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:44.554265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5a0c5-af2c-4363-903b-4703f80c6a6c None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:44.581570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4a9f0-1822-4b4a-bd6b-f8920d94350d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:44.582404 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4a9f0-1822-4b4a-bd6b-f8920d94350d None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:44.582688 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4a9f0-1822-4b4a-bd6b-f8920d94350d None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:44.582962 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4a9f0-1822-4b4a-bd6b-f8920d94350d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:44.583611 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4a9f0-1822-4b4a-bd6b-f8920d94350d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:44.584971 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4a9f0-1822-4b4a-bd6b-f8920d94350d None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:44.587615 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:44.598755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-dab4a9f0-1822-4b4a-bd6b-f8920d94350d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 05:41:44.598755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:44.598755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 05:41:44.598755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 05:41:44.598755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 05:41:44.598755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 05:41:44.598755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 05:41:44.598755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:41:44.598755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 05:41:44.598755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:44.598755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:41:44.598755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:44.598755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:44.598755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:44.598755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:44.598755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:44.599705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:44.599705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:44.599705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:44.599705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:44.599705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:44.599705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:44.599705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:44.599705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 05:41:44.599705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 05:41:44.599705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 05:41:44.599705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 05:41:44.599705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:44.599705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:44.599705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:44.599705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:44.599705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:44.600552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:44.600552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:44.600552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:44.600552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:44.600552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:44.600552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:44.600552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:44.600552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:44.600552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:44.600552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:44.600552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:44.600552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 05:41:44.600552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:41:44.600552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 05:41:44.600552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:44.600552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 397/799] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Jun 21 05:41:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:44.602013 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e5df3-0d5c-4cb0-a01c-7e02708ca270 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:44.602013 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e5df3-0d5c-4cb0-a01c-7e02708ca270 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:44.602013 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e5df3-0d5c-4cb0-a01c-7e02708ca270 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:44.607442 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 398/800] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:44.607442 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e5df3-0d5c-4cb0-a01c-7e02708ca270 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:44.672029 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5a0c5-af2c-4363-903b-4703f80c6a6c None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:44.709562 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec59386-9e36-41c1-bccb-a4ac1c8b8e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:44.710377 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec59386-9e36-41c1-bccb-a4ac1c8b8e1b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:44.710658 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec59386-9e36-41c1-bccb-a4ac1c8b8e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:44.710928 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec59386-9e36-41c1-bccb-a4ac1c8b8e1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:44.715653 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e5df3-0d5c-4cb0-a01c-7e02708ca270 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:44.722682 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec59386-9e36-41c1-bccb-a4ac1c8b8e1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:44.724137 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec59386-9e36-41c1-bccb-a4ac1c8b8e1b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:44.742355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-eec59386-9e36-41c1-bccb-a4ac1c8b8e1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:44.742355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:44.742355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:44.742355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:44.742355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:44.742355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:44.742355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:44.742355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:44.742355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:44.742355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:44.742355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:44.742355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:44.742355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:44.742355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:44.742355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:44.743285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:44.743285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:44.743285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:44.743285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:44.743285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:44.743285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:44.743285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:44.743285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:44.743285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:44.743285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:44.743285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:44.743285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:44.743285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:44.743285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:44.743285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:44.743285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:44.743285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:44.744185 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:44.744185 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:44.744185 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:44.744185 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:44.748183 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 403/801] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:44.748890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec59386-9e36-41c1-bccb-a4ac1c8b8e1b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:44.754982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fda112-d135-4c1a-b9b2-af646c333f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:44.755775 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fda112-d135-4c1a-b9b2-af646c333f22 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:44.756061 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fda112-d135-4c1a-b9b2-af646c333f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:44.756337 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fda112-d135-4c1a-b9b2-af646c333f22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:44.768423 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fda112-d135-4c1a-b9b2-af646c333f22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:44.769915 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fda112-d135-4c1a-b9b2-af646c333f22 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:44.789401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-93fda112-d135-4c1a-b9b2-af646c333f22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:44.789401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:44.789401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:44.789401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:44.789401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:44.789401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:44.789401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:44.789401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:44.789401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:44.789401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:44.789401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:44.789401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:44.789401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:44.789401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:44.789401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:44.790591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:44.790591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:44.790591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:44.790591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:44.790591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:44.790591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:44.790591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:44.790591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:44.790591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:44.790591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:44.790591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:44.790591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:44.790591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:44.790591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:44.790591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:44.790591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:44.790591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:44.791490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:44.791490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:44.791490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:44.791490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:44.791490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 399/802] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:44.792198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bcc94-42c6-431c-b7fc-634472d0cd44 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:44.792198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bcc94-42c6-431c-b7fc-634472d0cd44 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:44.792441 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bcc94-42c6-431c-b7fc-634472d0cd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:44.805751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:44.809374 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-7a8bcc94-42c6-431c-b7fc-634472d0cd44 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:44.810742 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-7a8bcc94-42c6-431c-b7fc-634472d0cd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:44.859772 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:44.862275 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec59386-9e36-41c1-bccb-a4ac1c8b8e1b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:44.880128 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 400/803] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:41:44.880966 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bcc94-42c6-431c-b7fc-634472d0cd44 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:44.911535 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a41f82-6091-47b1-87fe-c2a6fd141763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:44.912472 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a41f82-6091-47b1-87fe-c2a6fd141763 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:44.912757 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a41f82-6091-47b1-87fe-c2a6fd141763 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:44.913189 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a41f82-6091-47b1-87fe-c2a6fd141763 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:44.914229 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a41f82-6091-47b1-87fe-c2a6fd141763 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:44.914676 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a41f82-6091-47b1-87fe-c2a6fd141763 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:44.916079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a41f82-6091-47b1-87fe-c2a6fd141763 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:44.925531 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 404/804] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Jun 21 05:41:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:44.925531 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a41f82-6091-47b1-87fe-c2a6fd141763 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:44.991195 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bcc94-42c6-431c-b7fc-634472d0cd44 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:45.030257 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a41f82-6091-47b1-87fe-c2a6fd141763 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:45.035956 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6ddb9-1514-474a-bf44-49ee02c4388c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:45.036859 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6ddb9-1514-474a-bf44-49ee02c4388c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:45.037295 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6ddb9-1514-474a-bf44-49ee02c4388c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:45.037735 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6ddb9-1514-474a-bf44-49ee02c4388c None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:45.038499 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd6ddb9-1514-474a-bf44-49ee02c4388c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:45.038812 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd6ddb9-1514-474a-bf44-49ee02c4388c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:45.040177 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd6ddb9-1514-474a-bf44-49ee02c4388c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:45.043849 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:45.057168 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 401/805] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:45.057168 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6ddb9-1514-474a-bf44-49ee02c4388c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:45.072976 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6a601-d369-4b9a-b976-ff683527b9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:45.074198 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6a601-d369-4b9a-b976-ff683527b9fc None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:45.074629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6a601-d369-4b9a-b976-ff683527b9fc None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:45.075305 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6a601-d369-4b9a-b976-ff683527b9fc None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:45.076580 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6a601-d369-4b9a-b976-ff683527b9fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:45.077733 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6a601-d369-4b9a-b976-ff683527b9fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:45.079986 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6a601-d369-4b9a-b976-ff683527b9fc None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:45.098479 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 405/806] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:45.098479 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6a601-d369-4b9a-b976-ff683527b9fc None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:45.108333 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:45.169101 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6ddb9-1514-474a-bf44-49ee02c4388c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:45.207385 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b20084-6491-4974-9098-692e0f0056a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:45.208254 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b20084-6491-4974-9098-692e0f0056a9 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:45.208537 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b20084-6491-4974-9098-692e0f0056a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:45.208809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b20084-6491-4974-9098-692e0f0056a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:45.209805 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6a601-d369-4b9a-b976-ff683527b9fc None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:45.219884 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b20084-6491-4974-9098-692e0f0056a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:45.227554 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-f4b20084-6491-4974-9098-692e0f0056a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:41:45.227554 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:45.227554 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:45.227554 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:45.227554 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:45.227554 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:45.227554 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:45.227554 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:45.227554 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:45.227554 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:45.227554 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:45.227554 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:45.227554 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:45.227554 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:45.227554 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:45.227554 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:45.228569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:45.228569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:45.228569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:45.228569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:45.228569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:45.228569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:45.228569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:45.228569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:45.228569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:45.228569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:45.228569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:45.228569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:45.228569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:45.228569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:45.228569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:45.228569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:45.229404 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:45.229404 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:45.229404 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:45.229404 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:45.229404 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:45.229404 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:45.229404 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:45.229404 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:45.229404 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:45.229404 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:45.229404 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:41:45.229404 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:45.229404 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 402/807] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:41:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:45.230166 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b20084-6491-4974-9098-692e0f0056a9 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:45.251156 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e0a9b-690d-42de-b7f6-a59c50f15e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:45.251951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e0a9b-690d-42de-b7f6-a59c50f15e8d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:45.252136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e0a9b-690d-42de-b7f6-a59c50f15e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:45.252383 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e0a9b-690d-42de-b7f6-a59c50f15e8d None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:45.253136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e0a9b-690d-42de-b7f6-a59c50f15e8d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:45.253420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e0a9b-690d-42de-b7f6-a59c50f15e8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:45.254845 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e0a9b-690d-42de-b7f6-a59c50f15e8d None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:45.260640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 406/808] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Jun 21 05:41:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:45.261205 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e0a9b-690d-42de-b7f6-a59c50f15e8d None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:45.303357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:45.351238 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b20084-6491-4974-9098-692e0f0056a9 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:45.353693 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:45.380047 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e0a9b-690d-42de-b7f6-a59c50f15e8d None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:45.391278 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb65c7-a713-40a5-8b34-277f2ae01140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:45.392075 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb65c7-a713-40a5-8b34-277f2ae01140 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:45.392357 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb65c7-a713-40a5-8b34-277f2ae01140 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:45.392634 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb65c7-a713-40a5-8b34-277f2ae01140 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:45.399987 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb65c7-a713-40a5-8b34-277f2ae01140 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:45.401412 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb65c7-a713-40a5-8b34-277f2ae01140 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:45.414090 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95977acc-6657-4a05-9ead-7bb88ae85672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:45.414857 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-b0eb65c7-a713-40a5-8b34-277f2ae01140 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:45.414857 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:45.414857 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:45.414857 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:45.414857 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:45.414857 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:45.414857 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:45.414857 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:45.414857 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:45.414857 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:45.414857 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:45.414857 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:45.414857 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:41:45.414857 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:41:45.414857 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:41:45.415791 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:41:45.415791 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:45.415791 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:45.415791 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:45.415791 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:45.415791 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:45.415791 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:45.415791 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:45.415791 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:45.415791 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:45.415791 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:45.415791 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:45.415791 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:45.415791 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:45.415791 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:45.415791 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:45.415791 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:45.416796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:41:45.416796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:41:45.416796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:41:45.416796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:41:45.416796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:41:45.416796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:41:45.416796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:45.416796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:45.417422 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95977acc-6657-4a05-9ead-7bb88ae85672 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:45.417422 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95977acc-6657-4a05-9ead-7bb88ae85672 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:45.417422 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95977acc-6657-4a05-9ead-7bb88ae85672 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:45.417619 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 403/809] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:45.417619 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb65c7-a713-40a5-8b34-277f2ae01140 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:45.427857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95977acc-6657-4a05-9ead-7bb88ae85672 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:45.429350 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95977acc-6657-4a05-9ead-7bb88ae85672 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:45.445977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-95977acc-6657-4a05-9ead-7bb88ae85672 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:45.445977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:45.445977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:45.445977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:45.445977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:45.445977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:45.445977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:45.445977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:45.445977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:45.445977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:45.445977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:45.445977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:45.445977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:41:45.445977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:41:45.445977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:41:45.447188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:41:45.447188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:45.447188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:45.447188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:45.447188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:45.447188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:45.447188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:45.447188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:45.447188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:45.447188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:45.447188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:45.447188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:45.447188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:45.447188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:45.447188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:45.447188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:45.447188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:45.448341 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:41:45.448341 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:41:45.448341 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:41:45.448341 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:41:45.448341 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:41:45.448341 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:41:45.448341 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:45.448341 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:45.450107 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 407/810] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:45.451264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95977acc-6657-4a05-9ead-7bb88ae85672 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:45.555045 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:45.561196 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95977acc-6657-4a05-9ead-7bb88ae85672 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:45.597077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d162ac-5827-4a7c-a6f3-bbb35c06a029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:45.597735 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d162ac-5827-4a7c-a6f3-bbb35c06a029 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:45.598052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d162ac-5827-4a7c-a6f3-bbb35c06a029 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:45.598331 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d162ac-5827-4a7c-a6f3-bbb35c06a029 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:45.599071 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d162ac-5827-4a7c-a6f3-bbb35c06a029 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:45.600456 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d162ac-5827-4a7c-a6f3-bbb35c06a029 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:45.621079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 408/811] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jun 21 05:41:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:41:45.622482 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7268e1-bb95-4032-9aee-f78cae276a5c None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:45.622777 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7268e1-bb95-4032-9aee-f78cae276a5c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:45.623061 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7268e1-bb95-4032-9aee-f78cae276a5c None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:45.624915 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 409/812] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:45.625679 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7268e1-bb95-4032-9aee-f78cae276a5c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:45.644252 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb65c7-a713-40a5-8b34-277f2ae01140 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:45.697277 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a6ea6-c896-49b3-9253-d4baf8836b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:45.698332 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a6ea6-c896-49b3-9253-d4baf8836b6a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:45.698641 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a6ea6-c896-49b3-9253-d4baf8836b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:45.698949 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a6ea6-c896-49b3-9253-d4baf8836b6a None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:45.699735 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a6ea6-c896-49b3-9253-d4baf8836b6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:45.700093 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a6ea6-c896-49b3-9253-d4baf8836b6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:45.701507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a6ea6-c896-49b3-9253-d4baf8836b6a None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:45.715792 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 404/813] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:41:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:45.715792 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a6ea6-c896-49b3-9253-d4baf8836b6a None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:45.739390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:45.764281 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7268e1-bb95-4032-9aee-f78cae276a5c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:45.812025 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173d5d1-40c5-4eb7-bb4f-bd266d76b1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:45.812613 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173d5d1-40c5-4eb7-bb4f-bd266d76b1ba None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:45.812960 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173d5d1-40c5-4eb7-bb4f-bd266d76b1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:45.813171 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173d5d1-40c5-4eb7-bb4f-bd266d76b1ba None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:45.814110 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173d5d1-40c5-4eb7-bb4f-bd266d76b1ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:45.814310 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173d5d1-40c5-4eb7-bb4f-bd266d76b1ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:45.815754 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173d5d1-40c5-4eb7-bb4f-bd266d76b1ba None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:45.828504 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 410/814] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:41:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:45.834709 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658beba0-25ea-42ec-8e7f-2d24a2f376c5 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:45.835245 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658beba0-25ea-42ec-8e7f-2d24a2f376c5 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:45.835532 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658beba0-25ea-42ec-8e7f-2d24a2f376c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:45.836051 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a6ea6-c896-49b3-9253-d4baf8836b6a None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:45.856249 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-658beba0-25ea-42ec-8e7f-2d24a2f376c5 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:45.857489 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-658beba0-25ea-42ec-8e7f-2d24a2f376c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:45.867600 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:45.873904 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3af23-d991-4791-ab9b-fc7ac3b067f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:45.874644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3af23-d991-4791-ab9b-fc7ac3b067f5 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:45.874886 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3af23-d991-4791-ab9b-fc7ac3b067f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:45.875168 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3af23-d991-4791-ab9b-fc7ac3b067f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:45.875973 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3af23-d991-4791-ab9b-fc7ac3b067f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:45.876288 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3af23-d991-4791-ab9b-fc7ac3b067f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:45.878104 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3af23-d991-4791-ab9b-fc7ac3b067f5 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:45.890853 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 405/815] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:41:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:45.891704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3af23-d991-4791-ab9b-fc7ac3b067f5 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:45.940356 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 411/816] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:41:45.941316 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658beba0-25ea-42ec-8e7f-2d24a2f376c5 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:45.981283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:46.005264 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3af23-d991-4791-ab9b-fc7ac3b067f5 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:46.042742 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5dad0d-e6fe-4664-a350-365cae9fa0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:46.043534 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5dad0d-e6fe-4664-a350-365cae9fa0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:46.043828 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5dad0d-e6fe-4664-a350-365cae9fa0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:46.044107 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5dad0d-e6fe-4664-a350-365cae9fa0c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:46.055139 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5dad0d-e6fe-4664-a350-365cae9fa0c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:46.056387 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658beba0-25ea-42ec-8e7f-2d24a2f376c5 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:46.056596 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5dad0d-e6fe-4664-a350-365cae9fa0c5 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:46.074635 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-0d5dad0d-e6fe-4664-a350-365cae9fa0c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:46.074635 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:46.074635 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:46.074635 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:46.074635 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:46.074635 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:46.074635 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:46.074635 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:46.074635 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:46.074635 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:46.074635 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:46.074635 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:46.074635 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:46.074635 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:46.074635 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:46.075605 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:46.075605 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:46.075605 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:46.075605 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:46.075605 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:46.075605 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:46.075605 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:46.075605 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:46.075605 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:46.075605 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:46.075605 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:46.075605 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:46.075605 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:46.075605 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:46.075605 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:46.075605 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:46.075605 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:46.076515 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:46.076515 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:46.076515 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:46.076515 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:46.076515 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 406/817] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:46.077329 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5dad0d-e6fe-4664-a350-365cae9fa0c5 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:46.102592 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b1c96-130a-4a26-a37e-a05251d23651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:46.103793 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b1c96-130a-4a26-a37e-a05251d23651 None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:46.104081 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b1c96-130a-4a26-a37e-a05251d23651 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:46.104360 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b1c96-130a-4a26-a37e-a05251d23651 None admin] PATH_INFO: `/v3/projects/e64b932ef6bf481cb93a04885a93b4b2/users/ac485a336d8b4360bce4f495bd02dbde/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:46.107577 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b1c96-130a-4a26-a37e-a05251d23651 None admin] RBAC: Authorizing `identity:create_grant(project_id=e64b932ef6bf481cb93a04885a93b4b2, user_id=ac485a336d8b4360bce4f495bd02dbde, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:46.111441 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b1c96-130a-4a26-a37e-a05251d23651 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:46.126786 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 412/818] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 21 05:41:45 2022] PUT /identity/v3/projects/e64b932ef6bf481cb93a04885a93b4b2/users/ac485a336d8b4360bce4f495bd02dbde/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:41:46.128036 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b1c96-130a-4a26-a37e-a05251d23651 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:46.140875 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:46.203582 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5dad0d-e6fe-4664-a350-365cae9fa0c5 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:46.239274 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:46.245734 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05b026-be8e-4926-8bec-4aec39bdf364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:46.248122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05b026-be8e-4926-8bec-4aec39bdf364 None admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:46.248122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05b026-be8e-4926-8bec-4aec39bdf364 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:46.248342 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05b026-be8e-4926-8bec-4aec39bdf364 None admin] PATH_INFO: `/v3/projects/e64b932ef6bf481cb93a04885a93b4b2/users/af8e0eb5ff8c40ae848929780d99e72d/roles/b2f95849039f475c904876eb2958a375` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:46.263079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b1c96-130a-4a26-a37e-a05251d23651 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:46.267545 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05b026-be8e-4926-8bec-4aec39bdf364 None admin] RBAC: Authorizing `identity:create_grant(project_id=e64b932ef6bf481cb93a04885a93b4b2, user_id=af8e0eb5ff8c40ae848929780d99e72d, role_id=b2f95849039f475c904876eb2958a375)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:46.269023 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05b026-be8e-4926-8bec-4aec39bdf364 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:46.290250 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 407/819] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 21 05:41:46 2022] PUT /identity/v3/projects/e64b932ef6bf481cb93a04885a93b4b2/users/af8e0eb5ff8c40ae848929780d99e72d/roles/b2f95849039f475c904876eb2958a375 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:41:46.291621 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05b026-be8e-4926-8bec-4aec39bdf364 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:46.315042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ae2d2-623d-45d4-9da9-b4d3161f56cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:46.316238 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ae2d2-623d-45d4-9da9-b4d3161f56cd None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:46.316727 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ae2d2-623d-45d4-9da9-b4d3161f56cd None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:46.317208 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ae2d2-623d-45d4-9da9-b4d3161f56cd None admin] PATH_INFO: `/v3/services/network` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:46.318253 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ae2d2-623d-45d4-9da9-b4d3161f56cd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:46.319972 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ae2d2-623d-45d4-9da9-b4d3161f56cd None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:46.338981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-ec3ae2d2-623d-45d4-9da9-b4d3161f56cd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 05:41:46.338981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:46.338981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 05:41:46.338981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 05:41:46.338981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 05:41:46.338981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 05:41:46.338981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 05:41:46.338981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:41:46.338981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 05:41:46.338981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:46.338981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:41:46.338981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:46.338981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:46.338981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:46.338981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:46.338981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:46.338981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:46.340022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:46.340022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:46.340022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:46.340022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:46.340022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:46.340022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:46.340022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 05:41:46.340022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 05:41:46.340022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 05:41:46.340022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 05:41:46.340022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:46.340022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:46.340022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:46.340022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:46.340022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:46.340022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:46.340925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:46.340925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:46.340925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:46.340925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:46.340925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:46.340925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:46.340925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:46.340925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:46.340925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:46.340925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:46.340925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 05:41:46.340925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:41:46.340925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 05:41:46.340925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:46.344214 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 413/820] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:46 2022] GET /identity/v3/services/network => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:46.351611 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ae2d2-623d-45d4-9da9-b4d3161f56cd None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:46.446482 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05b026-be8e-4926-8bec-4aec39bdf364 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:46.457083 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:46.503900 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ae2d2-623d-45d4-9da9-b4d3161f56cd None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:46.545294 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb056e-e316-4ddf-b965-53af96df166b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:46.546933 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb056e-e316-4ddf-b965-53af96df166b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:46.547043 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1c7b8-b087-4e52-bd51-8bcaa6a153e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:46.547535 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb056e-e316-4ddf-b965-53af96df166b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:46.547741 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1c7b8-b087-4e52-bd51-8bcaa6a153e7 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:46.548015 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1c7b8-b087-4e52-bd51-8bcaa6a153e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:46.548283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1c7b8-b087-4e52-bd51-8bcaa6a153e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:46.548639 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb056e-e316-4ddf-b965-53af96df166b None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:46.549021 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1c7b8-b087-4e52-bd51-8bcaa6a153e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:46.549330 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1c7b8-b087-4e52-bd51-8bcaa6a153e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:46.550023 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb056e-e316-4ddf-b965-53af96df166b None admin] RBAC: Adding query filter params (name=network) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:46.550536 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb056e-e316-4ddf-b965-53af96df166b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:46.550727 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1c7b8-b087-4e52-bd51-8bcaa6a153e7 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:46.552518 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb056e-e316-4ddf-b965-53af96df166b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:46.558764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 414/821] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jun 21 05:41:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:46.565088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb056e-e316-4ddf-b965-53af96df166b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:46.566853 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 408/822] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:46.573803 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1c7b8-b087-4e52-bd51-8bcaa6a153e7 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:46.634321 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:46.696663 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb056e-e316-4ddf-b965-53af96df166b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:46.719253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1c7b8-b087-4e52-bd51-8bcaa6a153e7 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:46.740899 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:46.748599 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63562445-61d8-4433-8026-24e56f779653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:46.749278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63562445-61d8-4433-8026-24e56f779653 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:46.749561 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63562445-61d8-4433-8026-24e56f779653 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:46.749838 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63562445-61d8-4433-8026-24e56f779653 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:46.750841 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63562445-61d8-4433-8026-24e56f779653 None admin] RBAC: Adding query filter params (type=network) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:46.751158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63562445-61d8-4433-8026-24e56f779653 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:46.753242 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63562445-61d8-4433-8026-24e56f779653 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:46.760283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375feae9-54ef-4472-91df-114050ed3728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:46.760485 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 415/823] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jun 21 05:41:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:41:46.761512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375feae9-54ef-4472-91df-114050ed3728 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:46.761800 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375feae9-54ef-4472-91df-114050ed3728 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:46.770080 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375feae9-54ef-4472-91df-114050ed3728 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:46.770255 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63562445-61d8-4433-8026-24e56f779653 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:46.778856 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375feae9-54ef-4472-91df-114050ed3728 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:46.781844 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375feae9-54ef-4472-91df-114050ed3728 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:46.797199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-375feae9-54ef-4472-91df-114050ed3728 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 05:41:46.797199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:46.797199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:46.797199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:46.797199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:46.797199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:46.797199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:46.797199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:46.797199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:46.797199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:46.797199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:46.797199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:46.797199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:41:46.797199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:41:46.797199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:41:46.797199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:41:46.798258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:46.798258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:46.798258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:41:46.798258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:46.798258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:41:46.798258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:46.798258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:46.798258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:46.798258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:46.798258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:46.798258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:46.798258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:46.798258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:46.798258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:46.798258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:46.798258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:46.798258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:46.798258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:46.799201 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:46.799201 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:46.799201 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:41:46.799201 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:41:46.799201 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:41:46.799201 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:41:46.799201 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:41:46.799201 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:41:46.799201 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 05:41:46.799201 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:46.801906 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 409/824] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jun 21 05:41:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:41:46.807389 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375feae9-54ef-4472-91df-114050ed3728 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:46.941781 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63562445-61d8-4433-8026-24e56f779653 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:46.980353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa430c26-433d-451a-b7ea-5c05c3ead579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:46.981684 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa430c26-433d-451a-b7ea-5c05c3ead579 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:46.982239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa430c26-433d-451a-b7ea-5c05c3ead579 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:46.982729 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa430c26-433d-451a-b7ea-5c05c3ead579 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:46.984673 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa430c26-433d-451a-b7ea-5c05c3ead579 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:46.986298 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa430c26-433d-451a-b7ea-5c05c3ead579 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:47.011927 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 416/825] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jun 21 05:41:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:41:47.031941 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375feae9-54ef-4472-91df-114050ed3728 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:47.034091 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:47.118882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13332e3-8a37-400f-b8cf-13706d79bf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:47.119600 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13332e3-8a37-400f-b8cf-13706d79bf17 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:47.119891 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13332e3-8a37-400f-b8cf-13706d79bf17 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:47.120173 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13332e3-8a37-400f-b8cf-13706d79bf17 None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:47.121050 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13332e3-8a37-400f-b8cf-13706d79bf17 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:47.121363 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13332e3-8a37-400f-b8cf-13706d79bf17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:47.123033 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13332e3-8a37-400f-b8cf-13706d79bf17 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:47.147963 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 410/826] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jun 21 05:41:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:47.153520 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa430c26-433d-451a-b7ea-5c05c3ead579 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:47.233041 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:47.286190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa430c26-433d-451a-b7ea-5c05c3ead579 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:47.322400 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e9ab6-ddf3-4012-aed2-90a74ed3e6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:47.323075 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e9ab6-ddf3-4012-aed2-90a74ed3e6b9 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:47.323358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e9ab6-ddf3-4012-aed2-90a74ed3e6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:47.323638 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e9ab6-ddf3-4012-aed2-90a74ed3e6b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:47.396530 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e9ab6-ddf3-4012-aed2-90a74ed3e6b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:47.398075 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e9ab6-ddf3-4012-aed2-90a74ed3e6b9 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:47.459385 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:47.503695 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 417/827] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:41:47 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 05:41:47.511041 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13332e3-8a37-400f-b8cf-13706d79bf17 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:47.625312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13332e3-8a37-400f-b8cf-13706d79bf17 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:47.668681 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25fca95-0748-455a-af97-f59499b0a2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:47.669809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fca95-0748-455a-af97-f59499b0a2fb None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:47.670316 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fca95-0748-455a-af97-f59499b0a2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:47.670771 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fca95-0748-455a-af97-f59499b0a2fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:47.681656 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25fca95-0748-455a-af97-f59499b0a2fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:47.683521 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25fca95-0748-455a-af97-f59499b0a2fb None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:47.702606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-d25fca95-0748-455a-af97-f59499b0a2fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:47.702606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:47.702606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:47.702606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:47.702606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:47.702606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:47.702606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:47.702606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:47.702606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:47.702606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:47.702606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:47.702606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:47.702606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:47.702606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:47.702606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:47.703544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:47.703544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:47.703544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:47.703544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:47.703544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:47.703544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:47.703544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:47.703544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:47.703544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:47.703544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:47.703544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:47.703544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:47.703544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:47.703544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:47.703544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:47.703544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:47.703544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:47.704426 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:47.704426 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:47.704426 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:47.704426 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:47.706374 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 411/828] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:47.717956 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e9ab6-ddf3-4012-aed2-90a74ed3e6b9 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:47.813709 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e9ab6-ddf3-4012-aed2-90a74ed3e6b9 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:47.840185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d312ef-4573-4ad4-890c-8f699fb73a90 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:47.840760 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d312ef-4573-4ad4-890c-8f699fb73a90 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:47.841267 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d312ef-4573-4ad4-890c-8f699fb73a90 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:47.843699 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 412/829] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:47.848810 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c9c4f-e6a4-4d8d-9bc2-d738f9e90345 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:47.849215 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c9c4f-e6a4-4d8d-9bc2-d738f9e90345 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:47.849581 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c9c4f-e6a4-4d8d-9bc2-d738f9e90345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:47.850832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24328014-df26-4e10-981d-c545b862164a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:47.851663 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24328014-df26-4e10-981d-c545b862164a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:47.852117 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24328014-df26-4e10-981d-c545b862164a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:47.852540 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24328014-df26-4e10-981d-c545b862164a None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:47.853408 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24328014-df26-4e10-981d-c545b862164a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:47.853875 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24328014-df26-4e10-981d-c545b862164a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:47.855442 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24328014-df26-4e10-981d-c545b862164a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:47.868640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 418/830] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:47.873218 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-ea3c9c4f-e6a4-4d8d-9bc2-d738f9e90345 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:47.873218 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ea3c9c4f-e6a4-4d8d-9bc2-d738f9e90345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:47.875110 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24328014-df26-4e10-981d-c545b862164a None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:47.886677 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:47.888239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:47.962201 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 413/831] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:41:47.983642 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c9c4f-e6a4-4d8d-9bc2-d738f9e90345 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:48.007409 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24328014-df26-4e10-981d-c545b862164a None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:48.052717 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3aacd6-1751-4379-a4be-f49b433133e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:48.053785 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3aacd6-1751-4379-a4be-f49b433133e9 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:48.054089 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3aacd6-1751-4379-a4be-f49b433133e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:48.054367 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3aacd6-1751-4379-a4be-f49b433133e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:48.063882 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3aacd6-1751-4379-a4be-f49b433133e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:48.066166 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3aacd6-1751-4379-a4be-f49b433133e9 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:48.085593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-bf3aacd6-1751-4379-a4be-f49b433133e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:48.085593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:48.085593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:48.085593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:48.085593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:48.085593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:48.085593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:48.085593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:48.085593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:48.085593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:48.085593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:48.085593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:48.085593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:41:48.085593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:41:48.085593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:41:48.086590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:41:48.086590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:48.086590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:48.086590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:48.086590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:48.086590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:48.086590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:48.086590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:48.086590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:48.086590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:48.086590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:48.086590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:48.086590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:48.086590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:48.086590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:48.086590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:48.086590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:48.087503 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:41:48.087503 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:41:48.087503 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:41:48.087503 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:41:48.087503 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:41:48.087503 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:41:48.087503 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:48.087503 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:48.090006 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 419/832] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:48.092572 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3aacd6-1751-4379-a4be-f49b433133e9 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:48.106182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c9c4f-e6a4-4d8d-9bc2-d738f9e90345 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:48.143955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abca32-462a-410e-8043-899983c44d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:48.144625 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abca32-462a-410e-8043-899983c44d1c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:48.144912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abca32-462a-410e-8043-899983c44d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:48.145188 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abca32-462a-410e-8043-899983c44d1c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:48.145841 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92abca32-462a-410e-8043-899983c44d1c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:48.147351 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92abca32-462a-410e-8043-899983c44d1c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:48.159473 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-92abca32-462a-410e-8043-899983c44d1c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 05:41:48.159473 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:48.159473 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 05:41:48.159473 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 05:41:48.159473 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 05:41:48.159473 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 05:41:48.159473 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 05:41:48.159473 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:41:48.159473 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 05:41:48.159473 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:48.159473 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:41:48.159473 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:48.159473 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:48.159473 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:48.159473 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:48.159473 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:48.159473 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:48.160744 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:48.160744 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:48.160744 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:48.160744 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:48.160744 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:48.160744 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:48.160744 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 05:41:48.160744 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 05:41:48.160744 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 05:41:48.160744 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 05:41:48.160744 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:48.160744 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:48.160744 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:48.160744 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:48.160744 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:48.160744 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:48.161661 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:48.161661 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:48.161661 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:48.161661 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:48.161661 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:48.161661 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:48.161661 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:48.161661 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:48.161661 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:48.161661 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:48.161661 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 05:41:48.161661 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:41:48.161661 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 05:41:48.161661 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:48.165962 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 414/833] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 21 05:41:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:48.166818 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abca32-462a-410e-8043-899983c44d1c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:48.169705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:48.187305 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:48.221057 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3aacd6-1751-4379-a4be-f49b433133e9 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:48.258206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54effd-2007-44b6-a096-7ce3df6deeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:48.259213 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54effd-2007-44b6-a096-7ce3df6deeb9 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:48.259652 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54effd-2007-44b6-a096-7ce3df6deeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:48.260085 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54effd-2007-44b6-a096-7ce3df6deeb9 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:48.261042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa54effd-2007-44b6-a096-7ce3df6deeb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:48.261511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa54effd-2007-44b6-a096-7ce3df6deeb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:48.263188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa54effd-2007-44b6-a096-7ce3df6deeb9 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:48.276976 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 420/834] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:41:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:41:48.282854 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54effd-2007-44b6-a096-7ce3df6deeb9 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:48.285130 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abca32-462a-410e-8043-899983c44d1c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:48.324916 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8bc35-6616-4689-a867-11c7301f8aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:48.325510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8bc35-6616-4689-a867-11c7301f8aea None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:48.325822 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8bc35-6616-4689-a867-11c7301f8aea None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:48.326859 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8bc35-6616-4689-a867-11c7301f8aea None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:48.327257 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8bc35-6616-4689-a867-11c7301f8aea None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:48.327712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8bc35-6616-4689-a867-11c7301f8aea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:48.329461 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8bc35-6616-4689-a867-11c7301f8aea None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:48.339653 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 415/835] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 21 05:41:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:48.340757 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8bc35-6616-4689-a867-11c7301f8aea None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:48.397516 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54effd-2007-44b6-a096-7ce3df6deeb9 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:48.414023 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:48.428871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:48.435338 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845ecd2-1a53-45f9-a6d9-17c0cd9601e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:48.436763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845ecd2-1a53-45f9-a6d9-17c0cd9601e3 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:48.437551 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845ecd2-1a53-45f9-a6d9-17c0cd9601e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:48.437913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845ecd2-1a53-45f9-a6d9-17c0cd9601e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:48.439377 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845ecd2-1a53-45f9-a6d9-17c0cd9601e3 None admin] RBAC: Adding query filter params (role.id=24aa6040c86049f996560e477e83886f, scope.project.id=e64b932ef6bf481cb93a04885a93b4b2, user.id=f702830987ba4548a4c2ee3d0e302d02) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:48.439650 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845ecd2-1a53-45f9-a6d9-17c0cd9601e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:48.441502 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845ecd2-1a53-45f9-a6d9-17c0cd9601e3 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:48.453959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 421/836] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:41:48 2022] GET /identity/v3/role_assignments?user.id=f702830987ba4548a4c2ee3d0e302d02&scope.project.id=e64b932ef6bf481cb93a04885a93b4b2&role.id=24aa6040c86049f996560e477e83886f => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:48.465397 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8bc35-6616-4689-a867-11c7301f8aea None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:48.505084 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e12f2e-05d5-4a53-9f70-e8e3e42840ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:48.505768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e12f2e-05d5-4a53-9f70-e8e3e42840ee None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:48.506092 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e12f2e-05d5-4a53-9f70-e8e3e42840ee None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:48.506379 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e12f2e-05d5-4a53-9f70-e8e3e42840ee None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:48.507107 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e12f2e-05d5-4a53-9f70-e8e3e42840ee None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:48.507421 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e12f2e-05d5-4a53-9f70-e8e3e42840ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:48.508808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e12f2e-05d5-4a53-9f70-e8e3e42840ee None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:48.514844 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 416/837] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 21 05:41:48 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:41:48.585874 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47274250-959e-4770-8176-fec28a3338cd None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:48.586088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47274250-959e-4770-8176-fec28a3338cd None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:48.586374 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47274250-959e-4770-8176-fec28a3338cd None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:48.588228 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 422/838] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:48.594413 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b9721-f86f-4ec1-b20d-f08fc47cecd8 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:48.594728 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b9721-f86f-4ec1-b20d-f08fc47cecd8 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:48.594992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b9721-f86f-4ec1-b20d-f08fc47cecd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:48.614955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-e89b9721-f86f-4ec1-b20d-f08fc47cecd8 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:48.616740 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e89b9721-f86f-4ec1-b20d-f08fc47cecd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:48.699771 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 417/839] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:41:48.723981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47274250-959e-4770-8176-fec28a3338cd None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:48.837644 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47274250-959e-4770-8176-fec28a3338cd None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:48.839119 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed54e2f-c55f-40b5-82c6-afe21f497692 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:48.839416 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed54e2f-c55f-40b5-82c6-afe21f497692 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:48.839702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed54e2f-c55f-40b5-82c6-afe21f497692 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:48.841344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 418/840] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 05:41:48.846930 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea34037-4c8c-42dc-82a3-4b4adaa41f73 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:48.847217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea34037-4c8c-42dc-82a3-4b4adaa41f73 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:48.847503 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea34037-4c8c-42dc-82a3-4b4adaa41f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:48.875154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-8ea34037-4c8c-42dc-82a3-4b4adaa41f73 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:48.876364 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-8ea34037-4c8c-42dc-82a3-4b4adaa41f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:48.880493 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5f62c-aa78-4fe4-ad9c-43a7016a50b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:48.881295 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5f62c-aa78-4fe4-ad9c-43a7016a50b6 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:48.881579 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5f62c-aa78-4fe4-ad9c-43a7016a50b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:48.881860 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5f62c-aa78-4fe4-ad9c-43a7016a50b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:48.894557 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5f62c-aa78-4fe4-ad9c-43a7016a50b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:48.902347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-1ad5f62c-aa78-4fe4-ad9c-43a7016a50b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:41:48.902347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:48.902347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:48.902347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:48.902347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:48.902347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:48.902347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:48.902347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:48.902347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:48.902347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:48.902347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:48.902347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:48.902347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:48.902347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:48.902347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:48.902347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:48.903370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:48.903370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:48.903370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:48.903370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:48.903370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:48.903370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:48.903370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:48.903370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:48.903370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:48.903370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:48.903370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:48.903370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:48.903370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:48.903370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:48.903370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:48.903370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:48.904251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:48.904251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:48.904251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:48.904251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:48.904251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:48.904251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:48.904251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:48.904251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:48.904251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:48.904251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:48.904251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:41:48.904251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:48.904251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 423/841] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:41:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:48.909986 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5f62c-aa78-4fe4-ad9c-43a7016a50b6 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:48.944018 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:48.970386 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 419/842] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 05:41:48.986233 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:48.996308 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea34037-4c8c-42dc-82a3-4b4adaa41f73 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:49.044708 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5f62c-aa78-4fe4-ad9c-43a7016a50b6 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:49.082960 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6930141-0b76-40bd-87c2-3b71f4935fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:49.083640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6930141-0b76-40bd-87c2-3b71f4935fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:49.084093 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6930141-0b76-40bd-87c2-3b71f4935fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:49.084378 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6930141-0b76-40bd-87c2-3b71f4935fc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:49.085673 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6930141-0b76-40bd-87c2-3b71f4935fc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:49.086040 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6930141-0b76-40bd-87c2-3b71f4935fc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:49.087810 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6930141-0b76-40bd-87c2-3b71f4935fc0 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:49.099168 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 424/843] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:41:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:49.105289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6930141-0b76-40bd-87c2-3b71f4935fc0 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:49.132755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea34037-4c8c-42dc-82a3-4b4adaa41f73 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:49.182427 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a7d64-e771-4f90-a133-279b8fb23f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:49.183478 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a7d64-e771-4f90-a133-279b8fb23f28 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:49.183767 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a7d64-e771-4f90-a133-279b8fb23f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:49.184051 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a7d64-e771-4f90-a133-279b8fb23f28 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:49.199140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a7d64-e771-4f90-a133-279b8fb23f28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:49.208198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-d84a7d64-e771-4f90-a133-279b8fb23f28 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:49.208198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:49.208198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:49.208198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:49.208198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:49.208198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:49.208198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:49.208198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:49.208198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:49.208198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:49.208198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:49.208198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:49.208198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:49.208198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:49.208198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:49.208198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:49.209230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:49.209230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:49.209230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:49.209230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:49.209230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:49.209230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:49.209230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:49.209230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:49.209230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:49.209230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:49.209230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:49.209230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:49.209230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:49.209230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:49.209230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:49.209230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:49.210118 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:49.210118 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:49.210118 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:49.210118 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:49.210118 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:49.210118 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:49.210118 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:49.210118 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:49.210118 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:49.210118 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:49.210118 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:41:49.210118 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:49.210118 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 420/844] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 21 05:41:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:41:49.215771 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a7d64-e771-4f90-a133-279b8fb23f28 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:49.275316 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:49.337301 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a7d64-e771-4f90-a133-279b8fb23f28 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:49.383408 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3dbd9-4d59-4002-9374-309b57a9c4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:49.384013 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3dbd9-4d59-4002-9374-309b57a9c4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:49.384364 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3dbd9-4d59-4002-9374-309b57a9c4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:49.384714 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3dbd9-4d59-4002-9374-309b57a9c4f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:49.385537 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3dbd9-4d59-4002-9374-309b57a9c4f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:49.385914 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3dbd9-4d59-4002-9374-309b57a9c4f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:49.387572 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3dbd9-4d59-4002-9374-309b57a9c4f8 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:49.390398 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6930141-0b76-40bd-87c2-3b71f4935fc0 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:49.401096 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 421/845] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 21 05:41:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:49.402200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3dbd9-4d59-4002-9374-309b57a9c4f8 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:49.408938 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:49.430466 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b39aac-0554-4a2d-b012-253f94997253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:49.431570 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b39aac-0554-4a2d-b012-253f94997253 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:49.432018 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b39aac-0554-4a2d-b012-253f94997253 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:49.432441 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b39aac-0554-4a2d-b012-253f94997253 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:49.443866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b39aac-0554-4a2d-b012-253f94997253 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:49.445583 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b39aac-0554-4a2d-b012-253f94997253 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:49.463823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-41b39aac-0554-4a2d-b012-253f94997253 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:49.463823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:49.463823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:49.463823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:49.463823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:49.463823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:49.463823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:49.463823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:49.463823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:49.463823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:49.463823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:49.463823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:49.463823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:49.463823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:49.463823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:49.464934 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:49.464934 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:49.464934 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:49.464934 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:49.464934 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:49.464934 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:49.464934 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:49.464934 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:49.464934 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:49.464934 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:49.464934 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:49.464934 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:49.464934 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:49.464934 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:49.464934 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:49.464934 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:49.464934 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:49.466066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:49.466066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:49.466066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:49.466066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:49.468490 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 425/846] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:49.474122 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b39aac-0554-4a2d-b012-253f94997253 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:49.519797 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3dbd9-4d59-4002-9374-309b57a9c4f8 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:49.533602 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:49.556374 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74539759-51b4-467a-a9ca-e17751f63afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:49.557450 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74539759-51b4-467a-a9ca-e17751f63afa None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:49.557888 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74539759-51b4-467a-a9ca-e17751f63afa None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:49.558343 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74539759-51b4-467a-a9ca-e17751f63afa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:49.569715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74539759-51b4-467a-a9ca-e17751f63afa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:49.571387 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74539759-51b4-467a-a9ca-e17751f63afa None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:49.584865 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b39aac-0554-4a2d-b012-253f94997253 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:49.590205 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-74539759-51b4-467a-a9ca-e17751f63afa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:49.590205 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:49.590205 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:49.590205 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:49.590205 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:49.590205 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:49.590205 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:49.590205 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:49.590205 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:49.590205 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:49.590205 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:49.590205 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:49.590205 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:49.590205 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:49.590205 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:49.591342 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:49.591342 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:49.591342 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:49.591342 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:49.591342 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:49.591342 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:49.591342 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:49.591342 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:49.591342 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:49.591342 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:49.591342 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:49.591342 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:49.591342 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:49.591342 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:49.591342 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:49.591342 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:49.591342 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:49.592928 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:49.592928 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:49.592928 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:49.592928 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:49.594879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 422/847] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:49.603457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74539759-51b4-467a-a9ca-e17751f63afa None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:49.627873 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5116fc8-e74f-4935-adcc-21a255b98e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:49.629266 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5116fc8-e74f-4935-adcc-21a255b98e36 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:49.629925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5116fc8-e74f-4935-adcc-21a255b98e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:49.630488 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5116fc8-e74f-4935-adcc-21a255b98e36 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:49.631501 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5116fc8-e74f-4935-adcc-21a255b98e36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:49.631985 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5116fc8-e74f-4935-adcc-21a255b98e36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:49.634989 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5116fc8-e74f-4935-adcc-21a255b98e36 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:49.653974 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 426/848] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:49.658209 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5116fc8-e74f-4935-adcc-21a255b98e36 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:49.690321 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:49.718413 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74539759-51b4-467a-a9ca-e17751f63afa None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:49.756007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012aee57-11ee-4ff1-81e5-f8b54833b6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:49.756663 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012aee57-11ee-4ff1-81e5-f8b54833b6fd None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:49.756950 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012aee57-11ee-4ff1-81e5-f8b54833b6fd None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:49.757233 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012aee57-11ee-4ff1-81e5-f8b54833b6fd None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:49.757994 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012aee57-11ee-4ff1-81e5-f8b54833b6fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:49.758311 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012aee57-11ee-4ff1-81e5-f8b54833b6fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:49.759740 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012aee57-11ee-4ff1-81e5-f8b54833b6fd None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:49.773648 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 423/849] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:49.777344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5116fc8-e74f-4935-adcc-21a255b98e36 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:49.778737 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012aee57-11ee-4ff1-81e5-f8b54833b6fd None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:49.811176 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:49.823738 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ba480-2415-476f-8eb2-780fe30889f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:49.826135 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ba480-2415-476f-8eb2-780fe30889f9 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:49.827161 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ba480-2415-476f-8eb2-780fe30889f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:49.827644 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ba480-2415-476f-8eb2-780fe30889f9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:49.838231 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ba480-2415-476f-8eb2-780fe30889f9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:49.840553 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ba480-2415-476f-8eb2-780fe30889f9 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:49.860462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-398ba480-2415-476f-8eb2-780fe30889f9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 05:41:49.860462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:49.860462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:49.860462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:49.860462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:49.860462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:49.860462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:49.860462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:49.860462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:49.860462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:49.860462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:49.860462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:49.860462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:41:49.860462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:41:49.860462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:41:49.860462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:41:49.861453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:49.861453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:49.861453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:41:49.861453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:49.861453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:41:49.861453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:49.861453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:49.861453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:49.861453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:49.861453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:49.861453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:49.861453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:49.861453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:49.861453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:49.861453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:49.861453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:49.861453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:49.861453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:49.867206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:49.867206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:49.867206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:41:49.867206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:41:49.867206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:41:49.867206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:41:49.867206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:41:49.867206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:41:49.867206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 05:41:49.867206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:49.867206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 427/850] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:41:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:49.869656 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ba480-2415-476f-8eb2-780fe30889f9 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:49.915058 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012aee57-11ee-4ff1-81e5-f8b54833b6fd None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:49.951105 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c579340-a9ef-497e-9e95-4581bfe8842b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:49.953407 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c579340-a9ef-497e-9e95-4581bfe8842b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:49.953407 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c579340-a9ef-497e-9e95-4581bfe8842b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:49.953660 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c579340-a9ef-497e-9e95-4581bfe8842b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:49.961315 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c579340-a9ef-497e-9e95-4581bfe8842b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:49.962962 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c579340-a9ef-497e-9e95-4581bfe8842b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:49.975261 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:49.980490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-1c579340-a9ef-497e-9e95-4581bfe8842b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 05:41:49.980490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:49.980490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:49.980490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:49.980490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:49.980490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:49.980490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:49.980490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:49.980490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:49.980490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:49.980490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:49.980490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:49.980490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:41:49.980490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:41:49.980490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:41:49.980490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:41:49.982062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:49.982062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:49.982062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:41:49.982062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:49.982062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:41:49.982062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:49.982062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:49.982062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:49.982062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:49.982062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:49.982062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:49.982062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:49.982062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:49.982062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:49.982062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:49.982062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:49.982062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:49.982062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:49.983309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:49.983309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:49.983309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:41:49.983309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:41:49.983309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:41:49.983309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:41:49.983309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:41:49.983309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:41:49.983309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 05:41:49.983309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:49.985788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 424/851] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jun 21 05:41:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:41:49.990363 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c579340-a9ef-497e-9e95-4581bfe8842b None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:49.992939 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ba480-2415-476f-8eb2-780fe30889f9 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:50.028118 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980095a-aae6-49b5-82fb-f70bbfc14abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:50.028923 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980095a-aae6-49b5-82fb-f70bbfc14abf None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:50.029305 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980095a-aae6-49b5-82fb-f70bbfc14abf None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:50.030279 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980095a-aae6-49b5-82fb-f70bbfc14abf None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:50.031227 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980095a-aae6-49b5-82fb-f70bbfc14abf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:50.031621 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980095a-aae6-49b5-82fb-f70bbfc14abf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:50.033155 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980095a-aae6-49b5-82fb-f70bbfc14abf None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:50.057411 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 428/852] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Jun 21 05:41:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:50.058577 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980095a-aae6-49b5-82fb-f70bbfc14abf None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:50.082465 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:50.101390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c579340-a9ef-497e-9e95-4581bfe8842b None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:50.140160 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ae963-96df-4b8f-ac4c-1b598fcd4fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:50.141507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ae963-96df-4b8f-ac4c-1b598fcd4fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:50.141995 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ae963-96df-4b8f-ac4c-1b598fcd4fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:50.142420 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ae963-96df-4b8f-ac4c-1b598fcd4fb4 None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:50.143412 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ae963-96df-4b8f-ac4c-1b598fcd4fb4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:50.143874 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ae963-96df-4b8f-ac4c-1b598fcd4fb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:50.145582 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ae963-96df-4b8f-ac4c-1b598fcd4fb4 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:50.164613 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 425/853] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Jun 21 05:41:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:41:50.169736 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ae963-96df-4b8f-ac4c-1b598fcd4fb4 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:50.178137 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980095a-aae6-49b5-82fb-f70bbfc14abf None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:50.216328 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2dc5d9-4950-4cdd-b82a-ec3cb1021184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:50.217063 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2dc5d9-4950-4cdd-b82a-ec3cb1021184 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:50.217342 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2dc5d9-4950-4cdd-b82a-ec3cb1021184 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:50.217625 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2dc5d9-4950-4cdd-b82a-ec3cb1021184 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:50.238103 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:50.304126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ae963-96df-4b8f-ac4c-1b598fcd4fb4 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:50.317088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2dc5d9-4950-4cdd-b82a-ec3cb1021184 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:50.319563 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2dc5d9-4950-4cdd-b82a-ec3cb1021184 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:50.341088 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f8185-a13b-410c-aa29-37db63ea8931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:50.341746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f8185-a13b-410c-aa29-37db63ea8931 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:50.343153 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f8185-a13b-410c-aa29-37db63ea8931 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:50.343153 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f8185-a13b-410c-aa29-37db63ea8931 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:50.359455 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:50.424435 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f8185-a13b-410c-aa29-37db63ea8931 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:50.425897 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f8185-a13b-410c-aa29-37db63ea8931 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:50.443543 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 429/854] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:41:50 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 05:41:50.450562 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2dc5d9-4950-4cdd-b82a-ec3cb1021184 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:50.515493 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:50.559807 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 426/855] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:41:50 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 05:41:50.562836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f8185-a13b-410c-aa29-37db63ea8931 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:50.590390 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2dc5d9-4950-4cdd-b82a-ec3cb1021184 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:50.616909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:50.651861 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b2b1b-7e49-420e-8574-72049b3c53b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:50.654246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b2b1b-7e49-420e-8574-72049b3c53b9 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:50.655581 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b2b1b-7e49-420e-8574-72049b3c53b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:50.656048 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b2b1b-7e49-420e-8574-72049b3c53b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:50.669308 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b2b1b-7e49-420e-8574-72049b3c53b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:50.670863 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b2b1b-7e49-420e-8574-72049b3c53b9 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:50.689452 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-6b5b2b1b-7e49-420e-8574-72049b3c53b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:50.689452 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:50.689452 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:50.689452 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:50.689452 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:50.689452 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:50.689452 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:50.689452 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:50.689452 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:50.689452 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:50.689452 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:50.689452 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:50.689452 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:50.689452 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:50.689452 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:50.690488 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:50.690488 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:50.690488 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:50.690488 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:50.690488 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:50.690488 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:50.690488 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:50.690488 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:50.690488 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:50.690488 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:50.690488 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:50.690488 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:50.690488 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:50.690488 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:50.690488 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:50.690488 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:50.690488 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:50.691472 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:50.691472 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:50.691472 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:50.691472 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:50.691721 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f8185-a13b-410c-aa29-37db63ea8931 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:50.695871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 430/856] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:50.697055 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e1374-c1a0-4489-acf2-017be1dbb365 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:50.697341 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e1374-c1a0-4489-acf2-017be1dbb365 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:50.697620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e1374-c1a0-4489-acf2-017be1dbb365 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:50.702477 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 431/857] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:50.702477 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e1374-c1a0-4489-acf2-017be1dbb365 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:50.729989 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa058da-874a-4d6a-b26c-1c55eca55d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:50.731048 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa058da-874a-4d6a-b26c-1c55eca55d05 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:50.731328 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa058da-874a-4d6a-b26c-1c55eca55d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:50.731604 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa058da-874a-4d6a-b26c-1c55eca55d05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:50.743461 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa058da-874a-4d6a-b26c-1c55eca55d05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:50.744901 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa058da-874a-4d6a-b26c-1c55eca55d05 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:50.762262 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-cfa058da-874a-4d6a-b26c-1c55eca55d05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:50.762262 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:50.762262 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:50.762262 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:50.762262 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:50.762262 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:50.762262 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:50.762262 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:50.762262 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:50.762262 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:50.762262 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:50.762262 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:50.762262 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:50.762262 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:50.762262 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:50.763254 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:50.763254 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:50.763254 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:50.763254 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:50.763254 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:50.763254 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:50.763254 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:50.763254 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:50.763254 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:50.763254 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:50.763254 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:50.763254 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:50.763254 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:50.763254 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:50.763254 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:50.763254 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:50.763254 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:50.765270 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:50.765270 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:50.765270 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:50.765270 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:50.765270 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 427/858] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:50.765622 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74008e6-5f5f-45bd-83d2-4517238ff1b3 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:50.765717 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74008e6-5f5f-45bd-83d2-4517238ff1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:50.765956 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74008e6-5f5f-45bd-83d2-4517238ff1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:50.783719 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-b74008e6-5f5f-45bd-83d2-4517238ff1b3 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:50.784899 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b74008e6-5f5f-45bd-83d2-4517238ff1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:50.802017 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:50.806646 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e1374-c1a0-4489-acf2-017be1dbb365 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:50.841078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fec2db-9224-4586-bb8e-888fd6bbeb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:50.841734 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fec2db-9224-4586-bb8e-888fd6bbeb89 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:50.842099 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fec2db-9224-4586-bb8e-888fd6bbeb89 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:50.842892 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fec2db-9224-4586-bb8e-888fd6bbeb89 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:50.843608 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fec2db-9224-4586-bb8e-888fd6bbeb89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:50.843909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fec2db-9224-4586-bb8e-888fd6bbeb89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:50.845275 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fec2db-9224-4586-bb8e-888fd6bbeb89 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:50.851382 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 428/859] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:41:50.852761 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987f27e-404d-487d-b6ff-c01b3679cd26 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:50.853052 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987f27e-404d-487d-b6ff-c01b3679cd26 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:50.853333 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987f27e-404d-487d-b6ff-c01b3679cd26 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:50.854661 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 429/860] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:50.855351 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987f27e-404d-487d-b6ff-c01b3679cd26 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:50.872371 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 432/861] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:50.874561 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6b272-6705-4ec5-8416-54964450db9f None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:50.874846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6b272-6705-4ec5-8416-54964450db9f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:50.875117 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6b272-6705-4ec5-8416-54964450db9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:50.888170 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:50.893073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-eaf6b272-6705-4ec5-8416-54964450db9f None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:50.894500 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-eaf6b272-6705-4ec5-8416-54964450db9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:50.960987 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 433/862] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:41:50.962046 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6b272-6705-4ec5-8416-54964450db9f None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:50.964139 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987f27e-404d-487d-b6ff-c01b3679cd26 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:50.998070 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07888c99-d24c-46b9-8b13-db6040e751dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:50.999305 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07888c99-d24c-46b9-8b13-db6040e751dc None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:50.999592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07888c99-d24c-46b9-8b13-db6040e751dc None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:50.999862 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07888c99-d24c-46b9-8b13-db6040e751dc None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:51.000573 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07888c99-d24c-46b9-8b13-db6040e751dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:51.000876 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07888c99-d24c-46b9-8b13-db6040e751dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:51.002253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07888c99-d24c-46b9-8b13-db6040e751dc None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:51.013297 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 430/863] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:51.014743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07888c99-d24c-46b9-8b13-db6040e751dc None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:51.054978 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:51.067326 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6b272-6705-4ec5-8416-54964450db9f None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:51.097107 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:51.106285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b6f06-e4f6-4cb2-b0f6-7f72bd60d330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:51.106948 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b6f06-e4f6-4cb2-b0f6-7f72bd60d330 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:51.107229 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b6f06-e4f6-4cb2-b0f6-7f72bd60d330 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:51.107505 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b6f06-e4f6-4cb2-b0f6-7f72bd60d330 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:51.108256 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b6f06-e4f6-4cb2-b0f6-7f72bd60d330 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:51.109709 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b6f06-e4f6-4cb2-b0f6-7f72bd60d330 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:51.114043 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07888c99-d24c-46b9-8b13-db6040e751dc None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:51.122818 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 434/864] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jun 21 05:41:50 2022] POST /identity/v3/services => generated 251 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:41:51.124190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b6f06-e4f6-4cb2-b0f6-7f72bd60d330 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:51.185218 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef71c2d-99a2-477b-8a89-a50165ed436f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:51.187395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef71c2d-99a2-477b-8a89-a50165ed436f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:51.188188 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef71c2d-99a2-477b-8a89-a50165ed436f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:51.188883 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef71c2d-99a2-477b-8a89-a50165ed436f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:51.199235 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef71c2d-99a2-477b-8a89-a50165ed436f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:51.201353 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef71c2d-99a2-477b-8a89-a50165ed436f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:51.217621 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-0ef71c2d-99a2-477b-8a89-a50165ed436f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:51.217621 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:51.217621 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:51.217621 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:51.217621 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:51.217621 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:51.217621 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:51.217621 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:51.217621 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:51.217621 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:51.217621 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:51.217621 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:51.217621 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:41:51.217621 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:41:51.217621 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:41:51.218643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:41:51.218643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:51.218643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:51.218643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:51.218643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:51.218643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:51.218643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:51.218643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:51.218643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:51.218643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:51.218643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:51.218643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:51.218643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:51.218643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:51.218643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:51.218643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:51.218643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:51.219537 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:41:51.219537 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:41:51.219537 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:41:51.219537 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:41:51.219537 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:41:51.219537 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:41:51.219537 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:51.219537 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:51.219537 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 431/865] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:51.220058 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef71c2d-99a2-477b-8a89-a50165ed436f None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:51.240932 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b6f06-e4f6-4cb2-b0f6-7f72bd60d330 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:51.280441 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d3cb8-e5b2-478c-b5eb-147a34c3b610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:51.282134 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d3cb8-e5b2-478c-b5eb-147a34c3b610 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:51.282417 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d3cb8-e5b2-478c-b5eb-147a34c3b610 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:51.282692 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d3cb8-e5b2-478c-b5eb-147a34c3b610 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:51.283348 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d3cb8-e5b2-478c-b5eb-147a34c3b610 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:51.284726 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d3cb8-e5b2-478c-b5eb-147a34c3b610 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:51.297917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-f88d3cb8-e5b2-478c-b5eb-147a34c3b610 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 05:41:51.297917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:51.297917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 05:41:51.297917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 05:41:51.297917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 05:41:51.297917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 05:41:51.297917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 05:41:51.297917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:41:51.297917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 05:41:51.297917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:51.297917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:41:51.297917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:51.297917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:51.297917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:51.297917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:51.297917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:51.299043 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:51.299043 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:51.299043 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:51.299043 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:51.299043 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:51.299043 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:51.299043 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:51.299043 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 05:41:51.299043 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 05:41:51.299043 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 05:41:51.299043 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 05:41:51.299043 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:51.299043 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:51.299043 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:51.299043 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:51.299043 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:51.299940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:51.299940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:51.299940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:51.299940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:51.299940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:51.299940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:51.299940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:51.299940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:51.299940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:51.299940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:51.299940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:51.299940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 05:41:51.299940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:41:51.299940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 05:41:51.299940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:51.299940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 435/866] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Jun 21 05:41:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:51.300840 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d3cb8-e5b2-478c-b5eb-147a34c3b610 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:51.317457 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:51.338087 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef71c2d-99a2-477b-8a89-a50165ed436f None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:51.376442 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc39342-f9bb-4d67-9ae7-7babfec52e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:51.377301 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc39342-f9bb-4d67-9ae7-7babfec52e99 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:51.377584 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc39342-f9bb-4d67-9ae7-7babfec52e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:51.378029 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc39342-f9bb-4d67-9ae7-7babfec52e99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:51.385591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc39342-f9bb-4d67-9ae7-7babfec52e99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:51.387192 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc39342-f9bb-4d67-9ae7-7babfec52e99 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:51.390653 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:51.404198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-cdc39342-f9bb-4d67-9ae7-7babfec52e99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:51.404198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:51.404198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:51.404198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:51.404198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:51.404198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:51.404198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:51.404198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:51.404198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:51.404198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:51.404198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:51.404198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:51.404198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:41:51.404198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:41:51.404198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:41:51.406030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:41:51.406030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:51.406030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:51.406030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:51.406030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:51.406030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:51.406030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:51.406030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:51.406030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:51.406030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:51.406030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:51.406030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:51.406030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:51.406030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:51.406030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:51.406030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:51.406030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:51.407834 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:41:51.407834 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:41:51.407834 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:41:51.407834 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:41:51.407834 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:41:51.407834 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:41:51.407834 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:51.407834 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:51.418016 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 432/867] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:51.418016 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc39342-f9bb-4d67-9ae7-7babfec52e99 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:51.430345 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d3cb8-e5b2-478c-b5eb-147a34c3b610 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:51.467564 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e811a7a-9b96-46ad-b1c3-5d27d60159ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:51.468324 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e811a7a-9b96-46ad-b1c3-5d27d60159ef None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:51.468744 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e811a7a-9b96-46ad-b1c3-5d27d60159ef None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:51.469009 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e811a7a-9b96-46ad-b1c3-5d27d60159ef None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:51.469962 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e811a7a-9b96-46ad-b1c3-5d27d60159ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:51.470156 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e811a7a-9b96-46ad-b1c3-5d27d60159ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:51.471609 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e811a7a-9b96-46ad-b1c3-5d27d60159ef None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:51.490719 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 436/868] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:41:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:51.490719 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e811a7a-9b96-46ad-b1c3-5d27d60159ef None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:51.531396 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc39342-f9bb-4d67-9ae7-7babfec52e99 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:51.565565 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:51.568480 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a790ef-b00c-4b68-ba38-623432eaf653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:51.569157 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a790ef-b00c-4b68-ba38-623432eaf653 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:51.569449 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a790ef-b00c-4b68-ba38-623432eaf653 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:51.569725 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a790ef-b00c-4b68-ba38-623432eaf653 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:51.570519 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a790ef-b00c-4b68-ba38-623432eaf653 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:51.570883 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a790ef-b00c-4b68-ba38-623432eaf653 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:51.572744 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a790ef-b00c-4b68-ba38-623432eaf653 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:51.582848 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 433/869] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jun 21 05:41:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:51.582848 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a790ef-b00c-4b68-ba38-623432eaf653 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:51.607045 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e811a7a-9b96-46ad-b1c3-5d27d60159ef None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:51.655722 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91414f0-9450-45a7-b42a-7502f1a06d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:51.656684 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91414f0-9450-45a7-b42a-7502f1a06d21 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:51.657210 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91414f0-9450-45a7-b42a-7502f1a06d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:51.657641 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91414f0-9450-45a7-b42a-7502f1a06d21 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:51.658637 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91414f0-9450-45a7-b42a-7502f1a06d21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:51.659182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91414f0-9450-45a7-b42a-7502f1a06d21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:51.660793 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91414f0-9450-45a7-b42a-7502f1a06d21 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:51.676577 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 437/870] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:41:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:51.677185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:51.678064 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91414f0-9450-45a7-b42a-7502f1a06d21 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:51.723711 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a790ef-b00c-4b68-ba38-623432eaf653 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:51.764579 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc9318-55a7-4193-84ee-8453f441ac3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:51.765309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc9318-55a7-4193-84ee-8453f441ac3f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:51.765612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc9318-55a7-4193-84ee-8453f441ac3f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:51.765869 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc9318-55a7-4193-84ee-8453f441ac3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:51.766743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc9318-55a7-4193-84ee-8453f441ac3f None admin] RBAC: Adding query filter params (role.id=24aa6040c86049f996560e477e83886f, scope.project.id=e64b932ef6bf481cb93a04885a93b4b2, user.id=ac485a336d8b4360bce4f495bd02dbde) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:51.767045 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc9318-55a7-4193-84ee-8453f441ac3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:51.768483 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc9318-55a7-4193-84ee-8453f441ac3f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:51.788443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 434/871] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:41:51 2022] GET /identity/v3/role_assignments?user.id=ac485a336d8b4360bce4f495bd02dbde&scope.project.id=e64b932ef6bf481cb93a04885a93b4b2&role.id=24aa6040c86049f996560e477e83886f => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:51.788827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc9318-55a7-4193-84ee-8453f441ac3f None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:51.842543 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91414f0-9450-45a7-b42a-7502f1a06d21 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:51.881853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:51.898770 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51f7ec-d86f-430a-b274-3cc30762bc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:51.899724 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51f7ec-d86f-430a-b274-3cc30762bc8f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:51.900207 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51f7ec-d86f-430a-b274-3cc30762bc8f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:51.901078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51f7ec-d86f-430a-b274-3cc30762bc8f None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:51.902959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51f7ec-d86f-430a-b274-3cc30762bc8f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:51.904284 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51f7ec-d86f-430a-b274-3cc30762bc8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:51.906480 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51f7ec-d86f-430a-b274-3cc30762bc8f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:51.928971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 438/872] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jun 21 05:41:51 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:51.981500 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc9318-55a7-4193-84ee-8453f441ac3f None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:52.016241 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:52.027055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fed907-ba10-4fba-aefe-9de49659c80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:52.027738 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fed907-ba10-4fba-aefe-9de49659c80a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:52.028028 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fed907-ba10-4fba-aefe-9de49659c80a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:52.028311 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fed907-ba10-4fba-aefe-9de49659c80a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:52.029175 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fed907-ba10-4fba-aefe-9de49659c80a None admin] RBAC: Adding query filter params (role.id=b2f95849039f475c904876eb2958a375, scope.project.id=e64b932ef6bf481cb93a04885a93b4b2, user.id=af8e0eb5ff8c40ae848929780d99e72d) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:52.029526 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fed907-ba10-4fba-aefe-9de49659c80a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:52.032304 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fed907-ba10-4fba-aefe-9de49659c80a None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:52.039496 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 435/873] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:41:51 2022] GET /identity/v3/role_assignments?user.id=af8e0eb5ff8c40ae848929780d99e72d&scope.project.id=e64b932ef6bf481cb93a04885a93b4b2&role.id=b2f95849039f475c904876eb2958a375 => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:53.298815 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f65ca-f555-49c3-8373-00c524ab2249 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:53.300310 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f65ca-f555-49c3-8373-00c524ab2249 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:53.301098 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f65ca-f555-49c3-8373-00c524ab2249 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:53.304566 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 439/874] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:53.309992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e73d98-b204-4114-b320-5b54cf76e6f1 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:53.311381 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e73d98-b204-4114-b320-5b54cf76e6f1 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:53.311381 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e73d98-b204-4114-b320-5b54cf76e6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:53.336491 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-97e73d98-b204-4114-b320-5b54cf76e6f1 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:53.338866 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-97e73d98-b204-4114-b320-5b54cf76e6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:53.461184 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 436/875] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:53 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 05:41:53.484889 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f65ca-f555-49c3-8373-00c524ab2249 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:53.588489 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f65ca-f555-49c3-8373-00c524ab2249 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:53.623605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63feca-4118-47e7-98bc-1b13cd63d2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:53.624786 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63feca-4118-47e7-98bc-1b13cd63d2c5 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:53.625285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63feca-4118-47e7-98bc-1b13cd63d2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:53.625768 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63feca-4118-47e7-98bc-1b13cd63d2c5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:53.626658 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63feca-4118-47e7-98bc-1b13cd63d2c5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:53.628239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63feca-4118-47e7-98bc-1b13cd63d2c5 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:53.640954 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-2f63feca-4118-47e7-98bc-1b13cd63d2c5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 05:41:53.640954 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:53.640954 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 05:41:53.640954 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 05:41:53.640954 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 05:41:53.640954 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 05:41:53.640954 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 05:41:53.640954 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:41:53.640954 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 05:41:53.640954 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:53.640954 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:41:53.640954 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:53.640954 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:53.640954 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:53.640954 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:53.640954 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:53.640954 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:53.641969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:53.641969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:53.641969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:53.641969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:53.641969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:53.641969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:53.641969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 05:41:53.641969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 05:41:53.641969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 05:41:53.641969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 05:41:53.641969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:53.641969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:53.641969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:53.641969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:53.641969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:53.641969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:53.642837 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:53.642837 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:53.642837 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:53.642837 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:53.642837 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:53.642837 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:53.642837 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:53.642837 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:53.642837 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:53.642837 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:53.642837 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 05:41:53.642837 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:41:53.642837 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 05:41:53.642837 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:53.645591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 440/876] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 21 05:41:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:53.652741 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e73d98-b204-4114-b320-5b54cf76e6f1 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:53.757518 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e73d98-b204-4114-b320-5b54cf76e6f1 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:53.782965 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:53.796033 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1fd57-3938-4d65-af9f-799334f963fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:53.796718 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1fd57-3938-4d65-af9f-799334f963fe None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:53.797004 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1fd57-3938-4d65-af9f-799334f963fe None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:53.797286 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1fd57-3938-4d65-af9f-799334f963fe None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:53.798040 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1fd57-3938-4d65-af9f-799334f963fe None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:53.798355 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1fd57-3938-4d65-af9f-799334f963fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:53.799736 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1fd57-3938-4d65-af9f-799334f963fe None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:53.805241 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 437/877] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 21 05:41:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:53.810948 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63feca-4118-47e7-98bc-1b13cd63d2c5 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:53.874877 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:53.922775 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63feca-4118-47e7-98bc-1b13cd63d2c5 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:53.960671 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9761bbac-86c5-4219-bdef-6c348305e3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:53.961709 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761bbac-86c5-4219-bdef-6c348305e3dc None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:53.962275 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761bbac-86c5-4219-bdef-6c348305e3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:53.962799 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761bbac-86c5-4219-bdef-6c348305e3dc None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:53.963730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9761bbac-86c5-4219-bdef-6c348305e3dc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:53.964248 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9761bbac-86c5-4219-bdef-6c348305e3dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:53.965950 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9761bbac-86c5-4219-bdef-6c348305e3dc None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:53.972285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 441/878] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 21 05:41:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:53.978276 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1fd57-3938-4d65-af9f-799334f963fe None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:54.092598 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1fd57-3938-4d65-af9f-799334f963fe None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:54.140604 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67ca4c-ed16-48da-ab66-4415ada2d680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:54.141279 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67ca4c-ed16-48da-ab66-4415ada2d680 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:54.141618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67ca4c-ed16-48da-ab66-4415ada2d680 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:54.141906 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67ca4c-ed16-48da-ab66-4415ada2d680 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:54.142737 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de67ca4c-ed16-48da-ab66-4415ada2d680 None admin] RBAC: Adding query filter params (interface=public, service_id=a0e0dba6f9ce4e79be6a2c6f2b0ded48, region_id=RegionOne) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:54.143058 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de67ca4c-ed16-48da-ab66-4415ada2d680 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:54.144432 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de67ca4c-ed16-48da-ab66-4415ada2d680 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:54.150563 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 438/879] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jun 21 05:41:53 2022] GET /identity/v3/endpoints?service_id=a0e0dba6f9ce4e79be6a2c6f2b0ded48&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:54.156667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9761bbac-86c5-4219-bdef-6c348305e3dc None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:54.214956 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904ded9-c586-41f4-b1de-02f908fa157f None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:54.215616 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904ded9-c586-41f4-b1de-02f908fa157f None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:54.215965 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904ded9-c586-41f4-b1de-02f908fa157f None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:54.218113 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 439/880] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 05:41:54.223142 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cf466-97c3-4eb0-ada5-b92f3db38ff1 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:54.223436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cf466-97c3-4eb0-ada5-b92f3db38ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:54.223724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cf466-97c3-4eb0-ada5-b92f3db38ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:54.245957 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-379cf466-97c3-4eb0-ada5-b92f3db38ff1 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:54.245957 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-379cf466-97c3-4eb0-ada5-b92f3db38ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:54.280289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9761bbac-86c5-4219-bdef-6c348305e3dc None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:54.299785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:54.307102 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:54.319382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252542e-f3c7-40c3-9721-e9be427ee8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:54.320051 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252542e-f3c7-40c3-9721-e9be427ee8ca None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:54.320336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252542e-f3c7-40c3-9721-e9be427ee8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:54.320614 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252542e-f3c7-40c3-9721-e9be427ee8ca None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:54.321305 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252542e-f3c7-40c3-9721-e9be427ee8ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:54.322608 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 440/881] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:54 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 05:41:54.323055 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252542e-f3c7-40c3-9721-e9be427ee8ca None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:54.324052 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcf539-aad1-4124-a786-b83d22fb249d None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:54.324341 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcf539-aad1-4124-a786-b83d22fb249d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:54.324625 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcf539-aad1-4124-a786-b83d22fb249d None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:54.325966 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 441/882] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:54.331916 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01872f2f-462f-4ef4-87e5-4b28d23af2f7 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:54.333080 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01872f2f-462f-4ef4-87e5-4b28d23af2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:54.334324 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01872f2f-462f-4ef4-87e5-4b28d23af2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:54.337527 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 442/883] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jun 21 05:41:54 2022] GET /identity/v3/services => generated 1011 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:41:54.347539 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc4b99-4d24-420a-bcd6-7fa193831761 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:54.348119 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc4b99-4d24-420a-bcd6-7fa193831761 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:54.348609 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc4b99-4d24-420a-bcd6-7fa193831761 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:54.352936 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-01872f2f-462f-4ef4-87e5-4b28d23af2f7 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:54.354279 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-01872f2f-462f-4ef4-87e5-4b28d23af2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:54.354550 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 443/884] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 05:41:54.355537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc4b99-4d24-420a-bcd6-7fa193831761 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:54.434221 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 442/885] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:54 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:41:54.435600 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c318c-9477-47a9-82d0-98ee5ada4241 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:54.435893 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c318c-9477-47a9-82d0-98ee5ada4241 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:54.436173 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c318c-9477-47a9-82d0-98ee5ada4241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:54.455906 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-6c8c318c-9477-47a9-82d0-98ee5ada4241 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:54.458045 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6c8c318c-9477-47a9-82d0-98ee5ada4241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:54.496624 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc4b99-4d24-420a-bcd6-7fa193831761 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:54.538087 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f02b25-815f-4cbc-8f87-3e242ccd4ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:54.538901 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f02b25-815f-4cbc-8f87-3e242ccd4ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:54.539189 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f02b25-815f-4cbc-8f87-3e242ccd4ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:54.539470 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f02b25-815f-4cbc-8f87-3e242ccd4ba1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:54.549537 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 443/886] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:54 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:41:54.550563 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c318c-9477-47a9-82d0-98ee5ada4241 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:54.556973 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f02b25-815f-4cbc-8f87-3e242ccd4ba1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:54.567876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-61f02b25-815f-4cbc-8f87-3e242ccd4ba1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 05:41:54.567876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:54.567876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:54.567876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:54.567876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:54.567876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:54.567876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:54.567876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:54.567876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:54.567876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:54.567876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:54.567876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:54.567876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:54.567876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:54.567876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:54.567876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:54.568922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:54.568922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:54.568922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:54.568922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:54.568922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:54.568922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:54.568922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:54.568922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:54.568922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:54.568922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:54.568922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:54.568922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:54.568922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:54.568922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:54.568922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:54.568922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:54.570293 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:54.570293 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:54.570293 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:54.570293 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:54.570293 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:54.570293 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:54.570293 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:54.570293 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:54.570293 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:54.570293 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:54.570293 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 05:41:54.570293 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:54.570293 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 444/887] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Jun 21 05:41:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:54.571247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f02b25-815f-4cbc-8f87-3e242ccd4ba1 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:54.603495 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:54.627160 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:54.672166 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c318c-9477-47a9-82d0-98ee5ada4241 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:54.684364 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f02b25-815f-4cbc-8f87-3e242ccd4ba1 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:54.709152 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a4c5d-a640-4ad1-8411-cf084f06f56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:54.710002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a4c5d-a640-4ad1-8411-cf084f06f56b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:54.710293 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a4c5d-a640-4ad1-8411-cf084f06f56b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:54.710756 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a4c5d-a640-4ad1-8411-cf084f06f56b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:54.711237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a4c5d-a640-4ad1-8411-cf084f06f56b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:54.712607 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a4c5d-a640-4ad1-8411-cf084f06f56b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:54.721458 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f5deb-6e0c-44a4-8004-73230b25b7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:54.722155 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f5deb-6e0c-44a4-8004-73230b25b7ba None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:54.722439 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f5deb-6e0c-44a4-8004-73230b25b7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:54.724156 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f5deb-6e0c-44a4-8004-73230b25b7ba None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:54.724893 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f5deb-6e0c-44a4-8004-73230b25b7ba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:54.726668 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-1c2a4c5d-a640-4ad1-8411-cf084f06f56b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 05:41:54.726668 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:54.726668 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 05:41:54.726668 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 05:41:54.726668 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 05:41:54.726668 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 05:41:54.726668 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 05:41:54.726668 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:41:54.726668 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 05:41:54.726668 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:54.726668 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:41:54.726668 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:54.726668 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:54.726668 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:54.726668 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:54.726668 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:54.726668 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:54.727640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:54.727640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:54.727640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:54.727640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:54.727640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:54.727640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:54.727640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 05:41:54.727640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 05:41:54.727640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 05:41:54.727640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 05:41:54.727640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:54.727640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:54.727640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:54.727640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:54.727640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:54.727640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:54.728470 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:54.728470 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:54.728470 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:54.728470 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:54.728470 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:54.728470 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:54.728470 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:54.728470 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:54.728470 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:54.728470 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:54.728470 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 05:41:54.728470 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:41:54.728470 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 05:41:54.728470 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:54.729236 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f5deb-6e0c-44a4-8004-73230b25b7ba None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:54.730168 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 444/888] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jun 21 05:41:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:54.731060 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a4c5d-a640-4ad1-8411-cf084f06f56b None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:54.752529 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 445/889] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jun 21 05:41:54 2022] POST /identity/v3/services => generated 269 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:41:54.752529 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f5deb-6e0c-44a4-8004-73230b25b7ba None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:54.894322 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a4c5d-a640-4ad1-8411-cf084f06f56b None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:54.897594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:54.922594 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f5deb-6e0c-44a4-8004-73230b25b7ba None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:54.926264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:54.941183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33102c8-f936-4814-910a-a15fb2df73ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:54.941866 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33102c8-f936-4814-910a-a15fb2df73ce None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:54.942183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33102c8-f936-4814-910a-a15fb2df73ce None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:54.942462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33102c8-f936-4814-910a-a15fb2df73ce None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:54.943389 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33102c8-f936-4814-910a-a15fb2df73ce None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:54.944139 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33102c8-f936-4814-910a-a15fb2df73ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:54.945838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33102c8-f936-4814-910a-a15fb2df73ce None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:54.957458 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 445/890] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Jun 21 05:41:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:54.962756 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33102c8-f936-4814-910a-a15fb2df73ce None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:54.976260 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f21df0-597c-43fa-b86b-fb7fa3d2a25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:54.976260 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f21df0-597c-43fa-b86b-fb7fa3d2a25d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:54.976260 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f21df0-597c-43fa-b86b-fb7fa3d2a25d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:54.976260 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f21df0-597c-43fa-b86b-fb7fa3d2a25d None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:54.976661 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f21df0-597c-43fa-b86b-fb7fa3d2a25d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:54.976661 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f21df0-597c-43fa-b86b-fb7fa3d2a25d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:54.976983 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f21df0-597c-43fa-b86b-fb7fa3d2a25d None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:54.983562 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 446/891] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jun 21 05:41:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:54.989370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f21df0-597c-43fa-b86b-fb7fa3d2a25d None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:55.107374 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33102c8-f936-4814-910a-a15fb2df73ce None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:55.123698 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f21df0-597c-43fa-b86b-fb7fa3d2a25d None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:55.149449 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020728db-b7a2-4e7b-b993-40f4067d805c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:55.150241 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020728db-b7a2-4e7b-b993-40f4067d805c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:55.150522 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020728db-b7a2-4e7b-b993-40f4067d805c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:55.150795 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020728db-b7a2-4e7b-b993-40f4067d805c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:55.164745 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020728db-b7a2-4e7b-b993-40f4067d805c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:55.166229 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020728db-b7a2-4e7b-b993-40f4067d805c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:55.171703 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2241ff-b110-4811-8d8b-0b3d8f5c90dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:55.172722 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2241ff-b110-4811-8d8b-0b3d8f5c90dd None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:55.173841 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2241ff-b110-4811-8d8b-0b3d8f5c90dd None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:55.174372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2241ff-b110-4811-8d8b-0b3d8f5c90dd None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:55.175851 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2241ff-b110-4811-8d8b-0b3d8f5c90dd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:55.176690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2241ff-b110-4811-8d8b-0b3d8f5c90dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:55.178358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2241ff-b110-4811-8d8b-0b3d8f5c90dd None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:55.184292 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 447/892] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jun 21 05:41:54 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:41:55.185887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-020728db-b7a2-4e7b-b993-40f4067d805c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:55.185887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:55.185887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:55.185887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:55.185887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:55.185887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:55.185887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:55.185887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:55.185887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:55.185887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:55.185887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:55.185887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:55.185887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:55.185887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:55.185887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:55.186808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:55.186808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:55.186808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:55.186808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:55.186808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:55.186808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:55.186808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:55.186808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:55.186808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:55.186808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:55.186808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:55.186808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:55.186808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:55.186808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:55.186808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:55.186808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:55.186808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:55.187728 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:55.187728 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:55.187728 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:55.187728 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:55.191664 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 446/893] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:41:55.197065 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2241ff-b110-4811-8d8b-0b3d8f5c90dd None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:55.236787 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:55.320994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2241ff-b110-4811-8d8b-0b3d8f5c90dd None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:55.361335 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e5f63-021d-4f6d-86a9-82f0715bc30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:55.362039 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e5f63-021d-4f6d-86a9-82f0715bc30f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:55.362330 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e5f63-021d-4f6d-86a9-82f0715bc30f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:55.362611 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e5f63-021d-4f6d-86a9-82f0715bc30f None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:55.363343 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e5f63-021d-4f6d-86a9-82f0715bc30f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:55.363652 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e5f63-021d-4f6d-86a9-82f0715bc30f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:55.365032 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e5f63-021d-4f6d-86a9-82f0715bc30f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:55.378713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 448/894] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:55.384350 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020728db-b7a2-4e7b-b993-40f4067d805c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:55.407192 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:55.499129 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020728db-b7a2-4e7b-b993-40f4067d805c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:55.535546 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8349d-6e0b-4ff6-947b-40927c41cf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:55.536369 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8349d-6e0b-4ff6-947b-40927c41cf11 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:55.536657 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8349d-6e0b-4ff6-947b-40927c41cf11 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:55.536938 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8349d-6e0b-4ff6-947b-40927c41cf11 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:55.546843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8349d-6e0b-4ff6-947b-40927c41cf11 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:55.548453 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8349d-6e0b-4ff6-947b-40927c41cf11 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:55.564232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-cdf8349d-6e0b-4ff6-947b-40927c41cf11 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 05:41:55.564232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:55.564232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:55.564232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:55.564232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:55.564232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:55.564232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:55.564232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:55.564232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:55.564232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:55.564232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:55.564232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:55.564232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:41:55.564232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:41:55.564232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:41:55.564232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:41:55.565251 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:55.565251 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:55.565251 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:41:55.565251 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:55.565251 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:41:55.565251 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:41:55.565251 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:55.565251 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:55.565251 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:55.565251 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:55.565251 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:55.565251 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:55.565251 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:55.565251 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:55.565251 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:55.565251 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:55.565251 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:55.565251 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:55.566219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:55.566219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:55.566219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:41:55.566219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:41:55.566219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:41:55.566219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:41:55.566219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:41:55.566219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:41:55.566219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 05:41:55.566219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:55.566219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 447/895] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jun 21 05:41:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:55.572981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e5f63-021d-4f6d-86a9-82f0715bc30f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:55.669466 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:55.679328 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e5f63-021d-4f6d-86a9-82f0715bc30f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:55.713626 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0caf1-66b6-4c12-a6e4-c5674c378a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:55.714693 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0caf1-66b6-4c12-a6e4-c5674c378a5e None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:55.715216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0caf1-66b6-4c12-a6e4-c5674c378a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:55.715720 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0caf1-66b6-4c12-a6e4-c5674c378a5e None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:55.717291 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0caf1-66b6-4c12-a6e4-c5674c378a5e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:55.717611 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0caf1-66b6-4c12-a6e4-c5674c378a5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:55.719079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0caf1-66b6-4c12-a6e4-c5674c378a5e None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:55.741698 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 449/896] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Jun 21 05:41:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:55.746882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8349d-6e0b-4ff6-947b-40927c41cf11 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:55.832566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:55.856309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8349d-6e0b-4ff6-947b-40927c41cf11 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:55.892778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad233a24-5d51-4ca6-abf2-e035dc810174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:55.893819 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad233a24-5d51-4ca6-abf2-e035dc810174 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:55.894479 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad233a24-5d51-4ca6-abf2-e035dc810174 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:55.894991 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad233a24-5d51-4ca6-abf2-e035dc810174 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:55.970411 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad233a24-5d51-4ca6-abf2-e035dc810174 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:55.972323 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad233a24-5d51-4ca6-abf2-e035dc810174 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:56.056315 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:56.079368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 448/897] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:41:55 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 05:41:56.091034 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0caf1-66b6-4c12-a6e4-c5674c378a5e None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:56.206315 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0caf1-66b6-4c12-a6e4-c5674c378a5e None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:56.246162 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ce3a8-7b2d-4a04-b864-5e78494e0747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:56.246892 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ce3a8-7b2d-4a04-b864-5e78494e0747 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:56.247182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ce3a8-7b2d-4a04-b864-5e78494e0747 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:56.247467 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ce3a8-7b2d-4a04-b864-5e78494e0747 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:56.258041 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ce3a8-7b2d-4a04-b864-5e78494e0747 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:56.259506 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ce3a8-7b2d-4a04-b864-5e78494e0747 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:56.278413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-972ce3a8-7b2d-4a04-b864-5e78494e0747 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:56.278413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:56.278413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:56.278413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:56.278413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:56.278413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:56.278413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:56.278413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:56.278413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:56.278413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:56.278413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:56.278413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:56.278413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:56.278413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:56.278413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:56.279974 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:56.279974 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:56.279974 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:56.279974 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:56.279974 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:56.279974 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:56.279974 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:56.279974 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:56.279974 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:56.279974 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:56.279974 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:56.279974 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:56.279974 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:56.279974 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:56.279974 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:56.279974 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:56.279974 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:56.281106 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:56.281106 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:56.281106 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:56.281106 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:56.281106 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 450/898] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:56.287426 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad233a24-5d51-4ca6-abf2-e035dc810174 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:56.393114 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad233a24-5d51-4ca6-abf2-e035dc810174 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:56.430786 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00afd4-64aa-4309-8a77-ea1e09f1a2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:56.431472 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00afd4-64aa-4309-8a77-ea1e09f1a2fc None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:56.431758 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00afd4-64aa-4309-8a77-ea1e09f1a2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:56.432044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00afd4-64aa-4309-8a77-ea1e09f1a2fc None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:56.432789 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00afd4-64aa-4309-8a77-ea1e09f1a2fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:56.433104 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00afd4-64aa-4309-8a77-ea1e09f1a2fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:56.434624 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00afd4-64aa-4309-8a77-ea1e09f1a2fc None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:56.445451 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f388e57-e379-4f3a-82f1-c67844213de5 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:56.445996 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f388e57-e379-4f3a-82f1-c67844213de5 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:56.446078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f388e57-e379-4f3a-82f1-c67844213de5 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:56.447738 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 451/899] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:56.448346 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 449/900] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:56.453556 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d0759-472d-4407-979d-c32bc2bdcd2c None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:56.453859 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d0759-472d-4407-979d-c32bc2bdcd2c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:56.454166 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d0759-472d-4407-979d-c32bc2bdcd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:56.459092 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00afd4-64aa-4309-8a77-ea1e09f1a2fc None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:56.459324 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:56.474733 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-150d0759-472d-4407-979d-c32bc2bdcd2c None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:56.476365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-150d0759-472d-4407-979d-c32bc2bdcd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:56.507945 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:56.578304 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 452/901] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 05:41:56.583750 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00afd4-64aa-4309-8a77-ea1e09f1a2fc None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:56.598901 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d0759-472d-4407-979d-c32bc2bdcd2c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:56.627760 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66debb-a5d4-4a1d-9ad1-5ff4b6577a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:56.629106 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66debb-a5d4-4a1d-9ad1-5ff4b6577a55 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:56.629813 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66debb-a5d4-4a1d-9ad1-5ff4b6577a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:56.630748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66debb-a5d4-4a1d-9ad1-5ff4b6577a55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:56.640239 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66debb-a5d4-4a1d-9ad1-5ff4b6577a55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:56.641774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66debb-a5d4-4a1d-9ad1-5ff4b6577a55 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:56.656746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-ff66debb-a5d4-4a1d-9ad1-5ff4b6577a55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:56.656746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:56.656746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:56.656746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:56.656746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:56.656746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:56.656746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:56.656746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:56.656746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:56.656746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:56.656746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:56.656746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:56.656746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:41:56.656746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:41:56.656746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:41:56.657700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:41:56.657700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:56.657700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:56.657700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:56.657700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:56.657700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:56.657700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:56.657700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:56.657700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:56.657700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:56.657700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:56.657700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:56.657700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:56.657700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:56.657700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:56.657700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:56.657700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:56.658652 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:41:56.658652 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:41:56.658652 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:41:56.658652 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:41:56.658652 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:41:56.658652 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:41:56.658652 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:41:56.658652 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:56.662891 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 450/902] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:41:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:56.663802 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66debb-a5d4-4a1d-9ad1-5ff4b6577a55 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:56.724880 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d0759-472d-4407-979d-c32bc2bdcd2c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:56.762935 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:56.769504 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb96023-1cbf-44fc-b3af-8e0dbb3d98eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:56.770469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb96023-1cbf-44fc-b3af-8e0dbb3d98eb None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:56.771169 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb96023-1cbf-44fc-b3af-8e0dbb3d98eb None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:56.771584 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb96023-1cbf-44fc-b3af-8e0dbb3d98eb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:56.772787 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb96023-1cbf-44fc-b3af-8e0dbb3d98eb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:56.774357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb96023-1cbf-44fc-b3af-8e0dbb3d98eb None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:56.787994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-4cb96023-1cbf-44fc-b3af-8e0dbb3d98eb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 05:41:56.787994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:56.787994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 05:41:56.787994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 05:41:56.787994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 05:41:56.787994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 05:41:56.787994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 05:41:56.787994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:41:56.787994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 05:41:56.787994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:56.787994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:41:56.787994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:56.787994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:56.787994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:56.787994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:56.787994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:56.787994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:56.789088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:56.789088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:56.789088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:56.789088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:56.789088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:56.789088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:56.789088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 05:41:56.789088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 05:41:56.789088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 05:41:56.789088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 05:41:56.789088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:56.789088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:56.789088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:56.789088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:56.789088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:56.789088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:56.789991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:56.789991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:56.789991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:56.789991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:56.789991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:56.789991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:56.789991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:56.789991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:56.789991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:56.789991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:56.789991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 05:41:56.789991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:41:56.789991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 05:41:56.789991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:56.791759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:56.794310 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 453/903] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 21 05:41:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:56.796100 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb96023-1cbf-44fc-b3af-8e0dbb3d98eb None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:56.798624 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66debb-a5d4-4a1d-9ad1-5ff4b6577a55 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:56.848322 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1dfed-6b00-4e40-9405-a72167f06012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:56.849512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1dfed-6b00-4e40-9405-a72167f06012 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:56.850013 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1dfed-6b00-4e40-9405-a72167f06012 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:56.850770 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1dfed-6b00-4e40-9405-a72167f06012 None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:56.851752 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1dfed-6b00-4e40-9405-a72167f06012 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:56.852268 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1dfed-6b00-4e40-9405-a72167f06012 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:56.854376 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1dfed-6b00-4e40-9405-a72167f06012 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:56.869944 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 451/904] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:41:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:56.876256 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1dfed-6b00-4e40-9405-a72167f06012 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:56.929529 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb96023-1cbf-44fc-b3af-8e0dbb3d98eb None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:56.971226 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791b239-44b0-423e-9885-39d79ca60a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:56.971921 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791b239-44b0-423e-9885-39d79ca60a20 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:56.972203 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791b239-44b0-423e-9885-39d79ca60a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:56.972470 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791b239-44b0-423e-9885-39d79ca60a20 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:56.973179 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5791b239-44b0-423e-9885-39d79ca60a20 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:56.973482 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5791b239-44b0-423e-9885-39d79ca60a20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:56.975319 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5791b239-44b0-423e-9885-39d79ca60a20 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:56.987401 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 454/905] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 21 05:41:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:56.987401 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b74e2-aa04-44c3-a454-337d9d8116f3 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:56.987401 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b74e2-aa04-44c3-a454-337d9d8116f3 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:56.987401 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b74e2-aa04-44c3-a454-337d9d8116f3 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:56.987401 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 455/906] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:56.991960 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b74e2-aa04-44c3-a454-337d9d8116f3 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:57.001307 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1dfed-6b00-4e40-9405-a72167f06012 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:57.037305 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cc8b1-f464-4b87-825f-a13f11dec054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:57.037886 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cc8b1-f464-4b87-825f-a13f11dec054 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:57.038203 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cc8b1-f464-4b87-825f-a13f11dec054 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:57.038488 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cc8b1-f464-4b87-825f-a13f11dec054 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:57.039332 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753cc8b1-f464-4b87-825f-a13f11dec054 None admin] RBAC: Adding query filter params (role.id=31cd2c6d233240a4b889e206872556b0, scope.project.id=e64b932ef6bf481cb93a04885a93b4b2, user.id=af8e0eb5ff8c40ae848929780d99e72d) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:57.039652 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753cc8b1-f464-4b87-825f-a13f11dec054 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:57.041078 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753cc8b1-f464-4b87-825f-a13f11dec054 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:57.047441 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 452/907] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:41:56 2022] GET /identity/v3/role_assignments?user.id=af8e0eb5ff8c40ae848929780d99e72d&scope.project.id=e64b932ef6bf481cb93a04885a93b4b2&role.id=31cd2c6d233240a4b889e206872556b0 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:57.048612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0068461-884e-47c8-b9d3-b78a1b200357 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:57.048906 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0068461-884e-47c8-b9d3-b78a1b200357 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:57.049190 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0068461-884e-47c8-b9d3-b78a1b200357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:57.068408 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-a0068461-884e-47c8-b9d3-b78a1b200357 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:57.069882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a0068461-884e-47c8-b9d3-b78a1b200357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:57.070672 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:57.094404 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:57.146492 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b74e2-aa04-44c3-a454-337d9d8116f3 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:57.166725 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 453/908] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:41:57.190556 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0068461-884e-47c8-b9d3-b78a1b200357 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:57.191108 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40d39b-a84d-4ccb-89e3-25898cd15b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:57.192025 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40d39b-a84d-4ccb-89e3-25898cd15b1e None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:57.192844 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40d39b-a84d-4ccb-89e3-25898cd15b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:57.193337 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40d39b-a84d-4ccb-89e3-25898cd15b1e None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:57.195331 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40d39b-a84d-4ccb-89e3-25898cd15b1e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:57.195853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40d39b-a84d-4ccb-89e3-25898cd15b1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:57.197464 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40d39b-a84d-4ccb-89e3-25898cd15b1e None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:57.205568 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 456/909] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jun 21 05:41:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:57.211522 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40d39b-a84d-4ccb-89e3-25898cd15b1e None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:57.316128 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0068461-884e-47c8-b9d3-b78a1b200357 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:57.334442 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40d39b-a84d-4ccb-89e3-25898cd15b1e None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:57.361727 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ab354-2e5d-499e-9f35-620265ec1e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:57.362908 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ab354-2e5d-499e-9f35-620265ec1e25 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:57.363442 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ab354-2e5d-499e-9f35-620265ec1e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:57.363991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:57.365009 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ab354-2e5d-499e-9f35-620265ec1e25 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:57.365857 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ab354-2e5d-499e-9f35-620265ec1e25 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:57.368179 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ab354-2e5d-499e-9f35-620265ec1e25 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:57.375909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c4e38-408e-4584-894f-d1990af22a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:57.376701 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c4e38-408e-4584-894f-d1990af22a0a None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:57.377086 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c4e38-408e-4584-894f-d1990af22a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:57.377516 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c4e38-408e-4584-894f-d1990af22a0a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:57.378419 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c4e38-408e-4584-894f-d1990af22a0a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:57.380401 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c4e38-408e-4584-894f-d1990af22a0a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:57.383042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-505ab354-2e5d-499e-9f35-620265ec1e25 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 05:41:57.383042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:57.383042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 05:41:57.383042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 05:41:57.383042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 05:41:57.383042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 05:41:57.383042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 05:41:57.383042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:41:57.383042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 05:41:57.383042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:57.383042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:41:57.383042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:57.383042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:57.383042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:57.383042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:57.383042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:57.384143 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:57.384143 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:57.384143 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:57.384143 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:57.384143 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:57.384143 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:57.384143 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:57.384143 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 05:41:57.384143 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 05:41:57.384143 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 05:41:57.384143 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 05:41:57.384143 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:57.384143 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:57.384143 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:57.384143 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:57.384143 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:57.385170 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:57.385170 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:57.385170 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:57.385170 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:57.385170 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:57.385170 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:57.385170 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:57.385170 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:57.385170 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:57.385170 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:57.385170 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:57.385170 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 05:41:57.385170 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:41:57.385170 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 05:41:57.385170 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:57.388423 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 454/910] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Jun 21 05:41:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:41:57.394472 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ab354-2e5d-499e-9f35-620265ec1e25 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:57.411975 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 457/911] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jun 21 05:41:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 05:41:57.416209 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110c317-9230-4f54-b518-ea0162d65f14 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:57.416496 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110c317-9230-4f54-b518-ea0162d65f14 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:57.416783 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110c317-9230-4f54-b518-ea0162d65f14 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:57.422507 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 458/912] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 05:41:57.423938 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f46c9-e0e5-4922-bdcd-8d5c6ff08a6d None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:57.424230 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f46c9-e0e5-4922-bdcd-8d5c6ff08a6d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:57.424520 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f46c9-e0e5-4922-bdcd-8d5c6ff08a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:57.427808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:57.447641 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-c75f46c9-e0e5-4922-bdcd-8d5c6ff08a6d None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:57.449051 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c75f46c9-e0e5-4922-bdcd-8d5c6ff08a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:57.549388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ab354-2e5d-499e-9f35-620265ec1e25 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:57.556004 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 459/913] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:41:57.581268 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f46c9-e0e5-4922-bdcd-8d5c6ff08a6d None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:57.595145 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d85c70-461a-4296-a152-45c30fe41883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:57.595821 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d85c70-461a-4296-a152-45c30fe41883 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:57.596106 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d85c70-461a-4296-a152-45c30fe41883 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:57.596385 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d85c70-461a-4296-a152-45c30fe41883 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:57.597098 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d85c70-461a-4296-a152-45c30fe41883 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:57.597407 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d85c70-461a-4296-a152-45c30fe41883 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:57.598812 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d85c70-461a-4296-a152-45c30fe41883 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:57.605974 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 455/914] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jun 21 05:41:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:41:57.611510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d85c70-461a-4296-a152-45c30fe41883 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:57.710336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f46c9-e0e5-4922-bdcd-8d5c6ff08a6d None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:57.721238 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:57.728589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:57.752390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d85c70-461a-4296-a152-45c30fe41883 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:57.758697 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ce57f-e262-4f58-91b1-ec5db6df4678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:57.759375 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ce57f-e262-4f58-91b1-ec5db6df4678 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:57.759662 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ce57f-e262-4f58-91b1-ec5db6df4678 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:57.759944 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ce57f-e262-4f58-91b1-ec5db6df4678 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:57.760680 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ce57f-e262-4f58-91b1-ec5db6df4678 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:57.762582 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ce57f-e262-4f58-91b1-ec5db6df4678 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:57.785783 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 460/915] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jun 21 05:41:57 2022] POST /identity/v3/services => generated 241 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:41:57.813571 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a62b2-f48d-442d-8479-a5c640ac2566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:57.814703 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a62b2-f48d-442d-8479-a5c640ac2566 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:57.815243 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a62b2-f48d-442d-8479-a5c640ac2566 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:57.815704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a62b2-f48d-442d-8479-a5c640ac2566 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:57.816673 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a62b2-f48d-442d-8479-a5c640ac2566 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:57.817213 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a62b2-f48d-442d-8479-a5c640ac2566 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:57.818843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a62b2-f48d-442d-8479-a5c640ac2566 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:57.825731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 456/916] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jun 21 05:41:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:41:57.835527 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ce57f-e262-4f58-91b1-ec5db6df4678 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:57.955752 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ce57f-e262-4f58-91b1-ec5db6df4678 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:57.996900 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2e376-23f6-4534-a029-0847766ab28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:57.997568 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2e376-23f6-4534-a029-0847766ab28a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:57.998421 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2e376-23f6-4534-a029-0847766ab28a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:57.998728 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2e376-23f6-4534-a029-0847766ab28a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:57.999579 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2e376-23f6-4534-a029-0847766ab28a None admin] RBAC: Adding query filter params (interface=public, service_id=299b9c01c80a4030974507b84321393c, region_id=RegionOne) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:57.999896 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2e376-23f6-4534-a029-0847766ab28a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:58.001279 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2e376-23f6-4534-a029-0847766ab28a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:58.009529 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 461/917] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jun 21 05:41:57 2022] GET /identity/v3/endpoints?service_id=299b9c01c80a4030974507b84321393c&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:58.015747 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a62b2-f48d-442d-8479-a5c640ac2566 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:58.134897 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a62b2-f48d-442d-8479-a5c640ac2566 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:58.170606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4773507-154e-4b89-ab44-7b8f880e71fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:58.171726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4773507-154e-4b89-ab44-7b8f880e71fc None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:58.172209 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4773507-154e-4b89-ab44-7b8f880e71fc None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:58.172710 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4773507-154e-4b89-ab44-7b8f880e71fc None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:58.173611 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4773507-154e-4b89-ab44-7b8f880e71fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:58.175206 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4773507-154e-4b89-ab44-7b8f880e71fc None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:58.183285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 457/918] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jun 21 05:41:58 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:41:59.191922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80391f5-d8f8-41f4-86d6-e16fdd8d88a2 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:59.192941 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80391f5-d8f8-41f4-86d6-e16fdd8d88a2 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:59.193419 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80391f5-d8f8-41f4-86d6-e16fdd8d88a2 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:59.195351 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 462/919] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:59.201047 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d6974-3cf8-42a3-a038-dbbb2e611d2a None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:59.202482 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d6974-3cf8-42a3-a038-dbbb2e611d2a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:59.202962 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d6974-3cf8-42a3-a038-dbbb2e611d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:59.209239 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:59.221678 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-951d6974-3cf8-42a3-a038-dbbb2e611d2a None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:59.223241 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-951d6974-3cf8-42a3-a038-dbbb2e611d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:59.292439 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 458/920] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:41:59.316225 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80391f5-d8f8-41f4-86d6-e16fdd8d88a2 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:59.348760 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:59.428448 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80391f5-d8f8-41f4-86d6-e16fdd8d88a2 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:59.464455 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1252f0-22a4-4222-ab35-dc21490a2b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:59.465268 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1252f0-22a4-4222-ab35-dc21490a2b29 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:59.465608 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1252f0-22a4-4222-ab35-dc21490a2b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:59.465894 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1252f0-22a4-4222-ab35-dc21490a2b29 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:59.477590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1252f0-22a4-4222-ab35-dc21490a2b29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:41:59.486388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-3c1252f0-22a4-4222-ab35-dc21490a2b29 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 05:41:59.486388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:59.486388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:59.486388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:59.486388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:59.486388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:59.486388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:59.486388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:59.486388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:59.486388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:59.486388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:59.486388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:59.486388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:41:59.486388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:41:59.486388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:41:59.486388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:41:59.487365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:41:59.487365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:41:59.487365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:41:59.487365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:41:59.487365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:59.487365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:59.487365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:59.487365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:59.487365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:59.487365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:59.487365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:59.487365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:59.487365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:59.487365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:59.487365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:59.487365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:59.488259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:59.488259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:59.488259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:59.488259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:59.488259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:41:59.488259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:41:59.488259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:41:59.488259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:41:59.488259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:41:59.488259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:41:59.488259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 05:41:59.488259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:59.488259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 463/921] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Jun 21 05:41:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:59.495654 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d6974-3cf8-42a3-a038-dbbb2e611d2a None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:59.608094 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d6974-3cf8-42a3-a038-dbbb2e611d2a None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:59.644802 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31558179-66a7-4db8-89e5-efba28c38e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:59.645483 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31558179-66a7-4db8-89e5-efba28c38e56 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:59.645771 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31558179-66a7-4db8-89e5-efba28c38e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:59.646082 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31558179-66a7-4db8-89e5-efba28c38e56 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:59.646837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31558179-66a7-4db8-89e5-efba28c38e56 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:41:59.647148 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31558179-66a7-4db8-89e5-efba28c38e56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:59.648512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31558179-66a7-4db8-89e5-efba28c38e56 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:59.650029 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:59.657697 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 459/922] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Jun 21 05:41:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:41:59.663444 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1252f0-22a4-4222-ab35-dc21490a2b29 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:59.665135 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a25e8-4597-4f31-bd20-ba0de04fa0ca None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:59.665702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a25e8-4597-4f31-bd20-ba0de04fa0ca None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:59.666085 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a25e8-4597-4f31-bd20-ba0de04fa0ca None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:59.670211 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 460/923] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:41:59.674264 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26d633-ad95-47a9-a582-6372b73b94d7 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:59.674722 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26d633-ad95-47a9-a582-6372b73b94d7 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:59.675181 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26d633-ad95-47a9-a582-6372b73b94d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:59.694776 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-da26d633-ad95-47a9-a582-6372b73b94d7 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:41:59.696197 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-da26d633-ad95-47a9-a582-6372b73b94d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:41:59.777768 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:59.790069 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 461/924] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:41:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:41:59.790280 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1252f0-22a4-4222-ab35-dc21490a2b29 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:59.810177 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26d633-ad95-47a9-a582-6372b73b94d7 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:59.828994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc905d5b-c6d0-43f1-828d-d364300d195e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:59.830139 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc905d5b-c6d0-43f1-828d-d364300d195e None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:59.830624 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc905d5b-c6d0-43f1-828d-d364300d195e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:59.831076 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc905d5b-c6d0-43f1-828d-d364300d195e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:59.842669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc905d5b-c6d0-43f1-828d-d364300d195e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:59.844389 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc905d5b-c6d0-43f1-828d-d364300d195e None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:59.864644 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-dc905d5b-c6d0-43f1-828d-d364300d195e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:59.864644 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:59.864644 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:41:59.864644 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:41:59.864644 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:41:59.864644 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:41:59.864644 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:41:59.864644 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:41:59.864644 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:41:59.864644 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:41:59.864644 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:41:59.864644 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:41:59.864644 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:41:59.864644 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:41:59.864644 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:41:59.865813 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:41:59.865813 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:41:59.865813 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:41:59.865813 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:41:59.865813 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:41:59.865813 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:41:59.865813 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:41:59.865813 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:41:59.865813 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:41:59.865813 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:41:59.865813 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:41:59.865813 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:41:59.865813 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:41:59.865813 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:41:59.865813 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:41:59.865813 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:41:59.865813 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:41:59.866961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:41:59.866961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:41:59.866961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:41:59.866961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:41:59.868901 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 464/925] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:41:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:41:59.875238 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc905d5b-c6d0-43f1-828d-d364300d195e None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:41:59.921802 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26d633-ad95-47a9-a582-6372b73b94d7 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:59.950027 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:41:59.959535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede57e72-bce2-4d3c-8de6-a7ddfd05c503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:41:59.960212 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede57e72-bce2-4d3c-8de6-a7ddfd05c503 None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:41:59.960527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede57e72-bce2-4d3c-8de6-a7ddfd05c503 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:41:59.960809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede57e72-bce2-4d3c-8de6-a7ddfd05c503 None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:41:59.961521 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede57e72-bce2-4d3c-8de6-a7ddfd05c503 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:41:59.963009 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede57e72-bce2-4d3c-8de6-a7ddfd05c503 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:41:59.964377 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: WARNING keystone.server.flask.common [None req-ede57e72-bce2-4d3c-8de6-a7ddfd05c503 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 21 05:41:59.983704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.sql.core [None req-ede57e72-bce2-4d3c-8de6-a7ddfd05c503 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 21 05:41:59.983704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 21 05:41:59.983704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [parameters: {'id': 'c89ff1783fed43ef8e90474ab2140eaa', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 21 05:41:59.983704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80110) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 21 05:41:59.988903 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc905d5b-c6d0-43f1-828d-d364300d195e None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:41:59.991976 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-ede57e72-bce2-4d3c-8de6-a7ddfd05c503 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c89ff1783fed43ef8e90474ab2140eaa.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c89ff1783fed43ef8e90474ab2140eaa. Jun 21 05:41:59.991976 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:59.991976 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 05:41:59.991976 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 05:41:59.991976 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 05:41:59.991976 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 05:41:59.991976 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 05:41:59.991976 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 05:41:59.991976 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 05:41:59.991976 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application conn.query(q) Jun 21 05:41:59.991976 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 05:41:59.991976 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 05:41:59.991976 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 05:41:59.992920 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application result.read() Jun 21 05:41:59.992920 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 05:41:59.992920 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 05:41:59.992920 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 05:41:59.992920 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 05:41:59.992920 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 05:41:59.992920 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 05:41:59.992920 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 05:41:59.992920 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 05:41:59.992920 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 21 05:41:59.992920 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:59.992920 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 21 05:41:59.992920 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:41:59.992920 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:41:59.992920 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 21 05:41:59.992920 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 21 05:41:59.992920 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 21 05:41:59.992920 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 21 05:41:59.998992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 05:41:59.998992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application next(self.gen) Jun 21 05:41:59.998992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 21 05:41:59.998992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application yield resource Jun 21 05:41:59.998992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 05:41:59.998992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application next(self.gen) Jun 21 05:41:59.998992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 21 05:41:59.998992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self.session.rollback() Jun 21 05:41:59.998992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 21 05:41:59.998992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self.force_reraise() Jun 21 05:41:59.998992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 21 05:41:59.998992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise self.value Jun 21 05:41:59.998992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 21 05:41:59.998992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 21 05:41:59.998992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 21 05:41:59.998992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application session.commit() Jun 21 05:41:59.998992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 21 05:42:00.000518 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 21 05:42:00.000518 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 21 05:42:00.000518 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._prepare_impl() Jun 21 05:42:00.000518 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 21 05:42:00.000518 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self.session.flush() Jun 21 05:42:00.000518 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 21 05:42:00.000518 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._flush(objects) Jun 21 05:42:00.000518 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 21 05:42:00.000518 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 21 05:42:00.000518 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 21 05:42:00.000518 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application compat.raise_( Jun 21 05:42:00.000518 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 05:42:00.000518 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception Jun 21 05:42:00.000518 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 21 05:42:00.000518 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application flush_context.execute() Jun 21 05:42:00.000518 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 21 05:42:00.000518 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rec.execute(self) Jun 21 05:42:00.002527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 21 05:42:00.002527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 21 05:42:00.002527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 21 05:42:00.002527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 21 05:42:00.002527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 21 05:42:00.002527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 21 05:42:00.002527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 21 05:42:00.002527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 21 05:42:00.002527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 21 05:42:00.002527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 21 05:42:00.002527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 21 05:42:00.002527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 21 05:42:00.002527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 21 05:42:00.002527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 21 05:42:00.002527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 21 05:42:00.004216 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 21 05:42:00.004216 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 05:42:00.004216 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception Jun 21 05:42:00.004216 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 05:42:00.004216 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 05:42:00.004216 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 05:42:00.004216 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 05:42:00.004216 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 05:42:00.004216 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 05:42:00.004216 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 05:42:00.004216 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application conn.query(q) Jun 21 05:42:00.004216 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 05:42:00.004216 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 05:42:00.004216 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 05:42:00.004216 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application result.read() Jun 21 05:42:00.004216 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 05:42:00.004216 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 05:42:00.006384 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 05:42:00.006384 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 05:42:00.006384 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 05:42:00.006384 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 05:42:00.006384 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 05:42:00.006384 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 05:42:00.006384 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 21 05:42:00.006384 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 21 05:42:00.006384 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [parameters: {'id': 'c89ff1783fed43ef8e90474ab2140eaa', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 21 05:42:00.006384 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 21 05:42:00.006384 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:00.006384 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:42:00.006384 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:00.006384 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:00.006384 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 21 05:42:00.007538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 21 05:42:00.007538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 21 05:42:00.007538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 21 05:42:00.007538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 21 05:42:00.007538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:00.007538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:42:00.007538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:00.007538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:00.007538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:00.007538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:00.007538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:00.007538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:00.007538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:00.007538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:00.007538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:00.007538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:00.007538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:00.010055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:00.010055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 21 05:42:00.010055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 21 05:42:00.010055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:00.010055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:00.010055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 21 05:42:00.010055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 21 05:42:00.010055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c89ff1783fed43ef8e90474ab2140eaa. Jun 21 05:42:00.010055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:00.010055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 462/926] 10.222.0.18 () {60 vars in 1140 bytes} [Tue Jun 21 05:41:59 2022] POST /identity/v3/projects => generated 262 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:42:00.010055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58258e-c97a-44fa-bc5e-98e2b8b36571 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:00.010055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58258e-c97a-44fa-bc5e-98e2b8b36571 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:00.011420 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58258e-c97a-44fa-bc5e-98e2b8b36571 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:00.011420 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 463/927] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:41:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:00.011420 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58258e-c97a-44fa-bc5e-98e2b8b36571 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:00.044162 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440b4dd-3a5e-4257-87e8-234fe4eeb71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:00.045519 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440b4dd-3a5e-4257-87e8-234fe4eeb71a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:00.045865 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440b4dd-3a5e-4257-87e8-234fe4eeb71a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:00.046217 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440b4dd-3a5e-4257-87e8-234fe4eeb71a None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:00.047010 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440b4dd-3a5e-4257-87e8-234fe4eeb71a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:00.047386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440b4dd-3a5e-4257-87e8-234fe4eeb71a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:00.048842 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440b4dd-3a5e-4257-87e8-234fe4eeb71a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:00.062652 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 465/928] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:00.068849 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77deb3d6-8099-4a6f-9172-27f655c1e4cb None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:00.069225 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77deb3d6-8099-4a6f-9172-27f655c1e4cb None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:00.069666 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77deb3d6-8099-4a6f-9172-27f655c1e4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:00.075437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:00.089143 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-77deb3d6-8099-4a6f-9172-27f655c1e4cb None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:00.090367 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-77deb3d6-8099-4a6f-9172-27f655c1e4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:00.127730 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58258e-c97a-44fa-bc5e-98e2b8b36571 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:00.164690 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60955c14-b91a-4cff-9dad-333b3e3e1de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:00.174105 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 466/929] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:42:00.174259 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60955c14-b91a-4cff-9dad-333b3e3e1de8 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:00.174259 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60955c14-b91a-4cff-9dad-333b3e3e1de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:00.174445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77deb3d6-8099-4a6f-9172-27f655c1e4cb None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:00.174529 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60955c14-b91a-4cff-9dad-333b3e3e1de8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:00.182971 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60955c14-b91a-4cff-9dad-333b3e3e1de8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:00.184743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60955c14-b91a-4cff-9dad-333b3e3e1de8 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:00.201338 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-60955c14-b91a-4cff-9dad-333b3e3e1de8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:42:00.201338 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:00.201338 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:00.201338 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:00.201338 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:00.201338 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:00.201338 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:00.201338 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:00.201338 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:00.201338 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:00.201338 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:00.201338 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:00.201338 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:42:00.201338 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:42:00.201338 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:42:00.202838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:42:00.202838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:00.202838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:00.202838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:00.202838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:00.202838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:00.202838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:00.202838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:00.202838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:00.202838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:00.202838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:00.202838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:00.202838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:00.202838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:00.202838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:00.202838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:00.202838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:00.203802 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:42:00.203802 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:42:00.203802 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:42:00.203802 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:42:00.203802 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:42:00.203802 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:42:00.203802 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:42:00.203802 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:00.203802 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 464/930] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:42:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:42:00.203802 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60955c14-b91a-4cff-9dad-333b3e3e1de8 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:00.256157 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:00.287755 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77deb3d6-8099-4a6f-9172-27f655c1e4cb None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:00.318977 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60955c14-b91a-4cff-9dad-333b3e3e1de8 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:00.319340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:00.325165 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a7ddc-d99a-473e-92cb-96c154033452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:00.326545 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a7ddc-d99a-473e-92cb-96c154033452 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:00.326833 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a7ddc-d99a-473e-92cb-96c154033452 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:00.327112 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a7ddc-d99a-473e-92cb-96c154033452 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:00.335186 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a7ddc-d99a-473e-92cb-96c154033452 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:00.336974 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a7ddc-d99a-473e-92cb-96c154033452 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:00.353024 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-8f8a7ddc-d99a-473e-92cb-96c154033452 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 05:42:00.353024 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:00.353024 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:00.353024 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:00.353024 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:00.353024 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:00.353024 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:00.353024 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:00.353024 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:00.353024 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:00.353024 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:00.353024 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:00.353024 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:42:00.353024 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:42:00.353024 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:42:00.353024 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:42:00.354113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:00.354113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:00.354113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:42:00.354113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:42:00.354113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:42:00.354113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:42:00.354113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:00.354113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:00.354113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:00.354113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:00.354113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:00.354113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:00.354113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:00.354113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:00.354113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:00.354113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:00.354113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:00.354113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:00.355055 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:00.355055 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:00.355055 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:42:00.355055 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:42:00.355055 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:42:00.355055 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:42:00.355055 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:42:00.355055 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:42:00.355055 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 05:42:00.355055 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:42:00.359652 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 467/931] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jun 21 05:42:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:42:00.360170 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a7ddc-d99a-473e-92cb-96c154033452 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:00.366476 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c3f19-8df1-41e6-8eaa-007d9692e0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:00.367356 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c3f19-8df1-41e6-8eaa-007d9692e0eb None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:00.367667 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c3f19-8df1-41e6-8eaa-007d9692e0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:00.367956 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c3f19-8df1-41e6-8eaa-007d9692e0eb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:00.368623 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c3f19-8df1-41e6-8eaa-007d9692e0eb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:00.370014 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c3f19-8df1-41e6-8eaa-007d9692e0eb None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:00.383253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-aa8c3f19-8df1-41e6-8eaa-007d9692e0eb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 05:42:00.383253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:00.383253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 05:42:00.383253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 05:42:00.383253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 05:42:00.383253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 05:42:00.383253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 05:42:00.383253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:42:00.383253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 05:42:00.383253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:00.383253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:42:00.383253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:00.383253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:00.383253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:00.383253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:00.383253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:00.383253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:00.384456 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:00.384456 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:00.384456 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:00.384456 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:00.384456 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:00.384456 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:00.384456 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 05:42:00.384456 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 05:42:00.384456 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 05:42:00.384456 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 05:42:00.384456 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:00.384456 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:00.384456 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:00.384456 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:00.384456 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:00.384456 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:00.385772 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:00.385772 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:00.385772 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:00.385772 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:00.385772 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:00.385772 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:00.385772 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:00.385772 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:00.385772 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:00.385772 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:00.385772 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 05:42:00.385772 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:42:00.385772 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 05:42:00.385772 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:00.385772 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 465/932] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jun 21 05:42:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:42:00.386762 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c3f19-8df1-41e6-8eaa-007d9692e0eb None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:00.470725 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a7ddc-d99a-473e-92cb-96c154033452 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:00.498963 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c3f19-8df1-41e6-8eaa-007d9692e0eb None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:00.506155 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d6325-d55f-4889-bd28-7848336d6d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:00.506842 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d6325-d55f-4889-bd28-7848336d6d44 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:00.507121 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d6325-d55f-4889-bd28-7848336d6d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:00.507368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:00.507486 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d6325-d55f-4889-bd28-7848336d6d44 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:00.508164 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d6325-d55f-4889-bd28-7848336d6d44 None admin] RBAC: Adding query filter params (name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:00.508472 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d6325-d55f-4889-bd28-7848336d6d44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:00.510480 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d6325-d55f-4889-bd28-7848336d6d44 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:00.540849 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 468/933] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jun 21 05:42:00 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:00.540849 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d6325-d55f-4889-bd28-7848336d6d44 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:00.549996 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1ad8f-2505-4294-81ec-0643c332e67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:00.550702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1ad8f-2505-4294-81ec-0643c332e67b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:00.550988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1ad8f-2505-4294-81ec-0643c332e67b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:00.551266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1ad8f-2505-4294-81ec-0643c332e67b None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:00.552152 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1ad8f-2505-4294-81ec-0643c332e67b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:00.552462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1ad8f-2505-4294-81ec-0643c332e67b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:00.553974 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1ad8f-2505-4294-81ec-0643c332e67b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:00.578857 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 466/934] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Jun 21 05:42:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:00.578857 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20007d84-0851-4564-ac6f-0e482e37c711 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:00.578857 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20007d84-0851-4564-ac6f-0e482e37c711 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:00.578857 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20007d84-0851-4564-ac6f-0e482e37c711 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:00.581708 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 467/935] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:00.582588 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20007d84-0851-4564-ac6f-0e482e37c711 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:00.597990 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:00.654801 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d6325-d55f-4889-bd28-7848336d6d44 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:00.692983 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20007d84-0851-4564-ac6f-0e482e37c711 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:00.693785 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0e8ff-35f9-4060-82c7-5e526e3e0a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:00.694487 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0e8ff-35f9-4060-82c7-5e526e3e0a4f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:00.694770 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0e8ff-35f9-4060-82c7-5e526e3e0a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:00.695046 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0e8ff-35f9-4060-82c7-5e526e3e0a4f None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:00.695767 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0e8ff-35f9-4060-82c7-5e526e3e0a4f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:00.696073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0e8ff-35f9-4060-82c7-5e526e3e0a4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:00.697468 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0e8ff-35f9-4060-82c7-5e526e3e0a4f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:00.704160 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 469/936] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jun 21 05:42:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:00.705398 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf6847-09a4-497f-a153-10ebd9f04c42 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:00.705689 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf6847-09a4-497f-a153-10ebd9f04c42 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:00.705982 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf6847-09a4-497f-a153-10ebd9f04c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:00.725085 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-eabf6847-09a4-497f-a153-10ebd9f04c42 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:00.726290 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-eabf6847-09a4-497f-a153-10ebd9f04c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:00.732948 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19ee85-cd5a-4d1c-9253-e832b34d36c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:00.733755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19ee85-cd5a-4d1c-9253-e832b34d36c2 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:00.734081 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19ee85-cd5a-4d1c-9253-e832b34d36c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:00.734835 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19ee85-cd5a-4d1c-9253-e832b34d36c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:00.747007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19ee85-cd5a-4d1c-9253-e832b34d36c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:00.749004 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19ee85-cd5a-4d1c-9253-e832b34d36c2 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:00.770301 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-ce19ee85-cd5a-4d1c-9253-e832b34d36c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:42:00.770301 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:00.770301 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:00.770301 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:00.770301 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:00.770301 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:00.770301 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:00.770301 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:00.770301 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:00.770301 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:00.770301 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:00.770301 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:00.770301 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:42:00.770301 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:42:00.770301 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:42:00.771362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:42:00.771362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:00.771362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:00.771362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:00.771362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:00.771362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:00.771362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:00.771362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:00.771362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:00.771362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:00.771362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:00.771362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:00.771362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:00.771362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:00.771362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:00.771362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:00.771362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:00.773253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:42:00.773253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:42:00.773253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:42:00.773253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:00.773253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 468/937] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:42:00.773253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19ee85-cd5a-4d1c-9253-e832b34d36c2 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:00.791108 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:00.819138 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 470/938] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:42:00.820186 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf6847-09a4-497f-a153-10ebd9f04c42 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:00.867617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:00.890732 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19ee85-cd5a-4d1c-9253-e832b34d36c2 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:00.924346 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf6847-09a4-497f-a153-10ebd9f04c42 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:00.926669 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c321d-bb02-4871-a15a-1bb916719296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:00.927338 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c321d-bb02-4871-a15a-1bb916719296 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:00.927625 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c321d-bb02-4871-a15a-1bb916719296 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:00.927904 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c321d-bb02-4871-a15a-1bb916719296 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:00.928695 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c321d-bb02-4871-a15a-1bb916719296 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:00.929006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c321d-bb02-4871-a15a-1bb916719296 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:00.930409 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c321d-bb02-4871-a15a-1bb916719296 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:00.936532 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 469/939] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jun 21 05:42:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:00.937582 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c321d-bb02-4871-a15a-1bb916719296 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:00.966868 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ffde6-b293-4653-a4b4-56fd7c1a5922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:00.967779 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ffde6-b293-4653-a4b4-56fd7c1a5922 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:00.968061 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ffde6-b293-4653-a4b4-56fd7c1a5922 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:00.968334 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ffde6-b293-4653-a4b4-56fd7c1a5922 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:00.969082 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ffde6-b293-4653-a4b4-56fd7c1a5922 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:00.969387 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ffde6-b293-4653-a4b4-56fd7c1a5922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:00.970769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ffde6-b293-4653-a4b4-56fd7c1a5922 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:00.982410 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 471/940] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:00.983135 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ffde6-b293-4653-a4b4-56fd7c1a5922 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:01.032958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:01.055649 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c321d-bb02-4871-a15a-1bb916719296 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:01.086889 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ffde6-b293-4653-a4b4-56fd7c1a5922 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:01.093526 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274a678-5976-4440-8998-a45709db816e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:01.094613 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:01.095018 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274a678-5976-4440-8998-a45709db816e None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:01.095312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274a678-5976-4440-8998-a45709db816e None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:01.095639 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274a678-5976-4440-8998-a45709db816e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:01.099214 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274a678-5976-4440-8998-a45709db816e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:01.099214 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274a678-5976-4440-8998-a45709db816e None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:01.113961 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-b274a678-5976-4440-8998-a45709db816e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 05:42:01.113961 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:01.113961 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 05:42:01.113961 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 05:42:01.113961 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 05:42:01.113961 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 05:42:01.113961 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 05:42:01.113961 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:42:01.113961 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 05:42:01.113961 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:01.113961 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:42:01.113961 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:01.113961 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:01.113961 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:01.113961 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:01.113961 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:01.114943 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:01.114943 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:01.114943 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:01.114943 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:01.114943 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:01.114943 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:01.114943 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:01.114943 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 05:42:01.114943 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 05:42:01.114943 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 05:42:01.114943 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 05:42:01.114943 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:01.114943 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:01.114943 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:01.114943 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:01.114943 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:01.115809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:01.115809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:01.115809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:01.115809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:01.115809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:01.115809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:01.115809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:01.115809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:01.115809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:01.115809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:01.115809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:01.115809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 05:42:01.115809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:42:01.115809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 05:42:01.115809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:01.115809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 470/941] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Jun 21 05:42:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:42:01.116650 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274a678-5976-4440-8998-a45709db816e None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:01.146828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d25f5-2573-4e8b-84d8-fdc099f6de72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:01.147647 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d25f5-2573-4e8b-84d8-fdc099f6de72 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:01.147931 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d25f5-2573-4e8b-84d8-fdc099f6de72 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:01.148524 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d25f5-2573-4e8b-84d8-fdc099f6de72 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:01.149593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d25f5-2573-4e8b-84d8-fdc099f6de72 None admin] RBAC: Adding query filter params (interface=public, service_id=99267286ab664aaa847528f0734f0433, region_id=RegionOne) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:01.149909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d25f5-2573-4e8b-84d8-fdc099f6de72 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:01.152042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d25f5-2573-4e8b-84d8-fdc099f6de72 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:01.158345 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 472/942] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jun 21 05:42:00 2022] GET /identity/v3/endpoints?service_id=99267286ab664aaa847528f0734f0433&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:01.159148 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d25f5-2573-4e8b-84d8-fdc099f6de72 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:01.223990 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274a678-5976-4440-8998-a45709db816e None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:01.258618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e71e2-2fec-403a-8e87-93f7e1413518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:01.259343 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e71e2-2fec-403a-8e87-93f7e1413518 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:01.259632 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e71e2-2fec-403a-8e87-93f7e1413518 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:01.259920 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e71e2-2fec-403a-8e87-93f7e1413518 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:01.267779 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e71e2-2fec-403a-8e87-93f7e1413518 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:01.268267 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d25f5-2573-4e8b-84d8-fdc099f6de72 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:01.269219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e71e2-2fec-403a-8e87-93f7e1413518 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:01.284611 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-ad2e71e2-2fec-403a-8e87-93f7e1413518 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:42:01.284611 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:01.284611 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:01.284611 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:01.284611 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:01.284611 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:01.284611 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:01.284611 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:01.284611 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:01.284611 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:01.284611 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:01.284611 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:01.284611 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:42:01.284611 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:42:01.284611 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:42:01.285564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:42:01.285564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:01.285564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:01.285564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:01.285564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:01.285564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:01.285564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:01.285564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:01.285564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:01.285564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:01.285564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:01.285564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:01.285564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:01.285564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:01.285564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:01.285564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:01.285564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:01.286858 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:42:01.286858 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:42:01.286858 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:42:01.286858 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:42:01.286858 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:42:01.286858 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:42:01.286858 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:42:01.286858 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:01.286858 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 471/943] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:42:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:42:01.286858 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e71e2-2fec-403a-8e87-93f7e1413518 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:01.291053 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:01.310912 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ec2c9-8b3a-4720-abeb-af00ce9b149d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:01.311591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ec2c9-8b3a-4720-abeb-af00ce9b149d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:01.311875 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ec2c9-8b3a-4720-abeb-af00ce9b149d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:01.312152 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ec2c9-8b3a-4720-abeb-af00ce9b149d None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:01.312858 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ec2c9-8b3a-4720-abeb-af00ce9b149d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:01.313163 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ec2c9-8b3a-4720-abeb-af00ce9b149d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:01.314577 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ec2c9-8b3a-4720-abeb-af00ce9b149d None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:01.323887 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 473/944] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jun 21 05:42:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:01.323887 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ec2c9-8b3a-4720-abeb-af00ce9b149d None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:01.361888 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:01.399106 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e71e2-2fec-403a-8e87-93f7e1413518 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:01.430254 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ec2c9-8b3a-4720-abeb-af00ce9b149d None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:01.434728 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9be709-75e3-452f-ad38-25b03c986335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:01.435926 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9be709-75e3-452f-ad38-25b03c986335 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:01.436208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9be709-75e3-452f-ad38-25b03c986335 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:01.436484 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9be709-75e3-452f-ad38-25b03c986335 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:01.437166 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9be709-75e3-452f-ad38-25b03c986335 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:01.438592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9be709-75e3-452f-ad38-25b03c986335 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:01.458154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 472/945] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jun 21 05:42:01 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:42:01.459165 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9be709-75e3-452f-ad38-25b03c986335 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:01.477103 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64f433-c93d-4ba2-ac52-26d8f2f223d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:01.477877 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64f433-c93d-4ba2-ac52-26d8f2f223d5 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:01.478388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64f433-c93d-4ba2-ac52-26d8f2f223d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:01.478698 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64f433-c93d-4ba2-ac52-26d8f2f223d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:01.480040 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64f433-c93d-4ba2-ac52-26d8f2f223d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:01.480040 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64f433-c93d-4ba2-ac52-26d8f2f223d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:01.481915 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64f433-c93d-4ba2-ac52-26d8f2f223d5 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:01.502288 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 474/946] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:42:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:01.503468 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64f433-c93d-4ba2-ac52-26d8f2f223d5 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:01.541399 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:01.579843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9be709-75e3-452f-ad38-25b03c986335 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:01.618942 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:01.619297 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552208a0-5045-40ca-a8ad-d61d133f964e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:01.620225 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552208a0-5045-40ca-a8ad-d61d133f964e None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:01.620360 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552208a0-5045-40ca-a8ad-d61d133f964e None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:01.620637 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552208a0-5045-40ca-a8ad-d61d133f964e None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:01.621344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552208a0-5045-40ca-a8ad-d61d133f964e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:01.621659 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552208a0-5045-40ca-a8ad-d61d133f964e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:01.623118 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552208a0-5045-40ca-a8ad-d61d133f964e None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:01.627786 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64f433-c93d-4ba2-ac52-26d8f2f223d5 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:01.628634 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 473/947] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jun 21 05:42:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:01.635405 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552208a0-5045-40ca-a8ad-d61d133f964e None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:01.666294 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb0f81-e456-49b3-acb7-93a9a5cc436c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:01.667210 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb0f81-e456-49b3-acb7-93a9a5cc436c None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:01.667495 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb0f81-e456-49b3-acb7-93a9a5cc436c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:01.667789 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb0f81-e456-49b3-acb7-93a9a5cc436c None admin] PATH_INFO: `/v3/projects/e64b932ef6bf481cb93a04885a93b4b2/users/af8e0eb5ff8c40ae848929780d99e72d/roles/31cd2c6d233240a4b889e206872556b0` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:01.670902 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb0f81-e456-49b3-acb7-93a9a5cc436c None admin] RBAC: Authorizing `identity:create_grant(project_id=e64b932ef6bf481cb93a04885a93b4b2, user_id=af8e0eb5ff8c40ae848929780d99e72d, role_id=31cd2c6d233240a4b889e206872556b0)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:01.672340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb0f81-e456-49b3-acb7-93a9a5cc436c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:01.689664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 475/948] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 21 05:42:01 2022] PUT /identity/v3/projects/e64b932ef6bf481cb93a04885a93b4b2/users/af8e0eb5ff8c40ae848929780d99e72d/roles/31cd2c6d233240a4b889e206872556b0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:42:01.768227 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552208a0-5045-40ca-a8ad-d61d133f964e None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:01.806800 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:01.812510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79786918-3624-44a0-af8c-c7d7df88cc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:01.813733 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79786918-3624-44a0-af8c-c7d7df88cc35 None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:01.814404 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79786918-3624-44a0-af8c-c7d7df88cc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:01.815057 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79786918-3624-44a0-af8c-c7d7df88cc35 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:01.815827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79786918-3624-44a0-af8c-c7d7df88cc35 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:01.817278 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79786918-3624-44a0-af8c-c7d7df88cc35 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:01.845529 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 474/949] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jun 21 05:42:01 2022] POST /identity/v3/endpoints => generated 347 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 05:42:02.679419 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada5ef1-bedb-4715-9f1e-6134ebd5214a None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:02.679943 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada5ef1-bedb-4715-9f1e-6134ebd5214a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:02.680022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada5ef1-bedb-4715-9f1e-6134ebd5214a None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:02.681612 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 476/950] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:02.686915 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63ef67-107f-4de1-ba95-0a3b2eba0dcf None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:02.687322 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63ef67-107f-4de1-ba95-0a3b2eba0dcf None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:02.687493 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63ef67-107f-4de1-ba95-0a3b2eba0dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:02.705250 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-8a63ef67-107f-4de1-ba95-0a3b2eba0dcf None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:02.706791 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-8a63ef67-107f-4de1-ba95-0a3b2eba0dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:02.787132 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 475/951] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:42:02.812914 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada5ef1-bedb-4715-9f1e-6134ebd5214a None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:02.928158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada5ef1-bedb-4715-9f1e-6134ebd5214a None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:02.964393 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22b413-dddd-40e0-bfc6-1a2323580ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:02.965279 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22b413-dddd-40e0-bfc6-1a2323580ef6 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:02.965726 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22b413-dddd-40e0-bfc6-1a2323580ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:02.966186 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22b413-dddd-40e0-bfc6-1a2323580ef6 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:02.967047 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22b413-dddd-40e0-bfc6-1a2323580ef6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:02.968644 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22b413-dddd-40e0-bfc6-1a2323580ef6 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:02.970120 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: WARNING keystone.server.flask.common [None req-7e22b413-dddd-40e0-bfc6-1a2323580ef6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 21 05:42:02.983554 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.sql.core [None req-7e22b413-dddd-40e0-bfc6-1a2323580ef6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 21 05:42:02.983554 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 21 05:42:02.983554 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [parameters: {'user_id': '6acd2840ec4a4b47a933a98118edce5d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 21 05:42:02.983554 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80109) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 21 05:42:03.001278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-7e22b413-dddd-40e0-bfc6-1a2323580ef6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 21 05:42:03.001278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:03.001278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 05:42:03.001278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 05:42:03.001278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 05:42:03.001278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 05:42:03.001278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 05:42:03.001278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 05:42:03.001278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 05:42:03.001278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application conn.query(q) Jun 21 05:42:03.001278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 05:42:03.001278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 05:42:03.001278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 05:42:03.001278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application result.read() Jun 21 05:42:03.001278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 05:42:03.002404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 05:42:03.002404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 05:42:03.002404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 05:42:03.002404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 05:42:03.002404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 05:42:03.002404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 05:42:03.002404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 05:42:03.002404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 21 05:42:03.002404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:42:03.002404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 21 05:42:03.002404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:42:03.002404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:03.002404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 21 05:42:03.002404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 21 05:42:03.002404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 21 05:42:03.002404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 21 05:42:03.002404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 05:42:03.002404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application next(self.gen) Jun 21 05:42:03.003505 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 21 05:42:03.003505 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application yield resource Jun 21 05:42:03.003505 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 05:42:03.003505 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application next(self.gen) Jun 21 05:42:03.003505 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 21 05:42:03.003505 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application self.session.rollback() Jun 21 05:42:03.003505 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 21 05:42:03.003505 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application self.force_reraise() Jun 21 05:42:03.003505 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 21 05:42:03.003505 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise self.value Jun 21 05:42:03.003505 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 21 05:42:03.003505 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 21 05:42:03.003505 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 21 05:42:03.003505 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application session.commit() Jun 21 05:42:03.003505 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 21 05:42:03.003505 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 21 05:42:03.003505 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 21 05:42:03.004469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._prepare_impl() Jun 21 05:42:03.004469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 21 05:42:03.004469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application self.session.flush() Jun 21 05:42:03.004469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 21 05:42:03.004469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._flush(objects) Jun 21 05:42:03.004469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 21 05:42:03.004469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 21 05:42:03.004469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 21 05:42:03.004469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application compat.raise_( Jun 21 05:42:03.004469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 05:42:03.004469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception Jun 21 05:42:03.004469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 21 05:42:03.004469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application flush_context.execute() Jun 21 05:42:03.004469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 21 05:42:03.004469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rec.execute(self) Jun 21 05:42:03.004469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 21 05:42:03.004469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 21 05:42:03.005350 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 21 05:42:03.005350 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 21 05:42:03.005350 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 21 05:42:03.005350 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 21 05:42:03.005350 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 21 05:42:03.005350 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 21 05:42:03.005350 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 21 05:42:03.005350 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 21 05:42:03.005350 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 21 05:42:03.005350 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 21 05:42:03.005350 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 21 05:42:03.005350 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 21 05:42:03.005350 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 21 05:42:03.005350 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 21 05:42:03.005350 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 05:42:03.005350 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception Jun 21 05:42:03.006273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 05:42:03.006273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 05:42:03.006273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 05:42:03.006273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 05:42:03.006273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 05:42:03.006273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 05:42:03.006273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 05:42:03.006273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application conn.query(q) Jun 21 05:42:03.006273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 05:42:03.006273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 05:42:03.006273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 05:42:03.006273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application result.read() Jun 21 05:42:03.006273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 05:42:03.006273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 05:42:03.006273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 05:42:03.006273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 05:42:03.007134 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 05:42:03.007134 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 05:42:03.007134 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 05:42:03.007134 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 05:42:03.007134 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 21 05:42:03.007134 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 21 05:42:03.007134 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [parameters: {'user_id': '6acd2840ec4a4b47a933a98118edce5d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 21 05:42:03.007134 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 21 05:42:03.007134 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:42:03.007134 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:42:03.007134 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:42:03.007134 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:03.007134 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:03.007134 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:03.007134 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:03.008066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:03.008066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:03.008066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:03.008066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:03.008066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:03.008066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:03.008066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:03.008066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 21 05:42:03.008066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 21 05:42:03.008066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:03.008066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:03.008066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:42:03.008066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:42:03.008066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:42:03.008066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:42:03.008066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 21 05:42:03.008066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 21 05:42:03.011379 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 21 05:42:03.011379 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 21 05:42:03.011379 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 21 05:42:03.011379 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 21 05:42:03.011379 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 21 05:42:03.011379 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:42:03.011379 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 477/952] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Jun 21 05:42:02 2022] POST /identity/v3/users => generated 160 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:42:03.014039 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63ef67-107f-4de1-ba95-0a3b2eba0dcf None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:03.146243 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63ef67-107f-4de1-ba95-0a3b2eba0dcf None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:03.162551 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:03.186054 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017520c-e172-42a8-b09d-50e16920d5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:03.187206 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017520c-e172-42a8-b09d-50e16920d5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:03.187711 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017520c-e172-42a8-b09d-50e16920d5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:03.188231 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017520c-e172-42a8-b09d-50e16920d5a6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:03.196065 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017520c-e172-42a8-b09d-50e16920d5a6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:03.197724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017520c-e172-42a8-b09d-50e16920d5a6 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:03.213538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-2017520c-e172-42a8-b09d-50e16920d5a6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 05:42:03.213538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:03.213538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:03.213538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:03.213538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:03.213538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:03.213538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:03.213538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:03.213538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:03.213538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:03.213538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:03.213538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:03.213538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:42:03.213538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:42:03.213538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:42:03.213538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:42:03.214879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:03.214879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:03.214879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:42:03.214879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:42:03.214879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:42:03.214879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:42:03.214879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:03.214879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:03.214879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:03.214879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:03.214879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:03.214879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:03.214879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:03.214879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:03.214879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:03.214879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:03.214879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:03.214879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:03.216146 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:03.216146 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:03.216146 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:42:03.216146 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:42:03.216146 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:42:03.216146 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:42:03.216146 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:42:03.216146 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:42:03.216146 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 05:42:03.216146 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:03.219116 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 476/953] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:42:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:42:03.229370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22b413-dddd-40e0-bfc6-1a2323580ef6 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:03.254166 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:03.345504 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22b413-dddd-40e0-bfc6-1a2323580ef6 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:03.382663 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10671a3a-33c8-4e1f-ad3a-adc96c6658c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:03.383506 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10671a3a-33c8-4e1f-ad3a-adc96c6658c4 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:03.383882 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10671a3a-33c8-4e1f-ad3a-adc96c6658c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:03.384253 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10671a3a-33c8-4e1f-ad3a-adc96c6658c4 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:03.385156 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10671a3a-33c8-4e1f-ad3a-adc96c6658c4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:03.385560 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10671a3a-33c8-4e1f-ad3a-adc96c6658c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:03.387358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10671a3a-33c8-4e1f-ad3a-adc96c6658c4 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:03.432574 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 478/954] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jun 21 05:42:03 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:03.628058 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b379fc-39a5-46bf-b68d-ed03b1518149 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:03.628376 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b379fc-39a5-46bf-b68d-ed03b1518149 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:03.628694 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b379fc-39a5-46bf-b68d-ed03b1518149 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:03.630245 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 477/955] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:03.635953 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fbd11-d2ec-4ab6-8651-efcef72caaa7 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:03.636239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fbd11-d2ec-4ab6-8651-efcef72caaa7 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:03.636522 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fbd11-d2ec-4ab6-8651-efcef72caaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:03.655078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-699fbd11-d2ec-4ab6-8651-efcef72caaa7 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:03.656895 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-699fbd11-d2ec-4ab6-8651-efcef72caaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:03.736476 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 479/956] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:42:03.762778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b379fc-39a5-46bf-b68d-ed03b1518149 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:03.858086 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6b5a6-7b70-48a9-ad4a-2cce7ecb76b6 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:03.858439 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6b5a6-7b70-48a9-ad4a-2cce7ecb76b6 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:03.858652 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6b5a6-7b70-48a9-ad4a-2cce7ecb76b6 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:03.860163 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 480/957] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 05:42:03.865138 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b32910-25ae-4583-a5a3-d82e41d03d25 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:03.865430 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b32910-25ae-4583-a5a3-d82e41d03d25 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:03.865705 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b32910-25ae-4583-a5a3-d82e41d03d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:03.871142 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b379fc-39a5-46bf-b68d-ed03b1518149 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:03.871658 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:03.885489 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-70b32910-25ae-4583-a5a3-d82e41d03d25 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:03.886610 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-70b32910-25ae-4583-a5a3-d82e41d03d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:03.909204 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ac62b-043c-4596-9e55-b6b1113bdd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:03.910042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ac62b-043c-4596-9e55-b6b1113bdd7e None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:03.910325 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ac62b-043c-4596-9e55-b6b1113bdd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:03.910601 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ac62b-043c-4596-9e55-b6b1113bdd7e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:03.911254 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ac62b-043c-4596-9e55-b6b1113bdd7e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:03.912614 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ac62b-043c-4596-9e55-b6b1113bdd7e None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:03.924768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-194ac62b-043c-4596-9e55-b6b1113bdd7e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 05:42:03.924768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:03.924768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 05:42:03.924768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 05:42:03.924768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 05:42:03.924768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 05:42:03.924768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 05:42:03.924768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:42:03.924768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 05:42:03.924768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:03.924768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:42:03.924768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:03.924768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:03.924768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:03.924768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:03.924768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:03.924768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:03.925875 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:03.925875 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:03.925875 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:03.925875 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:03.925875 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:03.925875 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:03.925875 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 05:42:03.925875 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 05:42:03.925875 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 05:42:03.925875 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 05:42:03.925875 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:03.925875 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:03.925875 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:03.925875 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:03.925875 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:03.925875 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:03.927080 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:03.927080 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:03.927080 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:03.927080 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:03.927080 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:03.927080 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:03.927080 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:03.927080 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:03.927080 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:03.927080 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:03.927080 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 05:42:03.927080 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:42:03.927080 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 05:42:03.927080 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:03.927080 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 478/958] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jun 21 05:42:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:42:03.934867 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ac62b-043c-4596-9e55-b6b1113bdd7e None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:03.962922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 481/959] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 05:42:03.982431 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:03.986204 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b32910-25ae-4583-a5a3-d82e41d03d25 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:04.045339 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ac62b-043c-4596-9e55-b6b1113bdd7e None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:04.080058 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435414a-2153-438f-a022-114c9c41f5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:04.080730 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435414a-2153-438f-a022-114c9c41f5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:04.081018 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435414a-2153-438f-a022-114c9c41f5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:04.081301 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435414a-2153-438f-a022-114c9c41f5d6 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:04.082113 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435414a-2153-438f-a022-114c9c41f5d6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:04.082434 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435414a-2153-438f-a022-114c9c41f5d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:04.083814 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435414a-2153-438f-a022-114c9c41f5d6 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:04.085265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b32910-25ae-4583-a5a3-d82e41d03d25 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:04.088660 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 479/960] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jun 21 05:42:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:04.089922 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab46ffb-10b9-41ff-a88f-cda27b40e50c None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:04.090240 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab46ffb-10b9-41ff-a88f-cda27b40e50c None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:04.090522 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab46ffb-10b9-41ff-a88f-cda27b40e50c None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:04.091987 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 480/961] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:04.094506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab46ffb-10b9-41ff-a88f-cda27b40e50c None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:04.124965 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c07f81-efa0-4a66-a9a3-f640a5ad9df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:04.125776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c07f81-efa0-4a66-a9a3-f640a5ad9df7 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:04.126086 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c07f81-efa0-4a66-a9a3-f640a5ad9df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:04.126412 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c07f81-efa0-4a66-a9a3-f640a5ad9df7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:04.128376 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:04.137874 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c07f81-efa0-4a66-a9a3-f640a5ad9df7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:42:04.146052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-70c07f81-efa0-4a66-a9a3-f640a5ad9df7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 05:42:04.146052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:04.146052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:04.146052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:04.146052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:04.146052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:04.146052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:04.146052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:04.146052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:04.146052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:04.146052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:04.146052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:04.146052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:42:04.146052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:42:04.146052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:42:04.146052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:42:04.147286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:42:04.147286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:42:04.147286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:42:04.147286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:42:04.147286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:04.147286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:04.147286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:04.147286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:04.147286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:04.147286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:04.147286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:04.147286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:04.147286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:04.147286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:04.147286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:04.147286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:04.148277 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:04.148277 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:04.148277 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:04.148277 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:04.148277 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:42:04.148277 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:42:04.148277 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:42:04.148277 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:42:04.148277 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:42:04.148277 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:42:04.148277 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 05:42:04.148277 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:42:04.148277 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 482/962] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Jun 21 05:42:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:42:04.149151 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a302a-f50f-48c9-8ebc-f6552c38a43a None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:04.149151 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a302a-f50f-48c9-8ebc-f6552c38a43a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:04.149151 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a302a-f50f-48c9-8ebc-f6552c38a43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:04.167793 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-f64a302a-f50f-48c9-8ebc-f6552c38a43a None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:04.169158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f64a302a-f50f-48c9-8ebc-f6552c38a43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:04.207653 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab46ffb-10b9-41ff-a88f-cda27b40e50c None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:04.209254 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:04.237842 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 483/963] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:42:04.238779 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a302a-f50f-48c9-8ebc-f6552c38a43a None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:04.243883 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d74081-f010-4565-91f4-14b0addc54b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:04.244550 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d74081-f010-4565-91f4-14b0addc54b1 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:04.244833 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d74081-f010-4565-91f4-14b0addc54b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:04.246730 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d74081-f010-4565-91f4-14b0addc54b1 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:04.247467 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d74081-f010-4565-91f4-14b0addc54b1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:04.248429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d74081-f010-4565-91f4-14b0addc54b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:04.249793 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d74081-f010-4565-91f4-14b0addc54b1 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:04.254950 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 481/964] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jun 21 05:42:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:04.260337 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d74081-f010-4565-91f4-14b0addc54b1 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:04.356244 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a302a-f50f-48c9-8ebc-f6552c38a43a None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:04.361633 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d74081-f010-4565-91f4-14b0addc54b1 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:04.380993 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:04.392564 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc58524-1f91-4d5c-83c2-8e8dfa129c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:04.393183 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc58524-1f91-4d5c-83c2-8e8dfa129c08 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:04.393489 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc58524-1f91-4d5c-83c2-8e8dfa129c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:04.393765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc58524-1f91-4d5c-83c2-8e8dfa129c08 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:04.394541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc58524-1f91-4d5c-83c2-8e8dfa129c08 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:04.394851 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc58524-1f91-4d5c-83c2-8e8dfa129c08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:04.396219 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc58524-1f91-4d5c-83c2-8e8dfa129c08 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:04.396383 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc926fe0-2de5-4242-9004-3e5ee9787103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:04.397181 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc926fe0-2de5-4242-9004-3e5ee9787103 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:04.397470 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc926fe0-2de5-4242-9004-3e5ee9787103 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:04.397753 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc926fe0-2de5-4242-9004-3e5ee9787103 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:04.398441 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc926fe0-2de5-4242-9004-3e5ee9787103 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:04.399796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc926fe0-2de5-4242-9004-3e5ee9787103 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:04.405012 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 484/965] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Jun 21 05:42:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:04.405818 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc58524-1f91-4d5c-83c2-8e8dfa129c08 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:04.412183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-cc926fe0-2de5-4242-9004-3e5ee9787103 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 05:42:04.412183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:04.412183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 05:42:04.412183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 05:42:04.412183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 05:42:04.412183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 05:42:04.412183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 05:42:04.412183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:42:04.412183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 05:42:04.412183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:04.412183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:42:04.412183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:04.412183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:04.412183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:04.412183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:04.412183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:04.412183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:04.413299 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:04.413299 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:04.413299 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:04.413299 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:04.413299 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:04.413299 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:04.413299 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 05:42:04.413299 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 05:42:04.413299 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 05:42:04.413299 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 05:42:04.413299 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:04.413299 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:04.413299 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:04.413299 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:04.413299 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:04.413299 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:04.414174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:04.414174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:04.414174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:04.414174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:04.414174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:04.414174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:04.414174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:04.414174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:04.414174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:04.414174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:04.414174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 05:42:04.414174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:42:04.414174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 05:42:04.414174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:04.414174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 482/966] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:42:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:42:04.414990 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc926fe0-2de5-4242-9004-3e5ee9787103 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:04.446387 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:04.511986 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc58524-1f91-4d5c-83c2-8e8dfa129c08 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:04.516883 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc926fe0-2de5-4242-9004-3e5ee9787103 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:04.546300 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5fb33-9c45-4320-b965-df9fb4e51d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:04.546961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5fb33-9c45-4320-b965-df9fb4e51d4a None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:04.547247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5fb33-9c45-4320-b965-df9fb4e51d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:04.547529 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5fb33-9c45-4320-b965-df9fb4e51d4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:04.548270 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5fb33-9c45-4320-b965-df9fb4e51d4a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:04.549651 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5fb33-9c45-4320-b965-df9fb4e51d4a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:04.551426 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2706d-1232-42c3-af0d-af66c5668f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:04.552214 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2706d-1232-42c3-af0d-af66c5668f95 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:04.552495 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2706d-1232-42c3-af0d-af66c5668f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:04.552771 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2706d-1232-42c3-af0d-af66c5668f95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:04.563507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2706d-1232-42c3-af0d-af66c5668f95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:04.564971 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2706d-1232-42c3-af0d-af66c5668f95 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:04.569483 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 485/967] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jun 21 05:42:04 2022] POST /identity/v3/endpoints => generated 349 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:42:04.570360 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5fb33-9c45-4320-b965-df9fb4e51d4a None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:04.590062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-b1b2706d-1232-42c3-af0d-af66c5668f95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:42:04.590062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:04.590062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:04.590062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:04.590062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:04.590062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:04.590062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:04.590062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:04.590062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:04.590062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:04.590062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:04.590062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:04.590062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:42:04.590062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:42:04.590062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:42:04.591085 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:42:04.591085 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:04.591085 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:04.591085 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:04.591085 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:04.591085 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:04.591085 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:04.591085 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:04.591085 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:04.591085 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:04.591085 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:04.591085 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:04.591085 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:04.591085 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:04.591085 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:04.591085 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:04.591085 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:04.593309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:42:04.593309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:42:04.593309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:42:04.593309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:04.593309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 483/968] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:42:04.602456 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2706d-1232-42c3-af0d-af66c5668f95 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:04.629338 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:04.696917 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:04.710085 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5fb33-9c45-4320-b965-df9fb4e51d4a None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:04.719774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2706d-1232-42c3-af0d-af66c5668f95 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:04.750054 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b39fd1-35df-4408-bd6f-78ee5e448cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:04.751305 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b39fd1-35df-4408-bd6f-78ee5e448cef None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:04.751305 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b39fd1-35df-4408-bd6f-78ee5e448cef None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:04.751591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b39fd1-35df-4408-bd6f-78ee5e448cef None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:04.752502 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b39fd1-35df-4408-bd6f-78ee5e448cef None admin] RBAC: Adding query filter params (name=compute) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:04.752502 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b39fd1-35df-4408-bd6f-78ee5e448cef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:04.753796 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b39fd1-35df-4408-bd6f-78ee5e448cef None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:04.760393 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 486/969] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jun 21 05:42:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:04.763932 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513258b6-b9c1-45e6-80ba-f880482a243b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:04.764609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513258b6-b9c1-45e6-80ba-f880482a243b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:04.764894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513258b6-b9c1-45e6-80ba-f880482a243b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:04.765172 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513258b6-b9c1-45e6-80ba-f880482a243b None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:04.766043 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513258b6-b9c1-45e6-80ba-f880482a243b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:04.766358 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513258b6-b9c1-45e6-80ba-f880482a243b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:04.766751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b39fd1-35df-4408-bd6f-78ee5e448cef None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:04.767734 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513258b6-b9c1-45e6-80ba-f880482a243b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:04.781993 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 484/970] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:04.787771 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513258b6-b9c1-45e6-80ba-f880482a243b None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:04.882369 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b39fd1-35df-4408-bd6f-78ee5e448cef None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:04.884551 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:04.897643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513258b6-b9c1-45e6-80ba-f880482a243b None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:04.921470 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb33fb1-0f3c-40ae-9f72-afa0780e7dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:04.922182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb33fb1-0f3c-40ae-9f72-afa0780e7dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:04.922448 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb33fb1-0f3c-40ae-9f72-afa0780e7dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:04.922723 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb33fb1-0f3c-40ae-9f72-afa0780e7dd7 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:04.923427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb33fb1-0f3c-40ae-9f72-afa0780e7dd7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:04.923728 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb33fb1-0f3c-40ae-9f72-afa0780e7dd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:04.925096 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb33fb1-0f3c-40ae-9f72-afa0780e7dd7 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:04.930200 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 487/971] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jun 21 05:42:04 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:04.945042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14672552-edc7-4553-857a-24c77f07e539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:04.945897 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14672552-edc7-4553-857a-24c77f07e539 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:04.946221 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14672552-edc7-4553-857a-24c77f07e539 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:04.946502 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14672552-edc7-4553-857a-24c77f07e539 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:04.955870 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14672552-edc7-4553-857a-24c77f07e539 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:04.957301 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14672552-edc7-4553-857a-24c77f07e539 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:04.974482 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-14672552-edc7-4553-857a-24c77f07e539 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 05:42:04.974482 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:04.974482 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:04.974482 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:04.974482 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:04.974482 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:04.974482 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:04.974482 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:04.974482 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:04.974482 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:04.974482 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:04.974482 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:04.974482 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:42:04.974482 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:42:04.974482 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:42:04.974482 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:42:04.975589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:04.975589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:04.975589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:42:04.975589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:42:04.975589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:42:04.975589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:42:04.975589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:04.975589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:04.975589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:04.975589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:04.975589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:04.975589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:04.975589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:04.975589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:04.975589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:04.975589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:04.975589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:04.975589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:04.976528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:04.976528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:04.976528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:42:04.976528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:42:04.976528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:42:04.976528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:42:04.976528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:42:04.976528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:42:04.976528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 05:42:04.976528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:04.978340 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 485/972] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jun 21 05:42:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:42:04.981887 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb33fb1-0f3c-40ae-9f72-afa0780e7dd7 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:05.092006 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb33fb1-0f3c-40ae-9f72-afa0780e7dd7 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:05.134534 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a332f-bfdc-428c-ad22-ac225df32c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:05.135218 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a332f-bfdc-428c-ad22-ac225df32c11 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:05.135500 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a332f-bfdc-428c-ad22-ac225df32c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:05.135781 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a332f-bfdc-428c-ad22-ac225df32c11 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:05.136654 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a332f-bfdc-428c-ad22-ac225df32c11 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:05.136966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a332f-bfdc-428c-ad22-ac225df32c11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:05.139073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a332f-bfdc-428c-ad22-ac225df32c11 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:05.157329 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 488/973] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Jun 21 05:42:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:05.163071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14672552-edc7-4553-857a-24c77f07e539 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:05.166054 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:05.267325 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14672552-edc7-4553-857a-24c77f07e539 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:05.302608 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccb289-481c-428a-ad2b-f0c1f75aa50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:05.303262 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccb289-481c-428a-ad2b-f0c1f75aa50b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:05.303544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccb289-481c-428a-ad2b-f0c1f75aa50b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:05.303822 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccb289-481c-428a-ad2b-f0c1f75aa50b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:05.371600 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ccb289-481c-428a-ad2b-f0c1f75aa50b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:05.373069 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ccb289-481c-428a-ad2b-f0c1f75aa50b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:05.375001 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:05.475943 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 486/974] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:42:05 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 05:42:05.482551 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a332f-bfdc-428c-ad22-ac225df32c11 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:05.508015 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:05.583817 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a332f-bfdc-428c-ad22-ac225df32c11 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:05.618453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a9d45-468d-4228-89b0-6c1675f373de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:05.619244 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a9d45-468d-4228-89b0-6c1675f373de None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:05.619523 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a9d45-468d-4228-89b0-6c1675f373de None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:05.619792 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a9d45-468d-4228-89b0-6c1675f373de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:05.630055 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a9d45-468d-4228-89b0-6c1675f373de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:05.631521 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a9d45-468d-4228-89b0-6c1675f373de None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:05.649639 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-378a9d45-468d-4228-89b0-6c1675f373de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:42:05.649639 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:05.649639 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:05.649639 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:05.649639 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:05.649639 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:05.649639 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:05.649639 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:05.649639 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:05.649639 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:05.649639 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:05.649639 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:05.649639 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:42:05.649639 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:42:05.649639 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:42:05.650816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:42:05.650816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:05.650816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:05.650816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:05.650816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:05.650816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:05.650816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:05.650816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:05.650816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:05.650816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:05.650816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:05.650816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:05.650816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:05.650816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:05.650816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:05.650816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:05.650816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:05.651726 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:42:05.651726 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:42:05.651726 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:42:05.651726 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:42:05.654647 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 489/975] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:42:05.657154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccb289-481c-428a-ad2b-f0c1f75aa50b None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:05.759974 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccb289-481c-428a-ad2b-f0c1f75aa50b None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:05.761746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:05.802345 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7132a-3fbf-454b-9853-b2f3d9c6178b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:05.803464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7132a-3fbf-454b-9853-b2f3d9c6178b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:05.803749 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7132a-3fbf-454b-9853-b2f3d9c6178b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:05.804028 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7132a-3fbf-454b-9853-b2f3d9c6178b None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:05.806099 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7132a-3fbf-454b-9853-b2f3d9c6178b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:05.806418 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7132a-3fbf-454b-9853-b2f3d9c6178b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:05.807788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7132a-3fbf-454b-9853-b2f3d9c6178b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:05.828530 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 487/976] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:05.830247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a9d45-468d-4228-89b0-6c1675f373de None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:05.906799 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:05.930294 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a9d45-468d-4228-89b0-6c1675f373de None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:05.964265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343aa38-094c-4476-a950-cfd4e9f4b767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:05.965053 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343aa38-094c-4476-a950-cfd4e9f4b767 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:05.965331 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343aa38-094c-4476-a950-cfd4e9f4b767 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:05.965605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343aa38-094c-4476-a950-cfd4e9f4b767 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:05.972351 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343aa38-094c-4476-a950-cfd4e9f4b767 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:05.973784 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343aa38-094c-4476-a950-cfd4e9f4b767 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:05.987667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-a343aa38-094c-4476-a950-cfd4e9f4b767 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:42:05.987667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:05.987667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:05.987667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:05.987667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:05.987667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:05.987667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:05.987667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:05.987667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:05.987667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:05.987667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:05.987667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:05.987667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:42:05.987667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:42:05.987667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:42:05.988570 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:42:05.988570 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:05.988570 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:05.988570 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:05.988570 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:05.988570 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:05.988570 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:05.988570 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:05.988570 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:05.988570 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:05.988570 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:05.988570 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:05.988570 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:05.988570 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:05.988570 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:05.988570 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:05.988570 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:05.989490 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:42:05.989490 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:42:05.989490 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:42:05.989490 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:42:05.989490 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:42:05.989490 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:42:05.989490 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:42:05.989490 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:42:05.989490 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 490/977] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:42:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:42:05.995973 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7132a-3fbf-454b-9853-b2f3d9c6178b None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:06.105639 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7132a-3fbf-454b-9853-b2f3d9c6178b None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:06.145401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec4d9a-cf96-41e8-9710-ff2dfcb584bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:06.146089 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec4d9a-cf96-41e8-9710-ff2dfcb584bd None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:06.146374 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec4d9a-cf96-41e8-9710-ff2dfcb584bd None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:06.146647 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec4d9a-cf96-41e8-9710-ff2dfcb584bd None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:06.147432 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec4d9a-cf96-41e8-9710-ff2dfcb584bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:06.147736 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec4d9a-cf96-41e8-9710-ff2dfcb584bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:06.149150 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec4d9a-cf96-41e8-9710-ff2dfcb584bd None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:06.161698 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 488/978] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:42:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:06.167460 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343aa38-094c-4476-a950-cfd4e9f4b767 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:06.269275 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343aa38-094c-4476-a950-cfd4e9f4b767 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:06.302716 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba015f8-a077-417d-8663-88cc951f956b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:06.303369 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba015f8-a077-417d-8663-88cc951f956b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:06.303648 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba015f8-a077-417d-8663-88cc951f956b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:06.303921 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba015f8-a077-417d-8663-88cc951f956b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:06.304742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba015f8-a077-417d-8663-88cc951f956b None admin] RBAC: Adding query filter params (role.id=31cd2c6d233240a4b889e206872556b0, scope.project.id=e64b932ef6bf481cb93a04885a93b4b2, user.id=af8e0eb5ff8c40ae848929780d99e72d) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:06.305053 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba015f8-a077-417d-8663-88cc951f956b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:06.306521 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba015f8-a077-417d-8663-88cc951f956b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:06.309546 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:06.314594 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 491/979] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:42:06 2022] GET /identity/v3/role_assignments?user.id=af8e0eb5ff8c40ae848929780d99e72d&scope.project.id=e64b932ef6bf481cb93a04885a93b4b2&role.id=31cd2c6d233240a4b889e206872556b0 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:06.638573 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af88492-7db8-4247-bbb3-16d9c5c773e0 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:06.638956 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af88492-7db8-4247-bbb3-16d9c5c773e0 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:06.639135 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af88492-7db8-4247-bbb3-16d9c5c773e0 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:06.640744 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 489/980] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:06.646275 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644ffa0-4c50-4dd0-a5b9-55024dfc746e None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:06.646579 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644ffa0-4c50-4dd0-a5b9-55024dfc746e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:06.646843 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644ffa0-4c50-4dd0-a5b9-55024dfc746e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:06.663999 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-2644ffa0-4c50-4dd0-a5b9-55024dfc746e None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:06.665189 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-2644ffa0-4c50-4dd0-a5b9-55024dfc746e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:06.738908 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 492/981] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:42:06.762160 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af88492-7db8-4247-bbb3-16d9c5c773e0 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:06.789966 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:06.873303 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af88492-7db8-4247-bbb3-16d9c5c773e0 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:06.907675 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae559a3-df50-4675-85b4-879225ddc738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:06.908441 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae559a3-df50-4675-85b4-879225ddc738 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:06.908725 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae559a3-df50-4675-85b4-879225ddc738 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:06.908993 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae559a3-df50-4675-85b4-879225ddc738 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:06.909646 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae559a3-df50-4675-85b4-879225ddc738 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:06.911031 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae559a3-df50-4675-85b4-879225ddc738 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:06.923555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-6ae559a3-df50-4675-85b4-879225ddc738 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 05:42:06.923555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:06.923555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 05:42:06.923555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 05:42:06.923555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 05:42:06.923555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 05:42:06.923555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 05:42:06.923555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:42:06.923555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 05:42:06.923555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:06.923555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:42:06.923555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:06.923555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:06.923555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:06.923555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:06.923555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:06.923555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:06.924569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:06.924569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:06.924569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:06.924569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:06.924569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:06.924569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:06.924569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 05:42:06.924569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 05:42:06.924569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 05:42:06.924569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 05:42:06.924569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:06.924569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:06.924569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:06.924569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:06.924569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:06.924569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:06.925429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:06.925429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:06.925429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:06.925429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:06.925429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:06.925429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:06.925429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:06.925429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:06.925429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:06.925429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:06.925429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 05:42:06.925429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:42:06.925429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 05:42:06.925429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:06.932811 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 490/982] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jun 21 05:42:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:42:06.932983 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644ffa0-4c50-4dd0-a5b9-55024dfc746e None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:07.007168 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b81bae-3215-42fe-9a2f-ba115d9b2677 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:07.007511 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b81bae-3215-42fe-9a2f-ba115d9b2677 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:07.007746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b81bae-3215-42fe-9a2f-ba115d9b2677 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:07.010006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 491/983] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:07.014792 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e1b27-b2bc-4bc6-ab96-15813edda53e None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:07.015084 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e1b27-b2bc-4bc6-ab96-15813edda53e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:07.015368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e1b27-b2bc-4bc6-ab96-15813edda53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:07.032578 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-844e1b27-b2bc-4bc6-ab96-15813edda53e None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:07.033802 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-844e1b27-b2bc-4bc6-ab96-15813edda53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:07.037037 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644ffa0-4c50-4dd0-a5b9-55024dfc746e None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:07.067876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:07.074915 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ed3f8-2ade-4d7f-9cb9-c0eb09825d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:07.075623 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ed3f8-2ade-4d7f-9cb9-c0eb09825d22 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:07.075954 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ed3f8-2ade-4d7f-9cb9-c0eb09825d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:07.076237 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ed3f8-2ade-4d7f-9cb9-c0eb09825d22 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:07.076955 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ed3f8-2ade-4d7f-9cb9-c0eb09825d22 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:07.077264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ed3f8-2ade-4d7f-9cb9-c0eb09825d22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:07.078795 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ed3f8-2ade-4d7f-9cb9-c0eb09825d22 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:07.089065 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 493/984] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jun 21 05:42:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:07.090212 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ed3f8-2ade-4d7f-9cb9-c0eb09825d22 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:07.118951 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 492/985] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 05:42:07.141856 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e1b27-b2bc-4bc6-ab96-15813edda53e None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:07.160253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:07.201822 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ed3f8-2ade-4d7f-9cb9-c0eb09825d22 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:07.242468 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625b31e-4ca0-422c-b9cc-1581c62d9e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:07.243142 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625b31e-4ca0-422c-b9cc-1581c62d9e9e None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:07.243533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625b31e-4ca0-422c-b9cc-1581c62d9e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:07.243706 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625b31e-4ca0-422c-b9cc-1581c62d9e9e None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:07.244420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625b31e-4ca0-422c-b9cc-1581c62d9e9e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:07.244733 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625b31e-4ca0-422c-b9cc-1581c62d9e9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:07.246147 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625b31e-4ca0-422c-b9cc-1581c62d9e9e None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:07.251764 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e1b27-b2bc-4bc6-ab96-15813edda53e None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:07.254083 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 494/986] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jun 21 05:42:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:07.257733 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625b31e-4ca0-422c-b9cc-1581c62d9e9e None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:07.289062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5a86f-3e6b-479d-8820-35a7e19e3ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:07.289785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5a86f-3e6b-479d-8820-35a7e19e3ef9 None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:07.290103 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5a86f-3e6b-479d-8820-35a7e19e3ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:07.290384 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5a86f-3e6b-479d-8820-35a7e19e3ef9 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:07.291166 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5a86f-3e6b-479d-8820-35a7e19e3ef9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:07.292541 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5a86f-3e6b-479d-8820-35a7e19e3ef9 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:07.308108 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 493/987] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jun 21 05:42:07 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 05:42:07.325302 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:07.375808 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625b31e-4ca0-422c-b9cc-1581c62d9e9e None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:07.423919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff0489-095c-4e62-87d4-70524eb3d900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:07.424510 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff0489-095c-4e62-87d4-70524eb3d900 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:07.424792 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff0489-095c-4e62-87d4-70524eb3d900 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:07.425067 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff0489-095c-4e62-87d4-70524eb3d900 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:07.425889 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff0489-095c-4e62-87d4-70524eb3d900 None admin] RBAC: Adding query filter params (interface=admin, service_id=99267286ab664aaa847528f0734f0433, region_id=RegionOne) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:07.426234 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff0489-095c-4e62-87d4-70524eb3d900 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:07.427653 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff0489-095c-4e62-87d4-70524eb3d900 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:07.438456 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 495/988] 10.222.0.18 () {56 vars in 1249 bytes} [Tue Jun 21 05:42:07 2022] GET /identity/v3/endpoints?service_id=99267286ab664aaa847528f0734f0433&interface=admin®ion_id=RegionOne => generated 193 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:07.439633 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5a86f-3e6b-479d-8820-35a7e19e3ef9 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:07.532783 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:07.558363 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5a86f-3e6b-479d-8820-35a7e19e3ef9 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:07.594506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50d356-0596-4cd2-b508-c80dc5c20f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:07.595287 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50d356-0596-4cd2-b508-c80dc5c20f1c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:07.595639 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50d356-0596-4cd2-b508-c80dc5c20f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:07.595983 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50d356-0596-4cd2-b508-c80dc5c20f1c None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:07.596752 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50d356-0596-4cd2-b508-c80dc5c20f1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:07.598233 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50d356-0596-4cd2-b508-c80dc5c20f1c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:07.610015 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 494/989] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jun 21 05:42:07 2022] GET /identity/v3/services => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:42:08.392613 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a76b2-09f2-4770-8b61-3e5f4844bcb2 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:08.393107 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a76b2-09f2-4770-8b61-3e5f4844bcb2 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:08.393107 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a76b2-09f2-4770-8b61-3e5f4844bcb2 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:08.394660 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 496/990] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:08.399749 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd45d0-d015-4c49-b9b1-a5a5feab577c None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:08.400166 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd45d0-d015-4c49-b9b1-a5a5feab577c None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:08.400361 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd45d0-d015-4c49-b9b1-a5a5feab577c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:08.420881 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-52cd45d0-d015-4c49-b9b1-a5a5feab577c None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:08.422637 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-52cd45d0-d015-4c49-b9b1-a5a5feab577c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:08.510069 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 495/991] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:42:08.531206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a76b2-09f2-4770-8b61-3e5f4844bcb2 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:08.636997 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a76b2-09f2-4770-8b61-3e5f4844bcb2 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:08.656132 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:08.673476 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ecc60-170d-48d9-878e-0307950f090c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:08.674300 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ecc60-170d-48d9-878e-0307950f090c None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:08.674589 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ecc60-170d-48d9-878e-0307950f090c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:08.674868 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ecc60-170d-48d9-878e-0307950f090c None admin] PATH_INFO: `/v3/services/image` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:08.675526 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ecc60-170d-48d9-878e-0307950f090c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:08.676910 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ecc60-170d-48d9-878e-0307950f090c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:08.689136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-9a4ecc60-170d-48d9-878e-0307950f090c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 05:42:08.689136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:08.689136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 05:42:08.689136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 05:42:08.689136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 05:42:08.689136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 05:42:08.689136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 05:42:08.689136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:42:08.689136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 05:42:08.689136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:42:08.689136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:42:08.689136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:42:08.689136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:08.689136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:08.689136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:08.689136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:08.689136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:08.690531 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:08.690531 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:08.690531 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:08.690531 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:08.690531 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:08.690531 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:08.690531 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 05:42:08.690531 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 05:42:08.690531 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 05:42:08.690531 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 05:42:08.690531 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:08.690531 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:08.690531 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:08.690531 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:08.690531 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:08.690531 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:08.691395 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:08.691395 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:08.691395 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:08.691395 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:08.691395 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:08.691395 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:08.691395 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:08.691395 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:08.691395 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:08.691395 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:08.691395 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 05:42:08.691395 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:42:08.691395 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 05:42:08.691395 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:42:08.692638 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 497/992] 10.222.0.18 () {56 vars in 1105 bytes} [Tue Jun 21 05:42:08 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:42:08.696342 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd45d0-d015-4c49-b9b1-a5a5feab577c None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:08.771046 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:08.803266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd45d0-d015-4c49-b9b1-a5a5feab577c None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:08.837153 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948ebb6-208c-4a0c-a375-46f8ae85a496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:08.837821 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948ebb6-208c-4a0c-a375-46f8ae85a496 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:08.838137 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948ebb6-208c-4a0c-a375-46f8ae85a496 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:08.838417 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948ebb6-208c-4a0c-a375-46f8ae85a496 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:08.839223 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948ebb6-208c-4a0c-a375-46f8ae85a496 None admin] RBAC: Adding query filter params (name=image) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:08.839538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948ebb6-208c-4a0c-a375-46f8ae85a496 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:08.840897 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948ebb6-208c-4a0c-a375-46f8ae85a496 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:08.851579 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 496/993] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:42:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:08.852928 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ecc60-170d-48d9-878e-0307950f090c None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:08.963292 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ecc60-170d-48d9-878e-0307950f090c None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:08.996854 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8776f-ce23-4564-aecd-deeefccabe15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:08.998099 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8776f-ce23-4564-aecd-deeefccabe15 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:08.998384 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8776f-ce23-4564-aecd-deeefccabe15 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:08.998658 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8776f-ce23-4564-aecd-deeefccabe15 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:08.999363 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8776f-ce23-4564-aecd-deeefccabe15 None admin] RBAC: Adding query filter params (type=image) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:08.999694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8776f-ce23-4564-aecd-deeefccabe15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:09.001052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8776f-ce23-4564-aecd-deeefccabe15 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:09.014404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 498/994] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:42:08 2022] GET /identity/v3/services?type=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:09.396407 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b7805-13fc-4855-b7e8-901aafb13b8c None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:09.396795 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b7805-13fc-4855-b7e8-901aafb13b8c None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:09.397029 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b7805-13fc-4855-b7e8-901aafb13b8c None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:09.398495 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 497/995] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:09.404935 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efc3d2-0055-4f20-b74d-bcbe91a1c6b2 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:09.405431 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efc3d2-0055-4f20-b74d-bcbe91a1c6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:09.405537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efc3d2-0055-4f20-b74d-bcbe91a1c6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:09.422428 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-69efc3d2-0055-4f20-b74d-bcbe91a1c6b2 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:09.423613 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-69efc3d2-0055-4f20-b74d-bcbe91a1c6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:09.468540 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:09.494870 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 499/996] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 05:42:09.517744 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b7805-13fc-4855-b7e8-901aafb13b8c None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:09.624278 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b7805-13fc-4855-b7e8-901aafb13b8c None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:09.644020 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9346e-a780-4642-97f0-05db876f16b9 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:09.644348 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9346e-a780-4642-97f0-05db876f16b9 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:09.644583 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9346e-a780-4642-97f0-05db876f16b9 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:09.646123 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 500/997] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:09.651196 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5b462-2acb-4361-904f-4feaf93a1fb4 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:09.651416 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5b462-2acb-4361-904f-4feaf93a1fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:09.651679 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5b462-2acb-4361-904f-4feaf93a1fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:09.659741 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008fe6f-7386-4454-bbf2-b4107915a345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:09.660535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008fe6f-7386-4454-bbf2-b4107915a345 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:09.660817 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008fe6f-7386-4454-bbf2-b4107915a345 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:09.661091 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008fe6f-7386-4454-bbf2-b4107915a345 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:09.661749 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008fe6f-7386-4454-bbf2-b4107915a345 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:09.663138 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008fe6f-7386-4454-bbf2-b4107915a345 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:09.665192 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:09.670692 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-71c5b462-2acb-4361-904f-4feaf93a1fb4 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:09.671897 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-71c5b462-2acb-4361-904f-4feaf93a1fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:09.676829 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-d008fe6f-7386-4454-bbf2-b4107915a345 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 05:42:09.676829 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:09.676829 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 05:42:09.676829 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 05:42:09.676829 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 05:42:09.676829 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 05:42:09.676829 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 05:42:09.676829 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:42:09.676829 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 05:42:09.676829 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:09.676829 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:42:09.676829 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:09.676829 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:09.676829 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:09.676829 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:09.676829 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:09.676829 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:09.677827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:09.677827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:09.677827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:09.677827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:09.677827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:09.677827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:09.677827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 05:42:09.677827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 05:42:09.677827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 05:42:09.677827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 05:42:09.677827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:09.677827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:09.677827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:09.677827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:09.677827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:09.677827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:09.678722 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:09.678722 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:09.678722 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:09.678722 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:09.678722 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:09.678722 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:09.678722 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:09.678722 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:09.678722 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:09.678722 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:09.678722 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 05:42:09.678722 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:42:09.678722 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 05:42:09.678722 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:09.683118 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 498/998] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:42:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:42:09.683813 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008fe6f-7386-4454-bbf2-b4107915a345 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:09.758246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 501/999] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 05:42:09.769006 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5b462-2acb-4361-904f-4feaf93a1fb4 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:09.790098 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008fe6f-7386-4454-bbf2-b4107915a345 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:09.833190 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86506b-3b90-4e1d-8950-61291b88dead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:09.834234 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86506b-3b90-4e1d-8950-61291b88dead None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:09.834700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86506b-3b90-4e1d-8950-61291b88dead None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:09.835305 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86506b-3b90-4e1d-8950-61291b88dead None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:09.836696 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86506b-3b90-4e1d-8950-61291b88dead None admin] RBAC: Adding query filter params (name=compute) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:09.837544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86506b-3b90-4e1d-8950-61291b88dead None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:09.839311 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86506b-3b90-4e1d-8950-61291b88dead None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:09.846337 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 499/1000] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jun 21 05:42:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:09.852331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86506b-3b90-4e1d-8950-61291b88dead None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:09.870440 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5b462-2acb-4361-904f-4feaf93a1fb4 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:09.877776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:09.908767 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325f564-83f7-4e4e-9b4e-f4ebc2ae0c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:09.909504 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325f564-83f7-4e4e-9b4e-f4ebc2ae0c98 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:09.909795 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325f564-83f7-4e4e-9b4e-f4ebc2ae0c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:09.910102 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325f564-83f7-4e4e-9b4e-f4ebc2ae0c98 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:09.910790 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325f564-83f7-4e4e-9b4e-f4ebc2ae0c98 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:09.912235 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325f564-83f7-4e4e-9b4e-f4ebc2ae0c98 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:09.925751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-3325f564-83f7-4e4e-9b4e-f4ebc2ae0c98 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 05:42:09.925751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:09.925751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 05:42:09.925751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 05:42:09.925751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 05:42:09.925751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 05:42:09.925751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 05:42:09.925751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:42:09.925751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 05:42:09.925751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:42:09.925751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:42:09.925751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:42:09.925751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:09.925751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:09.925751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:09.925751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:09.925751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:09.926880 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:09.926880 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:09.926880 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:09.926880 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:09.926880 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:09.926880 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:09.926880 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 05:42:09.926880 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 05:42:09.926880 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 05:42:09.926880 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 05:42:09.926880 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:09.926880 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:09.926880 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:09.926880 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:09.926880 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:09.926880 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:09.927739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:09.927739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:09.927739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:09.927739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:09.927739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:09.927739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:09.927739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:09.927739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:09.927739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:09.927739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:09.927739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 05:42:09.927739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:42:09.927739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 05:42:09.927739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:42:09.927739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 502/1001] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jun 21 05:42:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:42:09.931075 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:09.933131 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325f564-83f7-4e4e-9b4e-f4ebc2ae0c98 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:09.977364 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86506b-3b90-4e1d-8950-61291b88dead None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:10.030208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46413b7-52df-4926-8b1a-6927b8bb66c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:10.030975 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46413b7-52df-4926-8b1a-6927b8bb66c2 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:10.031340 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46413b7-52df-4926-8b1a-6927b8bb66c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:10.031688 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46413b7-52df-4926-8b1a-6927b8bb66c2 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:10.032480 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46413b7-52df-4926-8b1a-6927b8bb66c2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:10.032851 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46413b7-52df-4926-8b1a-6927b8bb66c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:10.034304 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46413b7-52df-4926-8b1a-6927b8bb66c2 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:10.039818 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 500/1002] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jun 21 05:42:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:10.048789 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46413b7-52df-4926-8b1a-6927b8bb66c2 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:10.069606 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325f564-83f7-4e4e-9b4e-f4ebc2ae0c98 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:10.123771 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae86b1-da58-409b-8e63-e4b20cbe5424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:10.124463 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae86b1-da58-409b-8e63-e4b20cbe5424 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:10.124748 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae86b1-da58-409b-8e63-e4b20cbe5424 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:10.125069 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae86b1-da58-409b-8e63-e4b20cbe5424 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:10.125835 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae86b1-da58-409b-8e63-e4b20cbe5424 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:10.128627 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae86b1-da58-409b-8e63-e4b20cbe5424 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:10.128627 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae86b1-da58-409b-8e63-e4b20cbe5424 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:10.137755 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 503/1003] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jun 21 05:42:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:10.139483 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae86b1-da58-409b-8e63-e4b20cbe5424 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:10.181148 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46413b7-52df-4926-8b1a-6927b8bb66c2 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:10.182339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:10.220296 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:10.235752 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c93e7-a557-457f-991d-3db7340a3e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:10.236425 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c93e7-a557-457f-991d-3db7340a3e64 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:10.236708 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c93e7-a557-457f-991d-3db7340a3e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:10.236983 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c93e7-a557-457f-991d-3db7340a3e64 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:10.237788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c93e7-a557-457f-991d-3db7340a3e64 None admin] RBAC: Adding query filter params (interface=public, service_id=bc3652cf814b4b41b3ffbd0e9680acdd, region_id=RegionOne) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:10.238132 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c93e7-a557-457f-991d-3db7340a3e64 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:10.239524 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c93e7-a557-457f-991d-3db7340a3e64 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:10.245688 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 501/1004] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jun 21 05:42:10 2022] GET /identity/v3/endpoints?service_id=bc3652cf814b4b41b3ffbd0e9680acdd&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:10.251328 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c93e7-a557-457f-991d-3db7340a3e64 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:10.261634 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae86b1-da58-409b-8e63-e4b20cbe5424 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:10.299028 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783ad48-2aae-4f5e-87de-eadf12eb8783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:10.299714 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783ad48-2aae-4f5e-87de-eadf12eb8783 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:10.299977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783ad48-2aae-4f5e-87de-eadf12eb8783 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:10.300255 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783ad48-2aae-4f5e-87de-eadf12eb8783 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:10.300959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783ad48-2aae-4f5e-87de-eadf12eb8783 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:10.301263 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783ad48-2aae-4f5e-87de-eadf12eb8783 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:10.302692 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783ad48-2aae-4f5e-87de-eadf12eb8783 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:10.307679 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 504/1005] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jun 21 05:42:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:10.313294 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783ad48-2aae-4f5e-87de-eadf12eb8783 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:10.363632 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c93e7-a557-457f-991d-3db7340a3e64 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:10.397803 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce805bf-a4fa-43e0-830a-b4cb487e47fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:10.398493 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce805bf-a4fa-43e0-830a-b4cb487e47fa None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:10.398779 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce805bf-a4fa-43e0-830a-b4cb487e47fa None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:10.399057 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce805bf-a4fa-43e0-830a-b4cb487e47fa None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:10.399734 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce805bf-a4fa-43e0-830a-b4cb487e47fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:10.401086 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce805bf-a4fa-43e0-830a-b4cb487e47fa None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:10.407598 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 502/1006] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jun 21 05:42:10 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 05:42:10.428913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:10.434012 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783ad48-2aae-4f5e-87de-eadf12eb8783 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:10.479461 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37a270-1377-42b4-b4b8-da1e344900f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:10.480141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37a270-1377-42b4-b4b8-da1e344900f8 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:10.480689 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37a270-1377-42b4-b4b8-da1e344900f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:10.480962 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37a270-1377-42b4-b4b8-da1e344900f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:10.481792 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37a270-1377-42b4-b4b8-da1e344900f8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:10.483259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37a270-1377-42b4-b4b8-da1e344900f8 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:10.501585 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 505/1007] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jun 21 05:42:10 2022] POST /identity/v3/endpoints => generated 325 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 05:42:11.066388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dab62f-617c-4f84-97cc-b94745e04033 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:11.066921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dab62f-617c-4f84-97cc-b94745e04033 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:11.067002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dab62f-617c-4f84-97cc-b94745e04033 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:11.068493 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 503/1008] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:11.073902 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2301a9-154e-4646-b821-7d72e7c530ce None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:11.074253 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2301a9-154e-4646-b821-7d72e7c530ce None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:11.074467 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2301a9-154e-4646-b821-7d72e7c530ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:11.092268 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-db2301a9-154e-4646-b821-7d72e7c530ce None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:11.093499 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-db2301a9-154e-4646-b821-7d72e7c530ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:11.185957 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 506/1009] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:11 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:42:11.202413 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dab62f-617c-4f84-97cc-b94745e04033 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:11.268582 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:11.319088 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dab62f-617c-4f84-97cc-b94745e04033 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:11.357260 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b491a-ea33-459f-a300-e45572e46a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:11.357967 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b491a-ea33-459f-a300-e45572e46a98 None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:11.358255 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b491a-ea33-459f-a300-e45572e46a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:11.358541 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b491a-ea33-459f-a300-e45572e46a98 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:11.359275 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b491a-ea33-459f-a300-e45572e46a98 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:11.360667 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b491a-ea33-459f-a300-e45572e46a98 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:11.381971 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 504/1010] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jun 21 05:42:11 2022] POST /identity/v3/services => generated 242 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:42:12.586277 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600eecec-0f6b-4ec9-9b29-56948a35f60f None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:12.586772 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600eecec-0f6b-4ec9-9b29-56948a35f60f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:12.586772 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600eecec-0f6b-4ec9-9b29-56948a35f60f None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:12.588196 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 507/1011] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:12.593781 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec434a0-b95c-4899-ad58-240e4ba3725c None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:12.594204 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec434a0-b95c-4899-ad58-240e4ba3725c None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:12.594392 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec434a0-b95c-4899-ad58-240e4ba3725c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:12.606247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e425d-7ba0-41cf-a00d-81b730247a2a None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:12.607058 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e425d-7ba0-41cf-a00d-81b730247a2a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:12.607337 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e425d-7ba0-41cf-a00d-81b730247a2a None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:12.608684 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 508/1012] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 05:42:12.613096 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-4ec434a0-b95c-4899-ad58-240e4ba3725c None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:12.613552 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9df12-e189-465f-9869-fdf1a915c36b None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:12.613837 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9df12-e189-465f-9869-fdf1a915c36b None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:12.614140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9df12-e189-465f-9869-fdf1a915c36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:12.615191 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4ec434a0-b95c-4899-ad58-240e4ba3725c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:12.631076 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-30b9df12-e189-465f-9869-fdf1a915c36b None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:12.632260 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-30b9df12-e189-465f-9869-fdf1a915c36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:12.709973 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 505/1013] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:12 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:42:12.717970 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 509/1014] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:12 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 05:42:12.734989 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec434a0-b95c-4899-ad58-240e4ba3725c None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:12.736873 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9df12-e189-465f-9869-fdf1a915c36b None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:12.752111 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:12.781665 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:12.846848 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec434a0-b95c-4899-ad58-240e4ba3725c None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:12.856133 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9df12-e189-465f-9869-fdf1a915c36b None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:12.883763 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df904ad1-b2d7-4f36-a2da-061f4e653558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:12.884545 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df904ad1-b2d7-4f36-a2da-061f4e653558 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:12.884825 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df904ad1-b2d7-4f36-a2da-061f4e653558 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:12.885169 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df904ad1-b2d7-4f36-a2da-061f4e653558 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:12.885841 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df904ad1-b2d7-4f36-a2da-061f4e653558 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:12.887241 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df904ad1-b2d7-4f36-a2da-061f4e653558 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:12.902182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-df904ad1-b2d7-4f36-a2da-061f4e653558 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 05:42:12.902182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:12.902182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 05:42:12.902182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 05:42:12.902182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 05:42:12.902182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 05:42:12.902182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 05:42:12.902182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:42:12.902182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 05:42:12.902182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:12.902182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:42:12.902182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:12.902182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:12.902182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:12.902182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:12.902182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:12.902182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:12.910822 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:12.910822 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:12.910822 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:12.910822 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:12.910822 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:12.910822 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:12.910822 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 05:42:12.910822 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 05:42:12.910822 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 05:42:12.910822 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 05:42:12.910822 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:12.910822 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:12.910822 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:12.910822 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:12.910822 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:12.910822 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:12.912512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:12.912512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:12.912512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:12.912512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:12.912512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:12.912512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:12.912512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:12.912512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:12.912512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:12.912512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:12.912512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 05:42:12.912512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:42:12.912512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 05:42:12.912512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:12.914753 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8105bd2-5117-466a-b046-f28acf3d8d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:12.914753 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8105bd2-5117-466a-b046-f28acf3d8d3b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:12.916041 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 506/1015] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:42:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:42:12.916217 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8105bd2-5117-466a-b046-f28acf3d8d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:12.916217 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8105bd2-5117-466a-b046-f28acf3d8d3b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:12.916217 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8105bd2-5117-466a-b046-f28acf3d8d3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:12.916217 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8105bd2-5117-466a-b046-f28acf3d8d3b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:12.916217 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 510/1016] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:42:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:12.917155 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df904ad1-b2d7-4f36-a2da-061f4e653558 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:12.917368 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8105bd2-5117-466a-b046-f28acf3d8d3b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:12.998359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:13.021531 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df904ad1-b2d7-4f36-a2da-061f4e653558 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:13.022656 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8105bd2-5117-466a-b046-f28acf3d8d3b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:13.023959 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:13.059209 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0dc6b2-cfab-46f5-b133-62ead4626ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:13.059603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275f4c5-0927-427c-bdb2-052ae1d6862a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:13.059995 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dc6b2-cfab-46f5-b133-62ead4626ea0 None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:13.060269 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275f4c5-0927-427c-bdb2-052ae1d6862a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:13.060446 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dc6b2-cfab-46f5-b133-62ead4626ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:13.060543 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275f4c5-0927-427c-bdb2-052ae1d6862a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:13.060728 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dc6b2-cfab-46f5-b133-62ead4626ea0 None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:13.060835 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275f4c5-0927-427c-bdb2-052ae1d6862a None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:13.061427 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0dc6b2-cfab-46f5-b133-62ead4626ea0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:13.061606 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e275f4c5-0927-427c-bdb2-052ae1d6862a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:13.061813 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e275f4c5-0927-427c-bdb2-052ae1d6862a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:13.062876 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0dc6b2-cfab-46f5-b133-62ead4626ea0 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:13.063203 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e275f4c5-0927-427c-bdb2-052ae1d6862a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:13.068469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 511/1017] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jun 21 05:42:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:13.073806 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275f4c5-0927-427c-bdb2-052ae1d6862a None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:13.092218 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 507/1018] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jun 21 05:42:12 2022] POST /identity/v3/projects => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:42:13.207040 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275f4c5-0927-427c-bdb2-052ae1d6862a None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:13.244377 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bd406-4309-4105-a2bd-83c2591f2de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:13.245056 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bd406-4309-4105-a2bd-83c2591f2de1 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:13.245353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bd406-4309-4105-a2bd-83c2591f2de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:13.246405 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bd406-4309-4105-a2bd-83c2591f2de1 None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:13.246405 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bd406-4309-4105-a2bd-83c2591f2de1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:13.246692 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bd406-4309-4105-a2bd-83c2591f2de1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:13.248091 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bd406-4309-4105-a2bd-83c2591f2de1 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:13.253662 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 512/1019] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jun 21 05:42:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:13.259571 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0dc6b2-cfab-46f5-b133-62ead4626ea0 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:13.369401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0dc6b2-cfab-46f5-b133-62ead4626ea0 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:13.404062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bccdb-064e-4489-9eb7-2dbd2e261e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:13.404725 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bccdb-064e-4489-9eb7-2dbd2e261e28 None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:13.405009 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bccdb-064e-4489-9eb7-2dbd2e261e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:13.405287 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bccdb-064e-4489-9eb7-2dbd2e261e28 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:13.406055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0bccdb-064e-4489-9eb7-2dbd2e261e28 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:13.407421 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0bccdb-064e-4489-9eb7-2dbd2e261e28 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:13.429806 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 508/1020] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jun 21 05:42:13 2022] POST /identity/v3/endpoints => generated 334 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:42:13.430154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075ecaa-32f5-4ca1-b5d3-f8651197228a None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:13.430154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075ecaa-32f5-4ca1-b5d3-f8651197228a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:13.430154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075ecaa-32f5-4ca1-b5d3-f8651197228a None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:13.430154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 513/1021] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:13.435755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc44d33-8bc6-4e39-aa0a-1eb3d35a29f3 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:13.436044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc44d33-8bc6-4e39-aa0a-1eb3d35a29f3 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:13.436325 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc44d33-8bc6-4e39-aa0a-1eb3d35a29f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:13.455197 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-8cc44d33-8bc6-4e39-aa0a-1eb3d35a29f3 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:13.456695 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-8cc44d33-8bc6-4e39-aa0a-1eb3d35a29f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:13.467592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:13.557340 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 509/1022] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:42:13.582720 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075ecaa-32f5-4ca1-b5d3-f8651197228a None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:13.592701 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:13.701917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075ecaa-32f5-4ca1-b5d3-f8651197228a None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:13.740441 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c4ae1-f2de-4eeb-b99e-df1acdb914fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:13.741327 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c4ae1-f2de-4eeb-b99e-df1acdb914fb None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:13.741642 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c4ae1-f2de-4eeb-b99e-df1acdb914fb None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:13.741961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c4ae1-f2de-4eeb-b99e-df1acdb914fb None admin] PATH_INFO: `/v3/services/image` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:13.742699 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c4ae1-f2de-4eeb-b99e-df1acdb914fb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:13.744236 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c4ae1-f2de-4eeb-b99e-df1acdb914fb None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:13.756631 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-ae0c4ae1-f2de-4eeb-b99e-df1acdb914fb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 05:42:13.756631 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:13.756631 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 05:42:13.756631 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 05:42:13.756631 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 05:42:13.756631 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 05:42:13.756631 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 05:42:13.756631 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:42:13.756631 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 05:42:13.756631 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:42:13.756631 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:42:13.756631 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:42:13.756631 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:13.756631 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:13.756631 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:13.756631 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:13.756631 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:13.757655 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:13.757655 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:13.757655 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:13.757655 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:13.757655 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:13.757655 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:13.757655 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 05:42:13.757655 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 05:42:13.757655 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 05:42:13.757655 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 05:42:13.757655 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:13.757655 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:13.757655 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:13.757655 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:13.757655 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:13.757655 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:13.759051 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:13.759051 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:13.759051 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:13.759051 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:13.759051 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:13.759051 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:13.759051 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:13.759051 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:13.759051 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:13.759051 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:13.759051 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 05:42:13.759051 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:42:13.759051 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 05:42:13.759051 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:42:13.759051 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 514/1023] 10.222.0.18 () {56 vars in 1105 bytes} [Tue Jun 21 05:42:13 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:42:13.764228 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc44d33-8bc6-4e39-aa0a-1eb3d35a29f3 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:13.870403 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc44d33-8bc6-4e39-aa0a-1eb3d35a29f3 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:13.907354 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a7c33-b54e-4a85-a828-83c340d842d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:13.908032 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a7c33-b54e-4a85-a828-83c340d842d8 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:13.908318 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a7c33-b54e-4a85-a828-83c340d842d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:13.908601 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a7c33-b54e-4a85-a828-83c340d842d8 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:13.909317 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a7c33-b54e-4a85-a828-83c340d842d8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:13.909627 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a7c33-b54e-4a85-a828-83c340d842d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:13.911033 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a7c33-b54e-4a85-a828-83c340d842d8 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:13.916456 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 510/1024] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:42:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:13.922238 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c4ae1-f2de-4eeb-b99e-df1acdb914fb None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:14.001136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:14.038942 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c4ae1-f2de-4eeb-b99e-df1acdb914fb None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:14.077006 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5cc58-610f-48af-8c5f-31135170c04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:14.077772 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5cc58-610f-48af-8c5f-31135170c04d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:14.078154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5cc58-610f-48af-8c5f-31135170c04d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:14.078478 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5cc58-610f-48af-8c5f-31135170c04d None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:14.079295 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b5cc58-610f-48af-8c5f-31135170c04d None admin] RBAC: Adding query filter params (type=image) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:14.079658 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b5cc58-610f-48af-8c5f-31135170c04d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:14.081288 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b5cc58-610f-48af-8c5f-31135170c04d None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:14.092646 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 515/1025] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:42:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:14.093774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a7c33-b54e-4a85-a828-83c340d842d8 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:14.098086 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:14.199059 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a7c33-b54e-4a85-a828-83c340d842d8 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:14.236232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef87b4-42f3-4878-a834-fdd1b77e5979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:14.236895 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef87b4-42f3-4878-a834-fdd1b77e5979 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:14.237179 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef87b4-42f3-4878-a834-fdd1b77e5979 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:14.237457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef87b4-42f3-4878-a834-fdd1b77e5979 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:14.238275 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef87b4-42f3-4878-a834-fdd1b77e5979 None admin] RBAC: Adding query filter params (interface=public, service_id=d883a6b4614441b3bdc91477121c76f0, region_id=RegionOne) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:14.238587 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef87b4-42f3-4878-a834-fdd1b77e5979 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:14.239946 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef87b4-42f3-4878-a834-fdd1b77e5979 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:14.250412 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 511/1026] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jun 21 05:42:14 2022] GET /identity/v3/endpoints?service_id=d883a6b4614441b3bdc91477121c76f0&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:14.251657 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5cc58-610f-48af-8c5f-31135170c04d None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:14.353947 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5cc58-610f-48af-8c5f-31135170c04d None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:14.389683 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aaa5cc-b8c3-4859-af33-7f7dcd478fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:14.390369 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aaa5cc-b8c3-4859-af33-7f7dcd478fab None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:14.390667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aaa5cc-b8c3-4859-af33-7f7dcd478fab None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:14.390927 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aaa5cc-b8c3-4859-af33-7f7dcd478fab None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:14.391603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aaa5cc-b8c3-4859-af33-7f7dcd478fab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:14.392973 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aaa5cc-b8c3-4859-af33-7f7dcd478fab None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:14.394118 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:14.401274 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 516/1027] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jun 21 05:42:14 2022] GET /identity/v3/services => generated 1957 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:42:15.247700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef5ef6-c9a2-433c-8d12-d1fa6a5c890f None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:15.248210 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef5ef6-c9a2-433c-8d12-d1fa6a5c890f None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:15.248318 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef5ef6-c9a2-433c-8d12-d1fa6a5c890f None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:15.249723 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 512/1028] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:15.255353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd727557-1b98-4f65-a3dd-12a02d230ba3 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:15.255769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd727557-1b98-4f65-a3dd-12a02d230ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:15.255962 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd727557-1b98-4f65-a3dd-12a02d230ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:15.274118 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-bd727557-1b98-4f65-a3dd-12a02d230ba3 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:15.275428 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-bd727557-1b98-4f65-a3dd-12a02d230ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:15.350023 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 517/1029] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:42:15.371615 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef5ef6-c9a2-433c-8d12-d1fa6a5c890f None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:15.444804 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:15.484453 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef5ef6-c9a2-433c-8d12-d1fa6a5c890f None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:15.522412 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da27263-2414-48d2-b058-41d95fc5e754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:15.523212 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da27263-2414-48d2-b058-41d95fc5e754 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:15.523497 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da27263-2414-48d2-b058-41d95fc5e754 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:15.523774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da27263-2414-48d2-b058-41d95fc5e754 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:15.524944 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da27263-2414-48d2-b058-41d95fc5e754 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:15.526417 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da27263-2414-48d2-b058-41d95fc5e754 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:15.528816 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 513/1030] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:42:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:15.534631 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd727557-1b98-4f65-a3dd-12a02d230ba3 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:15.594941 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b929c-ffd6-40cc-b59a-1b0f77a7dfe3 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:15.595235 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b929c-ffd6-40cc-b59a-1b0f77a7dfe3 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:15.595510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b929c-ffd6-40cc-b59a-1b0f77a7dfe3 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:15.596915 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 514/1031] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 05:42:15.602113 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786c10c-7839-4dd4-90e4-ac0fdd6f2474 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:15.602397 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786c10c-7839-4dd4-90e4-ac0fdd6f2474 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:15.602672 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786c10c-7839-4dd4-90e4-ac0fdd6f2474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:15.620781 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-d786c10c-7839-4dd4-90e4-ac0fdd6f2474 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:15.622543 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d786c10c-7839-4dd4-90e4-ac0fdd6f2474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:15.644587 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd727557-1b98-4f65-a3dd-12a02d230ba3 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:15.675143 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:15.682802 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78938f-150b-4279-a359-2217672eb6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:15.683513 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78938f-150b-4279-a359-2217672eb6e8 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:15.683814 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78938f-150b-4279-a359-2217672eb6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:15.684110 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78938f-150b-4279-a359-2217672eb6e8 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:15.685460 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78938f-150b-4279-a359-2217672eb6e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:15.686999 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78938f-150b-4279-a359-2217672eb6e8 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:15.713963 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 515/1032] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:42:15.714205 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 518/1033] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 21 05:42:15 2022] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:42:15.730047 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786c10c-7839-4dd4-90e4-ac0fdd6f2474 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:15.804353 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:15.849351 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786c10c-7839-4dd4-90e4-ac0fdd6f2474 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:15.887238 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f3545-4d68-4b5e-ba66-855f5aca390d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:15.888862 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f3545-4d68-4b5e-ba66-855f5aca390d None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:15.889139 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f3545-4d68-4b5e-ba66-855f5aca390d None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:15.889413 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f3545-4d68-4b5e-ba66-855f5aca390d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:15.900658 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f3545-4d68-4b5e-ba66-855f5aca390d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:42:15.909626 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-388f3545-4d68-4b5e-ba66-855f5aca390d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 05:42:15.909626 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:15.909626 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:15.909626 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:15.909626 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:15.909626 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:15.909626 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:15.909626 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:15.909626 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:15.909626 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:15.909626 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:15.909626 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:15.909626 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:42:15.909626 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:42:15.909626 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:42:15.909626 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:42:15.910774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:42:15.910774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:42:15.910774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:42:15.910774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:42:15.910774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:15.910774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:15.910774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:15.910774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:15.910774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:15.910774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:15.910774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:15.910774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:15.910774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:15.910774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:15.910774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:15.910774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:15.911805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:15.911805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:15.911805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:15.911805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:15.911805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:42:15.911805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:42:15.911805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:42:15.911805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:42:15.911805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:42:15.911805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:42:15.911805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 05:42:15.911805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:15.911805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 516/1034] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Jun 21 05:42:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:42:15.919448 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78938f-150b-4279-a359-2217672eb6e8 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:16.030021 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78938f-150b-4279-a359-2217672eb6e8 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:16.065483 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65142b-312d-470d-86d7-81776a478af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:16.066181 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65142b-312d-470d-86d7-81776a478af2 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:16.066475 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65142b-312d-470d-86d7-81776a478af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:16.066747 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65142b-312d-470d-86d7-81776a478af2 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:16.067559 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65142b-312d-470d-86d7-81776a478af2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:16.067867 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65142b-312d-470d-86d7-81776a478af2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:16.069223 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65142b-312d-470d-86d7-81776a478af2 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:16.077870 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 519/1035] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Jun 21 05:42:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:16.083305 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f3545-4d68-4b5e-ba66-855f5aca390d None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:16.194434 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f3545-4d68-4b5e-ba66-855f5aca390d None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:16.217740 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:16.229606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14382d-fa86-472c-8ca5-5b1f5be93940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:16.230702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14382d-fa86-472c-8ca5-5b1f5be93940 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:16.230994 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14382d-fa86-472c-8ca5-5b1f5be93940 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:16.231803 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14382d-fa86-472c-8ca5-5b1f5be93940 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:16.242697 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14382d-fa86-472c-8ca5-5b1f5be93940 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:16.245573 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14382d-fa86-472c-8ca5-5b1f5be93940 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:16.262182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-fe14382d-fa86-472c-8ca5-5b1f5be93940 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:42:16.262182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:16.262182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:16.262182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:16.262182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:16.262182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:16.262182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:16.262182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:16.262182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:16.262182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:16.262182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:16.262182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:16.262182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:42:16.262182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:42:16.262182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:42:16.263596 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:42:16.263596 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:16.263596 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:16.263596 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:16.263596 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:16.263596 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:16.263596 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:16.263596 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:16.263596 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:16.263596 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:16.263596 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:16.263596 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:16.263596 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:16.263596 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:16.263596 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:16.263596 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:16.263596 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:16.264510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:42:16.264510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:42:16.264510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:42:16.264510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:16.264510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 517/1036] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:42:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:42:16.270673 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65142b-312d-470d-86d7-81776a478af2 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:16.321380 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:16.379380 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65142b-312d-470d-86d7-81776a478af2 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:16.416265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee7fd0-bccb-4f43-ba97-a6a415440858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:16.416925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee7fd0-bccb-4f43-ba97-a6a415440858 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:16.417264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee7fd0-bccb-4f43-ba97-a6a415440858 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:16.417543 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee7fd0-bccb-4f43-ba97-a6a415440858 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:16.418348 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee7fd0-bccb-4f43-ba97-a6a415440858 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:16.418658 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee7fd0-bccb-4f43-ba97-a6a415440858 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:16.420632 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee7fd0-bccb-4f43-ba97-a6a415440858 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:16.432942 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 520/1037] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:16.438404 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14382d-fa86-472c-8ca5-5b1f5be93940 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:16.440196 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8eee2d-6bb8-4477-aeb0-3a2655e2db23 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:16.440480 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8eee2d-6bb8-4477-aeb0-3a2655e2db23 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:16.440859 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8eee2d-6bb8-4477-aeb0-3a2655e2db23 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:16.442659 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 521/1038] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:16.447514 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db14acc-c51e-425e-90e5-f72c04945ae0 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:16.447735 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db14acc-c51e-425e-90e5-f72c04945ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:16.448009 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db14acc-c51e-425e-90e5-f72c04945ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:16.466541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-5db14acc-c51e-425e-90e5-f72c04945ae0 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:16.467721 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5db14acc-c51e-425e-90e5-f72c04945ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:16.557025 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 522/1039] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 05:42:16.559909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14382d-fa86-472c-8ca5-5b1f5be93940 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:16.579973 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db14acc-c51e-425e-90e5-f72c04945ae0 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:16.595960 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044f824-3018-4194-be17-4de7b5bd0767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:16.597126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044f824-3018-4194-be17-4de7b5bd0767 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:16.597683 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044f824-3018-4194-be17-4de7b5bd0767 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:16.598003 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044f824-3018-4194-be17-4de7b5bd0767 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:16.609035 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044f824-3018-4194-be17-4de7b5bd0767 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:16.610520 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044f824-3018-4194-be17-4de7b5bd0767 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:16.619062 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:16.624336 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-4044f824-3018-4194-be17-4de7b5bd0767 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 05:42:16.624336 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:16.624336 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:16.624336 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:16.624336 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:16.624336 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:16.624336 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:16.624336 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:16.624336 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:16.624336 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:16.624336 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:16.624336 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:16.624336 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:42:16.624336 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:42:16.624336 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:42:16.624336 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:42:16.625481 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:16.625481 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:16.625481 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:42:16.625481 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:42:16.625481 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:42:16.625481 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:42:16.625481 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:16.625481 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:16.625481 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:16.625481 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:16.625481 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:16.625481 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:16.625481 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:16.625481 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:16.625481 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:16.625481 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:16.625481 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:16.625481 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:16.626488 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:16.626488 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:16.626488 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:42:16.626488 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:42:16.626488 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:42:16.626488 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:42:16.626488 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:42:16.626488 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:42:16.626488 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 05:42:16.626488 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:16.626488 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 518/1040] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jun 21 05:42:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:42:16.631079 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044f824-3018-4194-be17-4de7b5bd0767 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:16.668541 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:16.691740 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db14acc-c51e-425e-90e5-f72c04945ae0 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:16.736319 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae3c41-d283-4811-a3a6-885db0cf1500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:16.737464 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae3c41-d283-4811-a3a6-885db0cf1500 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:16.737880 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae3c41-d283-4811-a3a6-885db0cf1500 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:16.738183 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae3c41-d283-4811-a3a6-885db0cf1500 None admin] PATH_INFO: `/v3/services/image` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:16.738847 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae3c41-d283-4811-a3a6-885db0cf1500 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:16.739425 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044f824-3018-4194-be17-4de7b5bd0767 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:16.740295 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae3c41-d283-4811-a3a6-885db0cf1500 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:16.755669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-04ae3c41-d283-4811-a3a6-885db0cf1500 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 05:42:16.755669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:16.755669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 05:42:16.755669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 05:42:16.755669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 05:42:16.755669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 05:42:16.755669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 05:42:16.755669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:42:16.755669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 05:42:16.755669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:42:16.755669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:42:16.755669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:42:16.755669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:16.755669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:16.755669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:16.755669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:16.755669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:16.756688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:16.756688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:16.756688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:16.756688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:16.756688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:16.756688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:16.756688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 05:42:16.756688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 05:42:16.756688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 05:42:16.756688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 05:42:16.756688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:16.756688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:16.756688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:16.756688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:16.756688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:16.756688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:16.758753 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:16.758753 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:16.758753 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:16.758753 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:16.758753 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:16.758753 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:16.758753 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:16.758753 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:16.758753 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:16.758753 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:16.758753 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 05:42:16.758753 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:42:16.758753 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 05:42:16.758753 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:42:16.758753 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 523/1041] 10.222.0.18 () {56 vars in 1105 bytes} [Tue Jun 21 05:42:16 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:42:16.763438 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae3c41-d283-4811-a3a6-885db0cf1500 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:16.774585 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d814c-a7bf-43f4-b727-8a8634c077c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:16.775237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d814c-a7bf-43f4-b727-8a8634c077c5 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:16.775522 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d814c-a7bf-43f4-b727-8a8634c077c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:16.775798 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d814c-a7bf-43f4-b727-8a8634c077c5 None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:16.776697 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d814c-a7bf-43f4-b727-8a8634c077c5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:16.777026 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d814c-a7bf-43f4-b727-8a8634c077c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:16.779037 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d814c-a7bf-43f4-b727-8a8634c077c5 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:16.796851 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 519/1042] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jun 21 05:42:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:16.802334 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d814c-a7bf-43f4-b727-8a8634c077c5 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:16.891207 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:16.894475 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae3c41-d283-4811-a3a6-885db0cf1500 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:16.896717 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:16.906676 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d814c-a7bf-43f4-b727-8a8634c077c5 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:16.932918 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dec77-2f75-4777-ae61-495c6a0bca6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:16.933606 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dec77-2f75-4777-ae61-495c6a0bca6f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:16.933892 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dec77-2f75-4777-ae61-495c6a0bca6f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:16.934203 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dec77-2f75-4777-ae61-495c6a0bca6f None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:16.934957 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dec77-2f75-4777-ae61-495c6a0bca6f None admin] RBAC: Adding query filter params (name=image) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:16.935263 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dec77-2f75-4777-ae61-495c6a0bca6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:16.936662 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dec77-2f75-4777-ae61-495c6a0bca6f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:16.942322 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 524/1043] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:42:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:16.948096 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b3a2f-bc87-435b-b853-b0a940792c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:16.949046 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b3a2f-bc87-435b-b853-b0a940792c57 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:16.949527 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dec77-2f75-4777-ae61-495c6a0bca6f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:16.949724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b3a2f-bc87-435b-b853-b0a940792c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:16.950805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b3a2f-bc87-435b-b853-b0a940792c57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:17.023248 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b3a2f-bc87-435b-b853-b0a940792c57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:17.024743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b3a2f-bc87-435b-b853-b0a940792c57 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:17.064710 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dec77-2f75-4777-ae61-495c6a0bca6f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:17.105909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a85ec-3bc7-4749-aa39-42a8f81830ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:17.106628 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a85ec-3bc7-4749-aa39-42a8f81830ed None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:17.106915 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a85ec-3bc7-4749-aa39-42a8f81830ed None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:17.107196 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a85ec-3bc7-4749-aa39-42a8f81830ed None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:17.110311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a85ec-3bc7-4749-aa39-42a8f81830ed None admin] RBAC: Adding query filter params (type=image) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:17.110311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a85ec-3bc7-4749-aa39-42a8f81830ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:17.110311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a85ec-3bc7-4749-aa39-42a8f81830ed None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:17.117503 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 525/1044] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:42:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:17.123625 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a85ec-3bc7-4749-aa39-42a8f81830ed None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:17.129577 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:17.138927 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 520/1045] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:42:16 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 05:42:17.144367 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b3a2f-bc87-435b-b853-b0a940792c57 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:17.153408 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:17.236064 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a85ec-3bc7-4749-aa39-42a8f81830ed None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:17.257304 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b3a2f-bc87-435b-b853-b0a940792c57 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:17.277681 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21975d57-73c0-45c9-bc3b-b15680f789b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:17.278428 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21975d57-73c0-45c9-bc3b-b15680f789b1 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:17.278742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21975d57-73c0-45c9-bc3b-b15680f789b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:17.279064 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21975d57-73c0-45c9-bc3b-b15680f789b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:17.279876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21975d57-73c0-45c9-bc3b-b15680f789b1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:17.281349 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21975d57-73c0-45c9-bc3b-b15680f789b1 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:17.298400 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb9dc0-f9a3-48cd-93d8-ee96bc0826c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:17.299329 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb9dc0-f9a3-48cd-93d8-ee96bc0826c6 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:17.299666 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb9dc0-f9a3-48cd-93d8-ee96bc0826c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:17.299997 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb9dc0-f9a3-48cd-93d8-ee96bc0826c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:17.313968 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 526/1046] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jun 21 05:42:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:42:17.324657 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb9dc0-f9a3-48cd-93d8-ee96bc0826c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:17.327136 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb9dc0-f9a3-48cd-93d8-ee96bc0826c6 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:17.350166 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-15fb9dc0-f9a3-48cd-93d8-ee96bc0826c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:42:17.350166 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:17.350166 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:17.350166 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:17.350166 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:17.350166 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:17.350166 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:17.350166 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:17.350166 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:17.350166 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:17.350166 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:17.350166 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:17.350166 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:42:17.350166 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:42:17.350166 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:42:17.351302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:42:17.351302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:17.351302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:17.351302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:17.351302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:17.351302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:17.351302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:17.351302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:17.351302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:17.351302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:17.351302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:17.351302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:17.351302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:17.351302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:17.351302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:17.351302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:17.351302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:17.358268 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:42:17.358268 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:42:17.358268 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:42:17.358268 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:17.358268 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 521/1047] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:42:17.359178 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21975d57-73c0-45c9-bc3b-b15680f789b1 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:17.463319 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:17.490816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21975d57-73c0-45c9-bc3b-b15680f789b1 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:17.533550 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae45f9-1289-4497-ab76-5f9c3118b392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:17.534303 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae45f9-1289-4497-ab76-5f9c3118b392 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:17.534638 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae45f9-1289-4497-ab76-5f9c3118b392 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:17.534971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae45f9-1289-4497-ab76-5f9c3118b392 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:17.535771 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae45f9-1289-4497-ab76-5f9c3118b392 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:17.536133 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae45f9-1289-4497-ab76-5f9c3118b392 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:17.537984 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae45f9-1289-4497-ab76-5f9c3118b392 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:17.552677 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 527/1048] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:17.558784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb9dc0-f9a3-48cd-93d8-ee96bc0826c6 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:17.622697 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:17.678819 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb9dc0-f9a3-48cd-93d8-ee96bc0826c6 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:17.713576 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2066eab-18a4-4cdd-b2a5-5ec1fe07bff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:17.714418 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2066eab-18a4-4cdd-b2a5-5ec1fe07bff1 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:17.714701 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2066eab-18a4-4cdd-b2a5-5ec1fe07bff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:17.714980 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2066eab-18a4-4cdd-b2a5-5ec1fe07bff1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:17.722651 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2066eab-18a4-4cdd-b2a5-5ec1fe07bff1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:17.724082 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2066eab-18a4-4cdd-b2a5-5ec1fe07bff1 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:17.737994 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-c2066eab-18a4-4cdd-b2a5-5ec1fe07bff1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:42:17.737994 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:17.737994 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:17.737994 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:17.737994 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:17.737994 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:17.737994 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:17.737994 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:17.737994 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:17.737994 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:17.737994 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:17.737994 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:17.737994 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:42:17.737994 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:42:17.737994 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:42:17.739122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:42:17.739122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:17.739122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:17.739122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:17.739122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:17.739122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:17.739122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:17.739122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:17.739122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:17.739122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:17.739122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:17.739122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:17.739122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:17.739122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:17.739122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:17.739122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:17.739122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:17.740318 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:42:17.740318 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:42:17.740318 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:42:17.740318 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:42:17.740318 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:42:17.740318 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:42:17.740318 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:42:17.740318 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:17.742008 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 522/1049] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:42:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:42:17.744969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae45f9-1289-4497-ab76-5f9c3118b392 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:17.851009 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae45f9-1289-4497-ab76-5f9c3118b392 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:17.870605 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c288c-dd65-4b06-8b3d-f5e248a0a620 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:17.870899 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c288c-dd65-4b06-8b3d-f5e248a0a620 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:17.871184 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c288c-dd65-4b06-8b3d-f5e248a0a620 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:17.873093 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 523/1050] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:17.878008 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4425c5-6aa4-4dc9-a657-2c69b49fea4a None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:17.878311 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4425c5-6aa4-4dc9-a657-2c69b49fea4a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:17.878587 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4425c5-6aa4-4dc9-a657-2c69b49fea4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:17.889299 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ecd13e-24c4-4647-8b2b-0edb5435d3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:17.890202 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ecd13e-24c4-4647-8b2b-0edb5435d3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:17.890484 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ecd13e-24c4-4647-8b2b-0edb5435d3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:17.890768 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ecd13e-24c4-4647-8b2b-0edb5435d3d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:17.891624 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ecd13e-24c4-4647-8b2b-0edb5435d3d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:17.891937 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ecd13e-24c4-4647-8b2b-0edb5435d3d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:17.893492 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ecd13e-24c4-4647-8b2b-0edb5435d3d8 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:17.897213 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-ab4425c5-6aa4-4dc9-a657-2c69b49fea4a None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:17.898449 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ab4425c5-6aa4-4dc9-a657-2c69b49fea4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:17.905555 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:17.911087 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 528/1051] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:42:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:17.916751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ecd13e-24c4-4647-8b2b-0edb5435d3d8 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:17.980852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 524/1052] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 05:42:18.005161 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4425c5-6aa4-4dc9-a657-2c69b49fea4a None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:18.038133 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ecd13e-24c4-4647-8b2b-0edb5435d3d8 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:18.042964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:18.072934 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde2838-45e6-4982-ba07-cf60cee39ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:18.073592 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde2838-45e6-4982-ba07-cf60cee39ece None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:18.073876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde2838-45e6-4982-ba07-cf60cee39ece None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:18.074182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde2838-45e6-4982-ba07-cf60cee39ece None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:18.075652 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde2838-45e6-4982-ba07-cf60cee39ece None admin] RBAC: Adding query filter params (role.id=31cd2c6d233240a4b889e206872556b0, scope.project.id=e64b932ef6bf481cb93a04885a93b4b2, user.id=f702830987ba4548a4c2ee3d0e302d02) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:18.075894 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde2838-45e6-4982-ba07-cf60cee39ece None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:18.077420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde2838-45e6-4982-ba07-cf60cee39ece None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:18.093987 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 529/1053] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:42:17 2022] GET /identity/v3/role_assignments?user.id=f702830987ba4548a4c2ee3d0e302d02&scope.project.id=e64b932ef6bf481cb93a04885a93b4b2&role.id=31cd2c6d233240a4b889e206872556b0 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:18.128496 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4425c5-6aa4-4dc9-a657-2c69b49fea4a None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:18.169590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b9db6-7b84-4dd4-87ea-ec31acf86af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:18.170439 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b9db6-7b84-4dd4-87ea-ec31acf86af5 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:18.170726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b9db6-7b84-4dd4-87ea-ec31acf86af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:18.171005 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b9db6-7b84-4dd4-87ea-ec31acf86af5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:18.183098 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1b9db6-7b84-4dd4-87ea-ec31acf86af5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:42:18.191493 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-2d1b9db6-7b84-4dd4-87ea-ec31acf86af5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:42:18.191493 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:18.191493 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:18.191493 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:18.191493 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:18.191493 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:18.191493 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:18.191493 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:18.191493 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:18.191493 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:18.191493 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:18.191493 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:18.191493 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:42:18.191493 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:42:18.191493 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:42:18.191493 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:42:18.192508 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:42:18.192508 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:42:18.192508 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:42:18.192508 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:42:18.192508 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:18.192508 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:18.192508 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:18.192508 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:18.192508 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:18.192508 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:18.192508 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:18.192508 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:18.192508 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:18.192508 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:18.192508 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:18.192508 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:18.193398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:18.193398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:18.193398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:18.193398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:18.193398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:42:18.193398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:42:18.193398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:42:18.193398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:42:18.193398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:42:18.193398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:42:18.193398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:42:18.193398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:18.197978 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 525/1054] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:42:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:42:18.199206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde2838-45e6-4982-ba07-cf60cee39ece None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:18.275237 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:18.315033 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde2838-45e6-4982-ba07-cf60cee39ece None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:18.349978 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e26350-74b0-4eda-b1d2-bfc903db564e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:18.350647 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e26350-74b0-4eda-b1d2-bfc903db564e None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:18.350928 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e26350-74b0-4eda-b1d2-bfc903db564e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:18.351203 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e26350-74b0-4eda-b1d2-bfc903db564e None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:18.351950 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e26350-74b0-4eda-b1d2-bfc903db564e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:18.352256 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e26350-74b0-4eda-b1d2-bfc903db564e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:18.353628 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e26350-74b0-4eda-b1d2-bfc903db564e None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:18.367839 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 530/1055] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:42:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:18.369244 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b9db6-7b84-4dd4-87ea-ec31acf86af5 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:18.465624 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:18.472896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b9db6-7b84-4dd4-87ea-ec31acf86af5 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:18.509825 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c413b8-1cad-4f6d-8e95-163432e426b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:18.510732 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c413b8-1cad-4f6d-8e95-163432e426b0 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:18.511037 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c413b8-1cad-4f6d-8e95-163432e426b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:18.511320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c413b8-1cad-4f6d-8e95-163432e426b0 None admin] PATH_INFO: `/v3/users/558748204844460a810730eb7c90e9aa` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:18.525649 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c413b8-1cad-4f6d-8e95-163432e426b0 None admin] RBAC: Authorizing `identity:get_user(user_id=558748204844460a810730eb7c90e9aa)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:18.527123 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c413b8-1cad-4f6d-8e95-163432e426b0 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:18.529967 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 526/1056] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:42:18 2022] GET /identity/v3/users/558748204844460a810730eb7c90e9aa => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:18.535494 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e26350-74b0-4eda-b1d2-bfc903db564e None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:18.651715 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e26350-74b0-4eda-b1d2-bfc903db564e None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:18.678523 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:18.688508 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3b178-8564-4e14-b4e7-1e503e4c607b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:18.689219 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3b178-8564-4e14-b4e7-1e503e4c607b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:18.689504 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3b178-8564-4e14-b4e7-1e503e4c607b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:18.689776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3b178-8564-4e14-b4e7-1e503e4c607b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:18.762555 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3b178-8564-4e14-b4e7-1e503e4c607b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:18.763998 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3b178-8564-4e14-b4e7-1e503e4c607b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:18.877811 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 531/1057] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:42:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 05:42:18.880138 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c413b8-1cad-4f6d-8e95-163432e426b0 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:18.986179 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c413b8-1cad-4f6d-8e95-163432e426b0 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:19.022151 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80913cf-0d90-4c02-8398-2c21a02bb8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:19.022945 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80913cf-0d90-4c02-8398-2c21a02bb8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:19.023229 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80913cf-0d90-4c02-8398-2c21a02bb8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:19.023507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80913cf-0d90-4c02-8398-2c21a02bb8d8 None admin] PATH_INFO: `/v3/projects/a93c9e8e5d574c85a8f6a26127950d15` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:19.024720 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80913cf-0d90-4c02-8398-2c21a02bb8d8 None admin] RBAC: Authorizing `identity:get_project(project_id=a93c9e8e5d574c85a8f6a26127950d15)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:19.026168 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80913cf-0d90-4c02-8398-2c21a02bb8d8 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:19.033711 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 527/1058] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:42:18 2022] GET /identity/v3/projects/a93c9e8e5d574c85a8f6a26127950d15 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:19.034814 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3b178-8564-4e14-b4e7-1e503e4c607b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:19.063668 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:19.145529 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3b178-8564-4e14-b4e7-1e503e4c607b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:19.186508 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc7a2a-7e26-473c-9fbe-21764fbff0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:19.187176 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc7a2a-7e26-473c-9fbe-21764fbff0aa None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:19.187461 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc7a2a-7e26-473c-9fbe-21764fbff0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:19.187740 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc7a2a-7e26-473c-9fbe-21764fbff0aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:19.188576 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc7a2a-7e26-473c-9fbe-21764fbff0aa None admin] RBAC: Adding query filter params (role.id=24aa6040c86049f996560e477e83886f, scope.project.id=a93c9e8e5d574c85a8f6a26127950d15, user.id=558748204844460a810730eb7c90e9aa) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:19.188893 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc7a2a-7e26-473c-9fbe-21764fbff0aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:19.190378 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc7a2a-7e26-473c-9fbe-21764fbff0aa None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:19.201986 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 532/1059] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:42:19 2022] GET /identity/v3/role_assignments?user.id=558748204844460a810730eb7c90e9aa&scope.project.id=a93c9e8e5d574c85a8f6a26127950d15&role.id=24aa6040c86049f996560e477e83886f => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:19.449587 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcc1fa-fe4e-461a-8d7e-f8200aaeb661 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:19.450160 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcc1fa-fe4e-461a-8d7e-f8200aaeb661 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:19.450252 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcc1fa-fe4e-461a-8d7e-f8200aaeb661 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:19.452230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 528/1060] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:19.457432 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d946ce-b451-4689-b3b6-d362dd5db662 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:19.457820 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d946ce-b451-4689-b3b6-d362dd5db662 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:19.458046 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d946ce-b451-4689-b3b6-d362dd5db662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:19.474429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-e1d946ce-b451-4689-b3b6-d362dd5db662 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:19.475609 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e1d946ce-b451-4689-b3b6-d362dd5db662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:19.545906 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 533/1061] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:42:19.568379 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bcc1fa-fe4e-461a-8d7e-f8200aaeb661 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:19.593598 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:19.675799 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bcc1fa-fe4e-461a-8d7e-f8200aaeb661 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:19.712826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34121bb2-8c51-4f86-aacf-0b5b7c4752c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:19.713415 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34121bb2-8c51-4f86-aacf-0b5b7c4752c0 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:19.713717 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34121bb2-8c51-4f86-aacf-0b5b7c4752c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:19.714029 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34121bb2-8c51-4f86-aacf-0b5b7c4752c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:19.783385 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34121bb2-8c51-4f86-aacf-0b5b7c4752c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:19.784811 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34121bb2-8c51-4f86-aacf-0b5b7c4752c0 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:19.810623 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:19.898679 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 529/1062] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:42:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 05:42:19.900035 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d946ce-b451-4689-b3b6-d362dd5db662 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:19.921442 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:19.999693 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d946ce-b451-4689-b3b6-d362dd5db662 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:20.036530 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62bc26b-75e1-49bf-ae8f-e3eaee7c9156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:20.037333 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bc26b-75e1-49bf-ae8f-e3eaee7c9156 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:20.037626 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bc26b-75e1-49bf-ae8f-e3eaee7c9156 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:20.037906 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bc26b-75e1-49bf-ae8f-e3eaee7c9156 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:20.049106 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62bc26b-75e1-49bf-ae8f-e3eaee7c9156 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:20.050606 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62bc26b-75e1-49bf-ae8f-e3eaee7c9156 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:20.068591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-e62bc26b-75e1-49bf-ae8f-e3eaee7c9156 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:42:20.068591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:20.068591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:20.068591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:20.068591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:20.068591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:20.068591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:20.068591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:20.068591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:20.068591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:20.068591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:20.068591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:20.068591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:42:20.068591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:42:20.068591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:42:20.069618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:42:20.069618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:20.069618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:20.069618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:20.069618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:20.069618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:20.069618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:20.069618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:20.069618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:20.069618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:20.069618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:20.069618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:20.069618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:20.069618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:20.069618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:20.069618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:20.069618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:20.075443 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:42:20.075443 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:42:20.075443 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:42:20.075443 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:42:20.075443 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 534/1063] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:42:20.080375 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34121bb2-8c51-4f86-aacf-0b5b7c4752c0 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:20.179057 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45204f9a-d5a2-4b39-826c-e43d23a2b1f3 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:20.179407 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45204f9a-d5a2-4b39-826c-e43d23a2b1f3 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:20.179660 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45204f9a-d5a2-4b39-826c-e43d23a2b1f3 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:20.181193 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 535/1064] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:20.187499 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1c2ee-4875-4c25-a58b-68184b9b9ae5 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:20.187845 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1c2ee-4875-4c25-a58b-68184b9b9ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:20.188096 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1c2ee-4875-4c25-a58b-68184b9b9ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:20.193243 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34121bb2-8c51-4f86-aacf-0b5b7c4752c0 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:20.207894 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-27c1c2ee-4875-4c25-a58b-68184b9b9ae5 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:20.209208 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-27c1c2ee-4875-4c25-a58b-68184b9b9ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:20.221584 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:20.235441 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a9b2e-d968-4b13-8e7a-319eb522a0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:20.236115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a9b2e-d968-4b13-8e7a-319eb522a0e4 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:20.236400 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a9b2e-d968-4b13-8e7a-319eb522a0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:20.236680 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a9b2e-d968-4b13-8e7a-319eb522a0e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:20.237406 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a9b2e-d968-4b13-8e7a-319eb522a0e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:20.238440 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a9b2e-d968-4b13-8e7a-319eb522a0e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:20.239109 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a9b2e-d968-4b13-8e7a-319eb522a0e4 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:20.251548 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 530/1065] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:20.300786 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 536/1066] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 05:42:20.324349 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a9b2e-d968-4b13-8e7a-319eb522a0e4 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:20.447929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a9b2e-d968-4b13-8e7a-319eb522a0e4 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:20.492285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbbf13-bd1f-48d5-8610-1d0b893c80aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:20.493132 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbbf13-bd1f-48d5-8610-1d0b893c80aa None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:20.493418 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbbf13-bd1f-48d5-8610-1d0b893c80aa None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:20.493697 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbbf13-bd1f-48d5-8610-1d0b893c80aa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:20.505826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbbf13-bd1f-48d5-8610-1d0b893c80aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:42:20.520120 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-dcfbbf13-bd1f-48d5-8610-1d0b893c80aa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 05:42:20.520120 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:20.520120 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:20.520120 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:20.520120 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:20.520120 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:20.520120 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:20.520120 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:20.520120 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:20.520120 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:20.520120 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:20.520120 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:20.520120 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:42:20.520120 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:42:20.520120 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:42:20.520120 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:42:20.521097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:42:20.521097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:42:20.521097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:42:20.521097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:42:20.521097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:20.521097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:20.521097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:20.521097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:20.521097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:20.521097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:20.521097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:20.521097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:20.521097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:20.521097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:20.521097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:20.521097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:20.522002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:20.522002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:20.522002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:20.522002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:20.522002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:42:20.522002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:42:20.522002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:42:20.522002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:42:20.522002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:42:20.522002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:42:20.522002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 05:42:20.522002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:20.522664 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 531/1067] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Jun 21 05:42:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:42:20.528856 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1c2ee-4875-4c25-a58b-68184b9b9ae5 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:20.531230 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:20.635042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1c2ee-4875-4c25-a58b-68184b9b9ae5 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:20.668647 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f6119-19f4-4b33-9039-e56f9227395c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:20.669307 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f6119-19f4-4b33-9039-e56f9227395c None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:20.669587 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f6119-19f4-4b33-9039-e56f9227395c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:20.669858 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f6119-19f4-4b33-9039-e56f9227395c None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:20.670617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f6119-19f4-4b33-9039-e56f9227395c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:20.670920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f6119-19f4-4b33-9039-e56f9227395c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:20.672280 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f6119-19f4-4b33-9039-e56f9227395c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:20.680247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 537/1068] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Jun 21 05:42:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:20.686006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbbf13-bd1f-48d5-8610-1d0b893c80aa None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:20.731398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:20.794025 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbbf13-bd1f-48d5-8610-1d0b893c80aa None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:20.828695 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82ab23-5711-4789-84bf-c83a64f93615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:20.829504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82ab23-5711-4789-84bf-c83a64f93615 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:20.829792 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82ab23-5711-4789-84bf-c83a64f93615 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:20.830109 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82ab23-5711-4789-84bf-c83a64f93615 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:20.842388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82ab23-5711-4789-84bf-c83a64f93615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:20.843837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82ab23-5711-4789-84bf-c83a64f93615 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:20.861534 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-ce82ab23-5711-4789-84bf-c83a64f93615 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:42:20.861534 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:20.861534 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:20.861534 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:20.861534 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:20.861534 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:20.861534 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:20.861534 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:20.861534 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:20.861534 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:20.861534 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:20.861534 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:20.861534 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:42:20.861534 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:42:20.861534 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:42:20.862709 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:42:20.862709 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:20.862709 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:20.862709 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:20.862709 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:20.862709 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:20.862709 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:20.862709 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:20.862709 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:20.862709 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:20.862709 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:20.862709 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:20.862709 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:20.862709 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:20.862709 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:20.862709 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:20.862709 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:20.863638 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:42:20.863638 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:42:20.863638 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:42:20.863638 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:20.863638 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 532/1069] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:42:20.868896 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f6119-19f4-4b33-9039-e56f9227395c None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:20.942643 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:20.994432 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f6119-19f4-4b33-9039-e56f9227395c None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:21.031999 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d5d53-f236-4f29-944d-dd2df32934cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:21.032669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d5d53-f236-4f29-944d-dd2df32934cd None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:21.032957 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d5d53-f236-4f29-944d-dd2df32934cd None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:21.033237 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d5d53-f236-4f29-944d-dd2df32934cd None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:21.033984 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d5d53-f236-4f29-944d-dd2df32934cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:21.034299 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d5d53-f236-4f29-944d-dd2df32934cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:21.035745 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d5d53-f236-4f29-944d-dd2df32934cd None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:21.047867 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 538/1070] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:21.053288 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82ab23-5711-4789-84bf-c83a64f93615 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:21.153420 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:21.160738 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82ab23-5711-4789-84bf-c83a64f93615 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:21.203008 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188f383-b5d0-4c74-b659-449e41cf77b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:21.203808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188f383-b5d0-4c74-b659-449e41cf77b9 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:21.204149 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188f383-b5d0-4c74-b659-449e41cf77b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:21.204466 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188f383-b5d0-4c74-b659-449e41cf77b9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:21.212927 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188f383-b5d0-4c74-b659-449e41cf77b9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:21.214527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188f383-b5d0-4c74-b659-449e41cf77b9 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:21.228686 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-b188f383-b5d0-4c74-b659-449e41cf77b9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 05:42:21.228686 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:21.228686 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:21.228686 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:21.228686 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:21.228686 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:21.228686 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:21.228686 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:21.228686 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:21.228686 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:21.228686 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:21.228686 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:21.228686 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:42:21.228686 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:42:21.228686 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:42:21.228686 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:42:21.229636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:21.229636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:21.229636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:42:21.229636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:42:21.229636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:42:21.229636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:42:21.229636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:21.229636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:21.229636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:21.229636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:21.229636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:21.229636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:21.229636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:21.229636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:21.229636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:21.229636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:21.229636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:21.229636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:21.230926 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:21.230926 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:21.230926 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:42:21.230926 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:42:21.230926 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:42:21.230926 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:42:21.230926 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:42:21.230926 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:42:21.230926 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 05:42:21.230926 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:21.230926 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 533/1071] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jun 21 05:42:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:42:21.236160 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d5d53-f236-4f29-944d-dd2df32934cd None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:21.290723 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d420d-4e8a-40a3-8b5a-9e68c6c84ef3 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:21.291033 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d420d-4e8a-40a3-8b5a-9e68c6c84ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:21.291776 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d420d-4e8a-40a3-8b5a-9e68c6c84ef3 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:21.293211 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 534/1072] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 05:42:21.299362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5265e22-393b-4b9c-b7b5-8dc6754527a1 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:21.299573 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5265e22-393b-4b9c-b7b5-8dc6754527a1 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:21.299864 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5265e22-393b-4b9c-b7b5-8dc6754527a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:21.325581 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-e5265e22-393b-4b9c-b7b5-8dc6754527a1 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:21.326841 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e5265e22-393b-4b9c-b7b5-8dc6754527a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:21.340692 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d5d53-f236-4f29-944d-dd2df32934cd None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:21.368545 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:21.383109 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b92ac6-ef9b-4916-a78c-4a9e8afe6e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:21.384025 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b92ac6-ef9b-4916-a78c-4a9e8afe6e44 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:21.384376 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b92ac6-ef9b-4916-a78c-4a9e8afe6e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:21.384717 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b92ac6-ef9b-4916-a78c-4a9e8afe6e44 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:21.385737 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b92ac6-ef9b-4916-a78c-4a9e8afe6e44 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:21.386157 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b92ac6-ef9b-4916-a78c-4a9e8afe6e44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:21.387994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b92ac6-ef9b-4916-a78c-4a9e8afe6e44 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:21.409245 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 539/1073] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jun 21 05:42:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:21.409444 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 535/1074] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 05:42:21.411510 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b92ac6-ef9b-4916-a78c-4a9e8afe6e44 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:21.435618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5265e22-393b-4b9c-b7b5-8dc6754527a1 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:21.520079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b92ac6-ef9b-4916-a78c-4a9e8afe6e44 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:21.523022 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:21.542265 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5265e22-393b-4b9c-b7b5-8dc6754527a1 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:21.556443 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaee57a-26f0-4a02-8744-a07046231a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:21.557246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaee57a-26f0-4a02-8744-a07046231a7a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:21.557573 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaee57a-26f0-4a02-8744-a07046231a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:21.557858 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaee57a-26f0-4a02-8744-a07046231a7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:21.569286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaee57a-26f0-4a02-8744-a07046231a7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:21.570829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaee57a-26f0-4a02-8744-a07046231a7a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:21.577561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfade0a3-e1ea-4977-9a72-85864644bce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:21.578417 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfade0a3-e1ea-4977-9a72-85864644bce0 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:21.578704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfade0a3-e1ea-4977-9a72-85864644bce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:21.579080 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfade0a3-e1ea-4977-9a72-85864644bce0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:21.590081 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-baaee57a-26f0-4a02-8744-a07046231a7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:42:21.590081 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:21.590081 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:21.590081 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:21.590081 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:21.590081 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:21.590081 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:21.590081 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:21.590081 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:21.590081 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:21.590081 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:21.590081 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:21.590081 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:42:21.590081 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:42:21.590081 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:42:21.591396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:42:21.591396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:21.591396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:21.591396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:21.591396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:21.591396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:21.591396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:21.591396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:21.591396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:21.591396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:21.591396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:21.591396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:21.591396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:21.591396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:21.591396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:21.591396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:21.591396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:21.592579 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:42:21.592579 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:42:21.592579 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:42:21.592579 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:42:21.592859 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfade0a3-e1ea-4977-9a72-85864644bce0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:42:21.594097 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 540/1075] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:42:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:42:21.596999 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaee57a-26f0-4a02-8744-a07046231a7a None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:21.598093 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-bfade0a3-e1ea-4977-9a72-85864644bce0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:42:21.598093 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:21.598093 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:21.598093 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:21.598093 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:21.598093 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:21.598093 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:21.598093 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:21.598093 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:21.598093 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:21.598093 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:21.598093 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:21.598093 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:42:21.598093 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:42:21.598093 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:42:21.598093 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:42:21.599173 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:42:21.599173 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:42:21.599173 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:42:21.599173 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:42:21.599173 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:21.599173 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:21.599173 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:21.599173 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:21.599173 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:21.599173 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:21.599173 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:21.599173 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:21.599173 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:21.599173 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:21.599173 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:21.599173 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:21.600050 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:21.600050 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:21.600050 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:21.600050 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:21.600050 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:42:21.600050 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:42:21.600050 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:42:21.600050 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:42:21.600050 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:42:21.600050 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:42:21.600050 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:42:21.600050 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:21.600050 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 536/1076] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:42:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:42:21.605424 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfade0a3-e1ea-4977-9a72-85864644bce0 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:21.633615 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:21.699020 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaee57a-26f0-4a02-8744-a07046231a7a None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:21.707568 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfade0a3-e1ea-4977-9a72-85864644bce0 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:21.738967 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63dda17-92e4-47e1-8a14-83a6ff91ded0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:21.739632 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dda17-92e4-47e1-8a14-83a6ff91ded0 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:21.739916 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dda17-92e4-47e1-8a14-83a6ff91ded0 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:21.740192 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dda17-92e4-47e1-8a14-83a6ff91ded0 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:21.740917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63dda17-92e4-47e1-8a14-83a6ff91ded0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:21.741224 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63dda17-92e4-47e1-8a14-83a6ff91ded0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:21.741438 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9c9c1-10f5-4011-a659-716782ca9027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:21.742139 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9c9c1-10f5-4011-a659-716782ca9027 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:21.742424 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9c9c1-10f5-4011-a659-716782ca9027 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:21.742628 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63dda17-92e4-47e1-8a14-83a6ff91ded0 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:21.742728 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9c9c1-10f5-4011-a659-716782ca9027 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:21.743442 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9c9c1-10f5-4011-a659-716782ca9027 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:21.743745 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9c9c1-10f5-4011-a659-716782ca9027 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:21.745090 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9c9c1-10f5-4011-a659-716782ca9027 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:21.754105 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 537/1077] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:42:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:21.759372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 541/1078] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:21.759996 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9c9c1-10f5-4011-a659-716782ca9027 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:21.760480 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63dda17-92e4-47e1-8a14-83a6ff91ded0 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:21.769975 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:21.856805 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:21.862158 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9c9c1-10f5-4011-a659-716782ca9027 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:21.864537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63dda17-92e4-47e1-8a14-83a6ff91ded0 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:21.897052 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebc551-3936-42b3-a27f-51bd83203031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:21.897916 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebc551-3936-42b3-a27f-51bd83203031 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:21.898229 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebc551-3936-42b3-a27f-51bd83203031 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:21.898505 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebc551-3936-42b3-a27f-51bd83203031 None admin] PATH_INFO: `/v3/users/558748204844460a810730eb7c90e9aa` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:21.899667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66696f4-b48d-4f98-9607-34785c387e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:21.899792 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebc551-3936-42b3-a27f-51bd83203031 None admin] RBAC: Authorizing `identity:get_user(user_id=558748204844460a810730eb7c90e9aa)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:21.900458 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66696f4-b48d-4f98-9607-34785c387e0f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:21.900738 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66696f4-b48d-4f98-9607-34785c387e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:21.901012 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66696f4-b48d-4f98-9607-34785c387e0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:21.901139 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebc551-3936-42b3-a27f-51bd83203031 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:21.902834 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 538/1079] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:42:21 2022] GET /identity/v3/users/558748204844460a810730eb7c90e9aa => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:21.908171 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66696f4-b48d-4f98-9607-34785c387e0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:21.908960 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebc551-3936-42b3-a27f-51bd83203031 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:21.909630 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66696f4-b48d-4f98-9607-34785c387e0f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:21.925117 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-f66696f4-b48d-4f98-9607-34785c387e0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:42:21.925117 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:21.925117 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:21.925117 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:21.925117 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:21.925117 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:21.925117 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:21.925117 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:21.925117 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:21.925117 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:21.925117 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:21.925117 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:21.925117 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:42:21.925117 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:42:21.925117 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:42:21.926265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:42:21.926265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:21.926265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:21.926265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:21.926265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:21.926265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:21.926265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:21.926265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:21.926265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:21.926265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:21.926265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:21.926265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:21.926265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:21.926265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:21.926265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:21.926265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:21.926265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:21.927280 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:42:21.927280 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:42:21.927280 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:42:21.927280 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:42:21.927280 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:42:21.927280 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:42:21.927280 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:42:21.927280 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:42:21.927280 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 542/1080] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:42:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:42:21.932787 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66696f4-b48d-4f98-9607-34785c387e0f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:21.993538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:22.019019 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebc551-3936-42b3-a27f-51bd83203031 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:22.033093 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66696f4-b48d-4f98-9607-34785c387e0f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:22.054163 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e45f32-b497-4a2c-9adc-fff6f9d55e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:22.055027 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e45f32-b497-4a2c-9adc-fff6f9d55e78 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:22.055309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e45f32-b497-4a2c-9adc-fff6f9d55e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:22.055586 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e45f32-b497-4a2c-9adc-fff6f9d55e78 None admin] PATH_INFO: `/v3/projects/a93c9e8e5d574c85a8f6a26127950d15` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:22.056756 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e45f32-b497-4a2c-9adc-fff6f9d55e78 None admin] RBAC: Authorizing `identity:get_project(project_id=a93c9e8e5d574c85a8f6a26127950d15)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:22.058205 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e45f32-b497-4a2c-9adc-fff6f9d55e78 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:22.060457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 539/1081] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:42:21 2022] GET /identity/v3/projects/a93c9e8e5d574c85a8f6a26127950d15 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:22.066215 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e45f32-b497-4a2c-9adc-fff6f9d55e78 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:22.068921 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405e8f9-80a3-408b-9e88-247102f092c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:22.069586 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405e8f9-80a3-408b-9e88-247102f092c6 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:22.069872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405e8f9-80a3-408b-9e88-247102f092c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:22.070189 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405e8f9-80a3-408b-9e88-247102f092c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:22.070980 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405e8f9-80a3-408b-9e88-247102f092c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:22.071290 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405e8f9-80a3-408b-9e88-247102f092c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:22.072739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405e8f9-80a3-408b-9e88-247102f092c6 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:22.084863 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 543/1082] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:42:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:22.090799 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405e8f9-80a3-408b-9e88-247102f092c6 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:22.108140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:22.172954 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e45f32-b497-4a2c-9adc-fff6f9d55e78 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:22.196549 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405e8f9-80a3-408b-9e88-247102f092c6 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:22.206956 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7b91d-e275-4c04-ba47-e434cba1a313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:22.207843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7b91d-e275-4c04-ba47-e434cba1a313 None admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:22.208128 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7b91d-e275-4c04-ba47-e434cba1a313 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:22.208406 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7b91d-e275-4c04-ba47-e434cba1a313 None admin] PATH_INFO: `/v3/projects/a93c9e8e5d574c85a8f6a26127950d15/users/558748204844460a810730eb7c90e9aa/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:22.210381 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7b91d-e275-4c04-ba47-e434cba1a313 None admin] RBAC: Authorizing `identity:create_grant(project_id=a93c9e8e5d574c85a8f6a26127950d15, user_id=558748204844460a810730eb7c90e9aa, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:22.211808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7b91d-e275-4c04-ba47-e434cba1a313 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:22.224401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 540/1083] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 21 05:42:22 2022] PUT /identity/v3/projects/a93c9e8e5d574c85a8f6a26127950d15/users/558748204844460a810730eb7c90e9aa/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 05:42:22.233718 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ab6ca-df0b-4abd-93d7-06e6d2e880ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:22.234655 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ab6ca-df0b-4abd-93d7-06e6d2e880ae None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:22.234947 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ab6ca-df0b-4abd-93d7-06e6d2e880ae None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:22.236253 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ab6ca-df0b-4abd-93d7-06e6d2e880ae None admin] PATH_INFO: `/v3/projects/e64b932ef6bf481cb93a04885a93b4b2/users/f702830987ba4548a4c2ee3d0e302d02/roles/31cd2c6d233240a4b889e206872556b0` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:22.239332 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ab6ca-df0b-4abd-93d7-06e6d2e880ae None admin] RBAC: Authorizing `identity:create_grant(project_id=e64b932ef6bf481cb93a04885a93b4b2, user_id=f702830987ba4548a4c2ee3d0e302d02, role_id=31cd2c6d233240a4b889e206872556b0)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:22.240854 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ab6ca-df0b-4abd-93d7-06e6d2e880ae None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:22.255953 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 544/1084] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 21 05:42:22 2022] PUT /identity/v3/projects/e64b932ef6bf481cb93a04885a93b4b2/users/f702830987ba4548a4c2ee3d0e302d02/roles/31cd2c6d233240a4b889e206872556b0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:42:24.257567 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04906421-8d3b-49c4-a79a-e0ae34ceb703 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:24.258115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04906421-8d3b-49c4-a79a-e0ae34ceb703 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:24.258232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04906421-8d3b-49c4-a79a-e0ae34ceb703 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:24.259526 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 541/1085] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:24.265447 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65912249-72f3-4f22-ba2b-8f81ab457337 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:24.265872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65912249-72f3-4f22-ba2b-8f81ab457337 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:24.266115 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65912249-72f3-4f22-ba2b-8f81ab457337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:24.283445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-65912249-72f3-4f22-ba2b-8f81ab457337 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:24.284638 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-65912249-72f3-4f22-ba2b-8f81ab457337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:24.314131 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f3a22-ed75-420d-a219-cd0b01ba5457 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:24.314425 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f3a22-ed75-420d-a219-cd0b01ba5457 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:24.314707 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f3a22-ed75-420d-a219-cd0b01ba5457 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:24.316222 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 542/1086] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:24.321015 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf5dbd-e837-4cea-9d2e-6b4127ef8b3f None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:24.321309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf5dbd-e837-4cea-9d2e-6b4127ef8b3f None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:24.321594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf5dbd-e837-4cea-9d2e-6b4127ef8b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:24.327196 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:24.341883 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-9eaf5dbd-e837-4cea-9d2e-6b4127ef8b3f None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:24.343133 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9eaf5dbd-e837-4cea-9d2e-6b4127ef8b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:24.357150 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 545/1087] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:42:24.380929 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65912249-72f3-4f22-ba2b-8f81ab457337 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:24.383893 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:24.410881 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 543/1088] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 05:42:24.434677 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf5dbd-e837-4cea-9d2e-6b4127ef8b3f None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:24.483387 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65912249-72f3-4f22-ba2b-8f81ab457337 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:24.517620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e71877-ce1b-48c9-987d-f56c4787c65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:24.518440 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e71877-ce1b-48c9-987d-f56c4787c65d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:24.518721 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e71877-ce1b-48c9-987d-f56c4787c65d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:24.518995 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e71877-ce1b-48c9-987d-f56c4787c65d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:24.529773 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e71877-ce1b-48c9-987d-f56c4787c65d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:42:24.536172 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf5dbd-e837-4cea-9d2e-6b4127ef8b3f None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:24.537610 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-33e71877-ce1b-48c9-987d-f56c4787c65d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:42:24.537610 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:24.537610 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:24.537610 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:24.537610 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:24.537610 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:24.537610 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:24.537610 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:24.537610 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:24.537610 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:24.537610 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:24.537610 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:24.537610 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:42:24.537610 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:42:24.537610 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:42:24.537610 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:42:24.538783 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:42:24.538783 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:42:24.538783 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:42:24.538783 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:42:24.538783 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:24.538783 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:24.538783 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:24.538783 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:24.538783 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:24.538783 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:24.538783 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:24.538783 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:24.538783 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:24.538783 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:24.538783 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:24.538783 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:24.539831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:24.539831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:24.539831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:24.539831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:24.539831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:42:24.539831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:42:24.539831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:42:24.539831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:42:24.539831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:42:24.539831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:42:24.539831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:42:24.539831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:42:24.539831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 546/1089] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:42:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:42:24.544780 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e71877-ce1b-48c9-987d-f56c4787c65d None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:24.569770 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:24.576661 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae08eb-0de8-495a-9436-d83c52dc6c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:24.577472 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae08eb-0de8-495a-9436-d83c52dc6c8f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:24.577750 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae08eb-0de8-495a-9436-d83c52dc6c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:24.578077 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae08eb-0de8-495a-9436-d83c52dc6c8f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:24.588285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae08eb-0de8-495a-9436-d83c52dc6c8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:42:24.599207 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-32ae08eb-0de8-495a-9436-d83c52dc6c8f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 05:42:24.599207 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:24.599207 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:24.599207 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:24.599207 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:24.599207 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:24.599207 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:24.599207 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:24.599207 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:24.599207 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:24.599207 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:24.599207 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:24.599207 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:42:24.599207 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:42:24.599207 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:42:24.599207 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:42:24.600462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:42:24.600462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:42:24.600462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:42:24.600462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:42:24.600462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:24.600462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:24.600462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:24.600462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:24.600462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:24.600462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:24.600462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:24.600462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:24.600462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:24.600462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:24.600462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:24.600462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:24.601527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:24.601527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:24.601527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:24.601527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:24.601527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:42:24.601527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:42:24.601527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:42:24.601527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:42:24.601527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:42:24.601527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:42:24.601527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 05:42:24.601527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:24.601527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 544/1090] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Jun 21 05:42:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:42:24.608023 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae08eb-0de8-495a-9436-d83c52dc6c8f None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:24.617084 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:24.657152 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e71877-ce1b-48c9-987d-f56c4787c65d None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:24.691614 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e98d4-9932-4422-a19b-887ea5e4d543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:24.692286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e98d4-9932-4422-a19b-887ea5e4d543 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:24.692576 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e98d4-9932-4422-a19b-887ea5e4d543 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:24.692868 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e98d4-9932-4422-a19b-887ea5e4d543 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:24.693610 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e98d4-9932-4422-a19b-887ea5e4d543 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:24.693948 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e98d4-9932-4422-a19b-887ea5e4d543 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:24.695548 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e98d4-9932-4422-a19b-887ea5e4d543 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:24.704769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 547/1091] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:42:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:24.710470 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e98d4-9932-4422-a19b-887ea5e4d543 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:24.711900 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae08eb-0de8-495a-9436-d83c52dc6c8f None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:24.745614 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250210d-8463-4ff1-b63d-bc371dd1e566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:24.746316 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250210d-8463-4ff1-b63d-bc371dd1e566 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:24.747109 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250210d-8463-4ff1-b63d-bc371dd1e566 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:24.747383 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250210d-8463-4ff1-b63d-bc371dd1e566 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:24.748122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250210d-8463-4ff1-b63d-bc371dd1e566 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:24.748429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250210d-8463-4ff1-b63d-bc371dd1e566 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:24.749795 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250210d-8463-4ff1-b63d-bc371dd1e566 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:24.758075 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 545/1092] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Jun 21 05:42:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:24.764130 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250210d-8463-4ff1-b63d-bc371dd1e566 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:24.816440 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e98d4-9932-4422-a19b-887ea5e4d543 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:24.821891 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:24.843879 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:24.853114 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58615276-def3-4f09-93f2-b9e1cd99277b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:24.854034 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58615276-def3-4f09-93f2-b9e1cd99277b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:24.854324 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58615276-def3-4f09-93f2-b9e1cd99277b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:24.854605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58615276-def3-4f09-93f2-b9e1cd99277b None admin] PATH_INFO: `/v3/users/558748204844460a810730eb7c90e9aa` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:24.856116 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58615276-def3-4f09-93f2-b9e1cd99277b None admin] RBAC: Authorizing `identity:get_user(user_id=558748204844460a810730eb7c90e9aa)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:24.857561 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58615276-def3-4f09-93f2-b9e1cd99277b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:24.859253 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 548/1093] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:42:24 2022] GET /identity/v3/users/558748204844460a810730eb7c90e9aa => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:24.864928 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58615276-def3-4f09-93f2-b9e1cd99277b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:24.868134 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250210d-8463-4ff1-b63d-bc371dd1e566 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:24.904359 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7852c3-b042-414f-ac94-0e123163c566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:24.905160 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7852c3-b042-414f-ac94-0e123163c566 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:24.905443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7852c3-b042-414f-ac94-0e123163c566 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:24.905726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7852c3-b042-414f-ac94-0e123163c566 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:24.916442 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7852c3-b042-414f-ac94-0e123163c566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:24.917801 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7852c3-b042-414f-ac94-0e123163c566 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:24.935234 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-9c7852c3-b042-414f-ac94-0e123163c566 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:42:24.935234 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:24.935234 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:24.935234 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:24.935234 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:24.935234 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:24.935234 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:24.935234 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:24.935234 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:24.935234 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:24.935234 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:24.935234 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:24.935234 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:42:24.935234 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:42:24.935234 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:42:24.936236 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:42:24.936236 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:24.936236 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:24.936236 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:24.936236 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:24.936236 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:24.936236 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:24.936236 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:24.936236 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:24.936236 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:24.936236 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:24.936236 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:24.936236 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:24.936236 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:24.936236 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:24.936236 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:24.936236 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:24.937147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:42:24.937147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:42:24.937147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:42:24.937147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:24.937147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 546/1094] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:42:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:42:24.942588 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7852c3-b042-414f-ac94-0e123163c566 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:24.969314 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58615276-def3-4f09-93f2-b9e1cd99277b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:25.003608 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1f576-220a-4100-ae8e-83e93a352d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:25.004248 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1f576-220a-4100-ae8e-83e93a352d74 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:25.004529 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1f576-220a-4100-ae8e-83e93a352d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:25.004800 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1f576-220a-4100-ae8e-83e93a352d74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:25.058851 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7852c3-b042-414f-ac94-0e123163c566 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:25.066547 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:25.070031 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:25.078437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c1f576-220a-4100-ae8e-83e93a352d74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:25.079899 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c1f576-220a-4100-ae8e-83e93a352d74 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:25.098643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9033e34-c994-49ea-a595-f4e5bdb8350c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:25.099309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9033e34-c994-49ea-a595-f4e5bdb8350c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:25.099592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9033e34-c994-49ea-a595-f4e5bdb8350c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:25.099869 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9033e34-c994-49ea-a595-f4e5bdb8350c None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:25.100662 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9033e34-c994-49ea-a595-f4e5bdb8350c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:25.100967 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9033e34-c994-49ea-a595-f4e5bdb8350c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:25.102409 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9033e34-c994-49ea-a595-f4e5bdb8350c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:25.115152 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 547/1095] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:25.120788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9033e34-c994-49ea-a595-f4e5bdb8350c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:25.184549 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 549/1096] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:42:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 05:42:25.190727 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1f576-220a-4100-ae8e-83e93a352d74 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:25.225317 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9033e34-c994-49ea-a595-f4e5bdb8350c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:25.260797 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71f743-4d8f-4641-a37f-312a09bc1d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:25.261585 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71f743-4d8f-4641-a37f-312a09bc1d71 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:25.261866 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71f743-4d8f-4641-a37f-312a09bc1d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:25.262215 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71f743-4d8f-4641-a37f-312a09bc1d71 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:25.270139 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71f743-4d8f-4641-a37f-312a09bc1d71 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:25.271577 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71f743-4d8f-4641-a37f-312a09bc1d71 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:25.285507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-1a71f743-4d8f-4641-a37f-312a09bc1d71 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 05:42:25.285507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:25.285507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:25.285507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:25.285507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:25.285507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:25.285507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:25.285507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:25.285507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:25.285507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:25.285507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:25.285507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:25.285507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:42:25.285507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:42:25.285507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:42:25.285507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:42:25.286561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:25.286561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:25.286561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:42:25.286561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:42:25.286561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:42:25.286561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:42:25.286561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:25.286561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:25.286561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:25.286561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:25.286561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:25.286561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:25.286561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:25.286561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:25.286561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:25.286561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:25.286561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:25.286561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:25.287528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:25.287528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:25.287528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:42:25.287528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:42:25.287528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:42:25.287528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:42:25.287528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:42:25.287528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:42:25.287528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 05:42:25.287528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:25.288387 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:25.291649 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 548/1097] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jun 21 05:42:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:42:25.292453 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71f743-4d8f-4641-a37f-312a09bc1d71 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:25.295864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1f576-220a-4100-ae8e-83e93a352d74 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:25.330568 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:25.330841 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49489407-4096-4ebd-8893-fbc8889f17c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:25.331886 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49489407-4096-4ebd-8893-fbc8889f17c2 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:25.332283 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49489407-4096-4ebd-8893-fbc8889f17c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:25.332685 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49489407-4096-4ebd-8893-fbc8889f17c2 None admin] PATH_INFO: `/v3/projects/a93c9e8e5d574c85a8f6a26127950d15` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:25.333892 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49489407-4096-4ebd-8893-fbc8889f17c2 None admin] RBAC: Authorizing `identity:get_project(project_id=a93c9e8e5d574c85a8f6a26127950d15)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:25.335347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49489407-4096-4ebd-8893-fbc8889f17c2 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:25.337037 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 550/1098] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:42:25 2022] GET /identity/v3/projects/a93c9e8e5d574c85a8f6a26127950d15 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:25.343162 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49489407-4096-4ebd-8893-fbc8889f17c2 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:25.408018 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71f743-4d8f-4641-a37f-312a09bc1d71 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:25.441425 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49489407-4096-4ebd-8893-fbc8889f17c2 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:25.441910 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2337fb-8da5-43dc-b11e-7d4472f3d082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:25.442617 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2337fb-8da5-43dc-b11e-7d4472f3d082 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:25.442912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2337fb-8da5-43dc-b11e-7d4472f3d082 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:25.443190 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2337fb-8da5-43dc-b11e-7d4472f3d082 None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:25.444034 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2337fb-8da5-43dc-b11e-7d4472f3d082 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:25.444348 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2337fb-8da5-43dc-b11e-7d4472f3d082 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:25.445779 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2337fb-8da5-43dc-b11e-7d4472f3d082 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:25.463239 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 549/1099] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jun 21 05:42:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:25.469364 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2337fb-8da5-43dc-b11e-7d4472f3d082 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:25.475228 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8a1fb-f025-43a5-888b-a88a0eac4337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:25.475886 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8a1fb-f025-43a5-888b-a88a0eac4337 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:25.476170 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8a1fb-f025-43a5-888b-a88a0eac4337 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:25.476448 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8a1fb-f025-43a5-888b-a88a0eac4337 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:25.477278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8a1fb-f025-43a5-888b-a88a0eac4337 None admin] RBAC: Adding query filter params (role.id=24aa6040c86049f996560e477e83886f, scope.project.id=a93c9e8e5d574c85a8f6a26127950d15, user.id=558748204844460a810730eb7c90e9aa) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:25.477592 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8a1fb-f025-43a5-888b-a88a0eac4337 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:25.479065 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8a1fb-f025-43a5-888b-a88a0eac4337 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:25.485793 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 551/1100] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:42:25 2022] GET /identity/v3/role_assignments?user.id=558748204844460a810730eb7c90e9aa&scope.project.id=a93c9e8e5d574c85a8f6a26127950d15&role.id=24aa6040c86049f996560e477e83886f => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:25.565000 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:25.584860 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2337fb-8da5-43dc-b11e-7d4472f3d082 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:25.624984 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da68da-f901-488b-95df-7d8e4693d5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:25.625846 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da68da-f901-488b-95df-7d8e4693d5ac None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:25.626231 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da68da-f901-488b-95df-7d8e4693d5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:25.626577 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da68da-f901-488b-95df-7d8e4693d5ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:25.706295 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da68da-f901-488b-95df-7d8e4693d5ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:25.707663 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da68da-f901-488b-95df-7d8e4693d5ac None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:25.789693 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:25.806895 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 550/1101] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:42:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 05:42:25.813178 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8a1fb-f025-43a5-888b-a88a0eac4337 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:25.839517 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:25.911133 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8a1fb-f025-43a5-888b-a88a0eac4337 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:25.945117 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64a72c-e202-432f-b57d-d9d1227a4e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:25.945917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64a72c-e202-432f-b57d-d9d1227a4e5e None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:25.946209 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64a72c-e202-432f-b57d-d9d1227a4e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:25.946483 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64a72c-e202-432f-b57d-d9d1227a4e5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:25.956594 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64a72c-e202-432f-b57d-d9d1227a4e5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:25.958003 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64a72c-e202-432f-b57d-d9d1227a4e5e None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:25.977492 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-ad64a72c-e202-432f-b57d-d9d1227a4e5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:42:25.977492 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:25.977492 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:25.977492 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:25.977492 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:25.977492 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:25.977492 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:25.977492 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:25.977492 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:25.977492 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:25.977492 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:25.977492 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:25.977492 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:42:25.977492 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:42:25.977492 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:42:25.978590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:42:25.978590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:25.978590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:25.978590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:25.978590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:25.978590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:25.978590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:25.978590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:25.978590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:25.978590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:25.978590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:25.978590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:25.978590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:25.978590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:25.978590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:25.978590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:25.978590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:25.980386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:42:25.980386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:42:25.980386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:42:25.980386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:42:25.981136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 552/1102] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:42:25.988542 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da68da-f901-488b-95df-7d8e4693d5ac None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:26.096339 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da68da-f901-488b-95df-7d8e4693d5ac None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:26.138432 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245712c3-7998-4a1e-8bab-efac7e5854b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:26.139094 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245712c3-7998-4a1e-8bab-efac7e5854b0 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:26.139381 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245712c3-7998-4a1e-8bab-efac7e5854b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:26.139767 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245712c3-7998-4a1e-8bab-efac7e5854b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:26.140500 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245712c3-7998-4a1e-8bab-efac7e5854b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:26.140810 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245712c3-7998-4a1e-8bab-efac7e5854b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:26.142193 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245712c3-7998-4a1e-8bab-efac7e5854b0 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:26.154928 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 551/1103] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:26.160657 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64a72c-e202-432f-b57d-d9d1227a4e5e None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:26.238668 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:26.262110 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64a72c-e202-432f-b57d-d9d1227a4e5e None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:26.297216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12222ff0-64f7-4eea-83e4-8ab5338a52fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:26.298040 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12222ff0-64f7-4eea-83e4-8ab5338a52fe None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:26.298328 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12222ff0-64f7-4eea-83e4-8ab5338a52fe None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:26.298604 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12222ff0-64f7-4eea-83e4-8ab5338a52fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:26.305575 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12222ff0-64f7-4eea-83e4-8ab5338a52fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:26.307075 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12222ff0-64f7-4eea-83e4-8ab5338a52fe None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:26.320829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-12222ff0-64f7-4eea-83e4-8ab5338a52fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:42:26.320829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:26.320829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:26.320829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:26.320829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:26.320829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:26.320829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:26.320829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:26.320829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:26.320829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:26.320829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:26.320829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:26.320829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:42:26.320829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:42:26.320829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:42:26.321951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:42:26.321951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:26.321951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:26.321951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:26.321951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:26.321951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:26.321951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:26.321951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:26.321951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:26.321951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:26.321951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:26.321951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:26.321951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:26.321951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:26.321951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:26.321951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:26.321951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:26.327780 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:42:26.327780 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:42:26.327780 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:42:26.327780 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:42:26.327780 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:42:26.327780 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:42:26.327780 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:42:26.327780 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:42:26.327780 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 553/1104] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:42:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:42:26.328285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245712c3-7998-4a1e-8bab-efac7e5854b0 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:26.374364 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:26.427190 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245712c3-7998-4a1e-8bab-efac7e5854b0 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:26.460784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c064f3-a385-4f81-90bb-fd4967f92acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:26.461441 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c064f3-a385-4f81-90bb-fd4967f92acc None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:26.461732 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c064f3-a385-4f81-90bb-fd4967f92acc None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:26.462039 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c064f3-a385-4f81-90bb-fd4967f92acc None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:26.462823 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c064f3-a385-4f81-90bb-fd4967f92acc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:26.463140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c064f3-a385-4f81-90bb-fd4967f92acc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:26.464570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c064f3-a385-4f81-90bb-fd4967f92acc None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:26.476372 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 552/1105] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:42:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:26.483344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12222ff0-64f7-4eea-83e4-8ab5338a52fe None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:26.589462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12222ff0-64f7-4eea-83e4-8ab5338a52fe None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:26.624652 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03118f54-c15c-4b6d-a7ce-ad395f313699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:26.625310 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03118f54-c15c-4b6d-a7ce-ad395f313699 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:26.625598 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03118f54-c15c-4b6d-a7ce-ad395f313699 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:26.625873 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03118f54-c15c-4b6d-a7ce-ad395f313699 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:26.626758 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03118f54-c15c-4b6d-a7ce-ad395f313699 None admin] RBAC: Adding query filter params (role.id=31cd2c6d233240a4b889e206872556b0, scope.project.id=e64b932ef6bf481cb93a04885a93b4b2, user.id=f702830987ba4548a4c2ee3d0e302d02) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:26.627071 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03118f54-c15c-4b6d-a7ce-ad395f313699 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:26.628503 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03118f54-c15c-4b6d-a7ce-ad395f313699 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:26.634799 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 554/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:42:26 2022] GET /identity/v3/role_assignments?user.id=f702830987ba4548a4c2ee3d0e302d02&scope.project.id=e64b932ef6bf481cb93a04885a93b4b2&role.id=31cd2c6d233240a4b889e206872556b0 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:27.613786 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800affe4-2217-4073-abca-294712e73e67 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:27.614365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800affe4-2217-4073-abca-294712e73e67 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:27.614497 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800affe4-2217-4073-abca-294712e73e67 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:27.615873 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 553/1107] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:27.620965 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c696f-628f-4829-a039-7dfa3c8b4550 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:27.621893 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c696f-628f-4829-a039-7dfa3c8b4550 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:27.622036 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c696f-628f-4829-a039-7dfa3c8b4550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:27.626961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:27.640004 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-fd0c696f-628f-4829-a039-7dfa3c8b4550 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:27.641181 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-fd0c696f-628f-4829-a039-7dfa3c8b4550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:27.708173 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 555/1108] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 05:42:27.732695 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800affe4-2217-4073-abca-294712e73e67 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:27.832966 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800affe4-2217-4073-abca-294712e73e67 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:27.835281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:27.866386 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff7e86-b003-4822-86a1-1398df7f4ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:27.867097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff7e86-b003-4822-86a1-1398df7f4ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:27.867382 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff7e86-b003-4822-86a1-1398df7f4ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:27.867660 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff7e86-b003-4822-86a1-1398df7f4ed2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:27.868819 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff7e86-b003-4822-86a1-1398df7f4ed2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:27.870268 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff7e86-b003-4822-86a1-1398df7f4ed2 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:27.872369 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 554/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:42:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:27.878038 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c696f-628f-4829-a039-7dfa3c8b4550 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:27.973417 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c696f-628f-4829-a039-7dfa3c8b4550 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:28.001747 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:28.007062 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b80413-71a5-4105-8bd1-0709ceffb95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:28.007723 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b80413-71a5-4105-8bd1-0709ceffb95a None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:28.008005 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b80413-71a5-4105-8bd1-0709ceffb95a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:28.008280 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b80413-71a5-4105-8bd1-0709ceffb95a None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:28.008982 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b80413-71a5-4105-8bd1-0709ceffb95a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:28.010441 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b80413-71a5-4105-8bd1-0709ceffb95a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:28.029914 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 556/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 21 05:42:27 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:42:30.109625 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3c606-7de7-4470-bba2-0150d2f13d7a None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:30.110199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3c606-7de7-4470-bba2-0150d2f13d7a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:30.110199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3c606-7de7-4470-bba2-0150d2f13d7a None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:30.111624 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 555/1111] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:30.117027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6457b9-6513-4ddb-8356-92fb9deac632 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:30.117404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6457b9-6513-4ddb-8356-92fb9deac632 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:30.117579 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6457b9-6513-4ddb-8356-92fb9deac632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:30.133811 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-8c6457b9-6513-4ddb-8356-92fb9deac632 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:30.135023 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8c6457b9-6513-4ddb-8356-92fb9deac632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:30.198628 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 557/1112] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:42:30.222750 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3c606-7de7-4470-bba2-0150d2f13d7a None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:30.321467 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3c606-7de7-4470-bba2-0150d2f13d7a None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:30.354552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbbf8c-6976-4ae3-b558-400b953b599a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:30.355669 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbbf8c-6976-4ae3-b558-400b953b599a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:30.355948 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbbf8c-6976-4ae3-b558-400b953b599a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:30.356222 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbbf8c-6976-4ae3-b558-400b953b599a None admin] PATH_INFO: `/v3/roles/ad23f352111e42de99e9d92fbfe2e1f4` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:30.357667 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbbf8c-6976-4ae3-b558-400b953b599a None admin] RBAC: Authorizing `identity:get_role(role_id=ad23f352111e42de99e9d92fbfe2e1f4)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:30.359045 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbbf8c-6976-4ae3-b558-400b953b599a None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:30.360430 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 556/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:42:30 2022] GET /identity/v3/roles/ad23f352111e42de99e9d92fbfe2e1f4 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:30.366196 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6457b9-6513-4ddb-8356-92fb9deac632 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:30.462138 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6457b9-6513-4ddb-8356-92fb9deac632 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:30.479272 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:30.497213 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf9d77-86b4-4a40-8910-2bf3cba7a237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:30.498110 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf9d77-86b4-4a40-8910-2bf3cba7a237 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:30.498396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf9d77-86b4-4a40-8910-2bf3cba7a237 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:30.498672 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf9d77-86b4-4a40-8910-2bf3cba7a237 None admin] PATH_INFO: `/v3/users/aacbd6bcc6a54016a32a2fecae99d5f8` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:30.511572 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf9d77-86b4-4a40-8910-2bf3cba7a237 None admin] RBAC: Authorizing `identity:get_user(user_id=aacbd6bcc6a54016a32a2fecae99d5f8)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:30.513553 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf9d77-86b4-4a40-8910-2bf3cba7a237 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:30.515316 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 558/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:42:30 2022] GET /identity/v3/users/aacbd6bcc6a54016a32a2fecae99d5f8 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:30.520977 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbbf8c-6976-4ae3-b558-400b953b599a None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:30.561684 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:30.618647 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbbf8c-6976-4ae3-b558-400b953b599a None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:30.656276 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44a8dc-c0eb-4986-bfb9-c1bad27af317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:30.656915 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44a8dc-c0eb-4986-bfb9-c1bad27af317 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:30.657195 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44a8dc-c0eb-4986-bfb9-c1bad27af317 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:30.657468 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44a8dc-c0eb-4986-bfb9-c1bad27af317 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:30.721648 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44a8dc-c0eb-4986-bfb9-c1bad27af317 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:30.723105 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44a8dc-c0eb-4986-bfb9-c1bad27af317 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:30.761604 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:30.821807 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 557/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:42:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 05:42:30.828190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf9d77-86b4-4a40-8910-2bf3cba7a237 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:30.924636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf9d77-86b4-4a40-8910-2bf3cba7a237 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:30.959334 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a8b3c-5dc8-4940-9a8b-1c842ec88593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:30.960181 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a8b3c-5dc8-4940-9a8b-1c842ec88593 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:30.960459 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a8b3c-5dc8-4940-9a8b-1c842ec88593 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:30.960731 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a8b3c-5dc8-4940-9a8b-1c842ec88593 None admin] PATH_INFO: `/v3/projects/a93c9e8e5d574c85a8f6a26127950d15` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:30.961894 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a8b3c-5dc8-4940-9a8b-1c842ec88593 None admin] RBAC: Authorizing `identity:get_project(project_id=a93c9e8e5d574c85a8f6a26127950d15)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:30.963351 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a8b3c-5dc8-4940-9a8b-1c842ec88593 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:30.965082 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 559/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:42:30 2022] GET /identity/v3/projects/a93c9e8e5d574c85a8f6a26127950d15 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:42:30.971527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44a8dc-c0eb-4986-bfb9-c1bad27af317 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:31.070542 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44a8dc-c0eb-4986-bfb9-c1bad27af317 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:31.103969 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6698d-e70d-4563-97e4-adb132669baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:31.104628 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6698d-e70d-4563-97e4-adb132669baa None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:31.105177 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6698d-e70d-4563-97e4-adb132669baa None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:31.105990 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6698d-e70d-4563-97e4-adb132669baa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:31.106827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6698d-e70d-4563-97e4-adb132669baa None admin] RBAC: Adding query filter params (role.id=ad23f352111e42de99e9d92fbfe2e1f4, scope.project.id=a93c9e8e5d574c85a8f6a26127950d15, user.id=aacbd6bcc6a54016a32a2fecae99d5f8) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:31.107139 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6698d-e70d-4563-97e4-adb132669baa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:31.108596 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6698d-e70d-4563-97e4-adb132669baa None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:31.114421 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 558/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:42:30 2022] GET /identity/v3/role_assignments?user.id=aacbd6bcc6a54016a32a2fecae99d5f8&scope.project.id=a93c9e8e5d574c85a8f6a26127950d15&role.id=ad23f352111e42de99e9d92fbfe2e1f4 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:33.133135 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a9f4d-1a79-4860-944a-a85c1b75a058 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:33.133586 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a9f4d-1a79-4860-944a-a85c1b75a058 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:33.133697 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a9f4d-1a79-4860-944a-a85c1b75a058 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:33.135114 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 560/1118] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:33.140483 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29641b-9796-4ee2-92cf-9f3c92dbf235 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:33.140896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29641b-9796-4ee2-92cf-9f3c92dbf235 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:33.141042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29641b-9796-4ee2-92cf-9f3c92dbf235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:33.146982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:33.158335 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-7c29641b-9796-4ee2-92cf-9f3c92dbf235 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:33.159525 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-7c29641b-9796-4ee2-92cf-9f3c92dbf235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:33.226871 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 559/1119] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 05:42:33.250211 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a9f4d-1a79-4860-944a-a85c1b75a058 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:33.302000 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:33.363367 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a9f4d-1a79-4860-944a-a85c1b75a058 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:33.401353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934cfd4d-025d-4a01-9423-dfc938feb70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:33.402891 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cfd4d-025d-4a01-9423-dfc938feb70f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:33.403178 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cfd4d-025d-4a01-9423-dfc938feb70f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:33.403454 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cfd4d-025d-4a01-9423-dfc938feb70f None admin] PATH_INFO: `/v3/roles/ad23f352111e42de99e9d92fbfe2e1f4` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:33.404941 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934cfd4d-025d-4a01-9423-dfc938feb70f None admin] RBAC: Authorizing `identity:get_role(role_id=ad23f352111e42de99e9d92fbfe2e1f4)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:33.406355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934cfd4d-025d-4a01-9423-dfc938feb70f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:33.407733 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 561/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:42:33 2022] GET /identity/v3/roles/ad23f352111e42de99e9d92fbfe2e1f4 => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:33.413573 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29641b-9796-4ee2-92cf-9f3c92dbf235 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:33.508068 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29641b-9796-4ee2-92cf-9f3c92dbf235 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:33.541639 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c646f7f-f70f-4b0d-89e4-ce627562fead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:33.542535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c646f7f-f70f-4b0d-89e4-ce627562fead None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:33.542851 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c646f7f-f70f-4b0d-89e4-ce627562fead None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:33.543129 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c646f7f-f70f-4b0d-89e4-ce627562fead None admin] PATH_INFO: `/v3/users/aacbd6bcc6a54016a32a2fecae99d5f8` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:33.544303 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c646f7f-f70f-4b0d-89e4-ce627562fead None admin] RBAC: Authorizing `identity:get_user(user_id=aacbd6bcc6a54016a32a2fecae99d5f8)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:33.545719 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c646f7f-f70f-4b0d-89e4-ce627562fead None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:33.547377 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 560/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:42:33 2022] GET /identity/v3/users/aacbd6bcc6a54016a32a2fecae99d5f8 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:33.553326 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934cfd4d-025d-4a01-9423-dfc938feb70f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:33.669812 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934cfd4d-025d-4a01-9423-dfc938feb70f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:33.684579 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:33.706829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319ad58-f33e-46a8-9ba0-46317293af6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:33.707688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319ad58-f33e-46a8-9ba0-46317293af6c None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:33.707968 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319ad58-f33e-46a8-9ba0-46317293af6c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:33.708244 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319ad58-f33e-46a8-9ba0-46317293af6c None admin] PATH_INFO: `/v3/projects/a93c9e8e5d574c85a8f6a26127950d15` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:33.709416 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319ad58-f33e-46a8-9ba0-46317293af6c None admin] RBAC: Authorizing `identity:get_project(project_id=a93c9e8e5d574c85a8f6a26127950d15)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:33.710879 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319ad58-f33e-46a8-9ba0-46317293af6c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:33.712578 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 562/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:42:33 2022] GET /identity/v3/projects/a93c9e8e5d574c85a8f6a26127950d15 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:33.724379 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c646f7f-f70f-4b0d-89e4-ce627562fead None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:33.727314 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:33.825684 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c646f7f-f70f-4b0d-89e4-ce627562fead None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:33.862831 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c38fb6-127c-45b6-ab76-9bf566e41484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:33.863715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c38fb6-127c-45b6-ab76-9bf566e41484 None admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:33.864000 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c38fb6-127c-45b6-ab76-9bf566e41484 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:33.864278 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c38fb6-127c-45b6-ab76-9bf566e41484 None admin] PATH_INFO: `/v3/projects/a93c9e8e5d574c85a8f6a26127950d15/users/aacbd6bcc6a54016a32a2fecae99d5f8/roles/ad23f352111e42de99e9d92fbfe2e1f4` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:33.866511 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c38fb6-127c-45b6-ab76-9bf566e41484 None admin] RBAC: Authorizing `identity:create_grant(project_id=a93c9e8e5d574c85a8f6a26127950d15, user_id=aacbd6bcc6a54016a32a2fecae99d5f8, role_id=ad23f352111e42de99e9d92fbfe2e1f4)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:33.867942 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c38fb6-127c-45b6-ab76-9bf566e41484 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:33.881299 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 561/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 21 05:42:33 2022] PUT /identity/v3/projects/a93c9e8e5d574c85a8f6a26127950d15/users/aacbd6bcc6a54016a32a2fecae99d5f8/roles/ad23f352111e42de99e9d92fbfe2e1f4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 05:42:35.905896 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d76843-4916-45a0-bad5-6ddf48512a97 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:35.906454 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d76843-4916-45a0-bad5-6ddf48512a97 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:35.906454 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d76843-4916-45a0-bad5-6ddf48512a97 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:35.907843 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 563/1124] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:35.913206 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f5f3f-655b-4d00-bfd1-8f57e55e5085 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:35.913651 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f5f3f-655b-4d00-bfd1-8f57e55e5085 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:35.913779 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f5f3f-655b-4d00-bfd1-8f57e55e5085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:35.930517 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-9f7f5f3f-655b-4d00-bfd1-8f57e55e5085 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:35.931722 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9f7f5f3f-655b-4d00-bfd1-8f57e55e5085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:35.988366 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:35.999885 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 562/1125] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:42:36.024497 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d76843-4916-45a0-bad5-6ddf48512a97 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:36.128557 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d76843-4916-45a0-bad5-6ddf48512a97 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:36.162548 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce694c-94bd-44a4-9d71-86c3ccc7435b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:36.163315 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce694c-94bd-44a4-9d71-86c3ccc7435b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:36.163594 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce694c-94bd-44a4-9d71-86c3ccc7435b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:36.163863 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce694c-94bd-44a4-9d71-86c3ccc7435b None admin] PATH_INFO: `/v3/roles/ad23f352111e42de99e9d92fbfe2e1f4` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:36.165333 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce694c-94bd-44a4-9d71-86c3ccc7435b None admin] RBAC: Authorizing `identity:get_role(role_id=ad23f352111e42de99e9d92fbfe2e1f4)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:36.166733 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce694c-94bd-44a4-9d71-86c3ccc7435b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:36.168144 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 564/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:42:36 2022] GET /identity/v3/roles/ad23f352111e42de99e9d92fbfe2e1f4 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:36.174159 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f5f3f-655b-4d00-bfd1-8f57e55e5085 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:36.271623 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f5f3f-655b-4d00-bfd1-8f57e55e5085 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:36.305598 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687070e-33e6-42c8-8be3-510a33805594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:36.306509 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687070e-33e6-42c8-8be3-510a33805594 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:36.306790 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687070e-33e6-42c8-8be3-510a33805594 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:36.307062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687070e-33e6-42c8-8be3-510a33805594 None admin] PATH_INFO: `/v3/users/aacbd6bcc6a54016a32a2fecae99d5f8` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:36.308303 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c687070e-33e6-42c8-8be3-510a33805594 None admin] RBAC: Authorizing `identity:get_user(user_id=aacbd6bcc6a54016a32a2fecae99d5f8)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:36.310237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c687070e-33e6-42c8-8be3-510a33805594 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:36.311855 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 563/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:42:36 2022] GET /identity/v3/users/aacbd6bcc6a54016a32a2fecae99d5f8 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:36.317677 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce694c-94bd-44a4-9d71-86c3ccc7435b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:36.366904 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:36.416673 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce694c-94bd-44a4-9d71-86c3ccc7435b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:36.450419 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150bef1-7328-4dba-90cb-8fa285b275c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:36.451063 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150bef1-7328-4dba-90cb-8fa285b275c1 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:36.451350 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150bef1-7328-4dba-90cb-8fa285b275c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:36.451626 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150bef1-7328-4dba-90cb-8fa285b275c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:36.517980 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150bef1-7328-4dba-90cb-8fa285b275c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:36.519621 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150bef1-7328-4dba-90cb-8fa285b275c1 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:36.565650 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:36.617359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 565/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:42:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 05:42:36.623777 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687070e-33e6-42c8-8be3-510a33805594 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:36.685566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:36.726587 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687070e-33e6-42c8-8be3-510a33805594 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:36.761084 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cf8c5-1bcc-4073-bf17-6d67c94989eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:36.762587 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cf8c5-1bcc-4073-bf17-6d67c94989eb None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:36.762878 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cf8c5-1bcc-4073-bf17-6d67c94989eb None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:36.763159 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cf8c5-1bcc-4073-bf17-6d67c94989eb None admin] PATH_INFO: `/v3/projects/a93c9e8e5d574c85a8f6a26127950d15` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:36.764364 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cf8c5-1bcc-4073-bf17-6d67c94989eb None admin] RBAC: Authorizing `identity:get_project(project_id=a93c9e8e5d574c85a8f6a26127950d15)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:36.765797 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cf8c5-1bcc-4073-bf17-6d67c94989eb None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:36.767534 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 564/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:42:36 2022] GET /identity/v3/projects/a93c9e8e5d574c85a8f6a26127950d15 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:36.773800 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150bef1-7328-4dba-90cb-8fa285b275c1 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:36.872633 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150bef1-7328-4dba-90cb-8fa285b275c1 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:36.906658 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7d6c1-3516-491d-9b08-c8a105e49055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:36.907320 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7d6c1-3516-491d-9b08-c8a105e49055 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:36.907605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7d6c1-3516-491d-9b08-c8a105e49055 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:36.907913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7d6c1-3516-491d-9b08-c8a105e49055 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:36.908747 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7d6c1-3516-491d-9b08-c8a105e49055 None admin] RBAC: Adding query filter params (role.id=ad23f352111e42de99e9d92fbfe2e1f4, scope.project.id=a93c9e8e5d574c85a8f6a26127950d15, user.id=aacbd6bcc6a54016a32a2fecae99d5f8) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:36.909066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7d6c1-3516-491d-9b08-c8a105e49055 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:36.910549 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7d6c1-3516-491d-9b08-c8a105e49055 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:36.916690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 566/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:42:36 2022] GET /identity/v3/role_assignments?user.id=aacbd6bcc6a54016a32a2fecae99d5f8&scope.project.id=a93c9e8e5d574c85a8f6a26127950d15&role.id=ad23f352111e42de99e9d92fbfe2e1f4 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:38.958397 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a82b6c-4605-4253-ae2a-2673a048d3b0 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:38.958927 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a82b6c-4605-4253-ae2a-2673a048d3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:38.959040 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a82b6c-4605-4253-ae2a-2673a048d3b0 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:38.960350 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 565/1131] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:38.965968 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d307b9-ab0c-44af-ad6e-0443cc74b943 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:38.966340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d307b9-ab0c-44af-ad6e-0443cc74b943 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:38.966518 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d307b9-ab0c-44af-ad6e-0443cc74b943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:38.983664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-12d307b9-ab0c-44af-ad6e-0443cc74b943 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:38.984849 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-12d307b9-ab0c-44af-ad6e-0443cc74b943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:38.992114 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:39.049923 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 567/1132] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:42:39.073194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a82b6c-4605-4253-ae2a-2673a048d3b0 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:39.174744 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a82b6c-4605-4253-ae2a-2673a048d3b0 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:39.206897 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:39.215739 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55722e7-910f-4a62-a871-e508e6d3c416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:39.216462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55722e7-910f-4a62-a871-e508e6d3c416 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:39.216744 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55722e7-910f-4a62-a871-e508e6d3c416 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:39.217022 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55722e7-910f-4a62-a871-e508e6d3c416 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:39.218262 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55722e7-910f-4a62-a871-e508e6d3c416 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:39.219678 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55722e7-910f-4a62-a871-e508e6d3c416 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:39.221282 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 566/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:42:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:39.227136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d307b9-ab0c-44af-ad6e-0443cc74b943 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:39.330613 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d307b9-ab0c-44af-ad6e-0443cc74b943 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:39.368080 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663920cd-b9e7-436e-b3ef-eb2ab7b89d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:39.368749 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663920cd-b9e7-436e-b3ef-eb2ab7b89d21 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:39.369037 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663920cd-b9e7-436e-b3ef-eb2ab7b89d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:39.369319 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663920cd-b9e7-436e-b3ef-eb2ab7b89d21 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:39.370080 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663920cd-b9e7-436e-b3ef-eb2ab7b89d21 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:39.371588 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663920cd-b9e7-436e-b3ef-eb2ab7b89d21 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:39.385790 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:39.400436 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 568/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jun 21 05:42:39 2022] POST /identity/v3/projects => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:42:41.464049 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723a36a-67f2-4d81-982e-f7a09e8adc32 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:41.465064 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723a36a-67f2-4d81-982e-f7a09e8adc32 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:41.465064 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723a36a-67f2-4d81-982e-f7a09e8adc32 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:41.466433 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 567/1135] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:41.472000 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330edfd1-d946-465d-a59e-82b70d789583 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:41.472438 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330edfd1-d946-465d-a59e-82b70d789583 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:41.472544 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330edfd1-d946-465d-a59e-82b70d789583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:41.489768 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-330edfd1-d946-465d-a59e-82b70d789583 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:41.491014 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-330edfd1-d946-465d-a59e-82b70d789583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:41.556188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 569/1136] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:42:41.581267 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723a36a-67f2-4d81-982e-f7a09e8adc32 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:41.681586 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723a36a-67f2-4d81-982e-f7a09e8adc32 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:41.715824 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5631a9-11bc-4534-a8a8-0da508458eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:41.716535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5631a9-11bc-4534-a8a8-0da508458eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:41.716821 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5631a9-11bc-4534-a8a8-0da508458eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:41.717102 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5631a9-11bc-4534-a8a8-0da508458eb9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:41.718303 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5631a9-11bc-4534-a8a8-0da508458eb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:41.719737 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5631a9-11bc-4534-a8a8-0da508458eb9 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:41.721360 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 568/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:42:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:41.727115 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330edfd1-d946-465d-a59e-82b70d789583 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:41.823289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330edfd1-d946-465d-a59e-82b70d789583 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:41.845557 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:41.858311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2262e-a3c8-4db1-8282-e8bf5e1884d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:41.858981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2262e-a3c8-4db1-8282-e8bf5e1884d1 None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:41.859263 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2262e-a3c8-4db1-8282-e8bf5e1884d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:41.859537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2262e-a3c8-4db1-8282-e8bf5e1884d1 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:41.860241 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2262e-a3c8-4db1-8282-e8bf5e1884d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:41.861680 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2262e-a3c8-4db1-8282-e8bf5e1884d1 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:41.881598 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 570/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 21 05:42:41 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:42:43.947727 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61411b4a-dad7-46fc-ba27-c5717621c171 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:43.948259 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61411b4a-dad7-46fc-ba27-c5717621c171 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:43.948893 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61411b4a-dad7-46fc-ba27-c5717621c171 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:43.950200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 569/1139] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:43.955385 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff90c37-e41c-4bc1-a3fc-5fc1a37f055d None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:43.955832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff90c37-e41c-4bc1-a3fc-5fc1a37f055d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:43.955940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff90c37-e41c-4bc1-a3fc-5fc1a37f055d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:43.973185 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-9ff90c37-e41c-4bc1-a3fc-5fc1a37f055d None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:43.974441 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-9ff90c37-e41c-4bc1-a3fc-5fc1a37f055d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:44.049634 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 571/1140] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:42:44.073156 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61411b4a-dad7-46fc-ba27-c5717621c171 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:44.138024 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:44.175855 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61411b4a-dad7-46fc-ba27-c5717621c171 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:44.211912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89cb75-62eb-43a7-8fb0-cb8c27ba08b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:44.212612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89cb75-62eb-43a7-8fb0-cb8c27ba08b3 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:44.212895 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89cb75-62eb-43a7-8fb0-cb8c27ba08b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:44.213172 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89cb75-62eb-43a7-8fb0-cb8c27ba08b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:44.223108 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89cb75-62eb-43a7-8fb0-cb8c27ba08b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:42:44.230923 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-0f89cb75-62eb-43a7-8fb0-cb8c27ba08b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:42:44.230923 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:44.230923 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:44.230923 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:44.230923 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:44.230923 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:44.230923 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:44.230923 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:44.230923 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:44.230923 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:44.230923 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:44.230923 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:44.230923 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:42:44.230923 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:42:44.230923 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:42:44.230923 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:42:44.232048 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:42:44.232048 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:42:44.232048 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:42:44.232048 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:42:44.232048 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:44.232048 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:44.232048 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:44.232048 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:44.232048 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:44.232048 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:44.232048 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:44.232048 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:44.232048 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:44.232048 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:44.232048 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:44.232048 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:44.232936 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:44.232936 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:44.232936 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:44.232936 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:44.232936 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:42:44.232936 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:42:44.232936 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:42:44.232936 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:42:44.232936 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:42:44.232936 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:42:44.232936 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:42:44.232936 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:44.232936 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 570/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:42:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:42:44.238316 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff90c37-e41c-4bc1-a3fc-5fc1a37f055d None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:44.337096 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff90c37-e41c-4bc1-a3fc-5fc1a37f055d None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:44.348821 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:44.373769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb21e5b-1ab7-4ff1-984f-386077efa8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:44.374471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb21e5b-1ab7-4ff1-984f-386077efa8fe None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:44.374758 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb21e5b-1ab7-4ff1-984f-386077efa8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:44.375038 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb21e5b-1ab7-4ff1-984f-386077efa8fe None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:44.375788 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb21e5b-1ab7-4ff1-984f-386077efa8fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:44.376099 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb21e5b-1ab7-4ff1-984f-386077efa8fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:44.378646 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb21e5b-1ab7-4ff1-984f-386077efa8fe None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:44.389872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 572/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:42:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:44.395949 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89cb75-62eb-43a7-8fb0-cb8c27ba08b3 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:44.494277 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89cb75-62eb-43a7-8fb0-cb8c27ba08b3 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:44.516757 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:44.527879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47b511-2af1-4c7f-93d4-7d9c8e072fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:44.528763 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47b511-2af1-4c7f-93d4-7d9c8e072fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:44.529048 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47b511-2af1-4c7f-93d4-7d9c8e072fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:44.529327 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47b511-2af1-4c7f-93d4-7d9c8e072fa0 None admin] PATH_INFO: `/v3/users/5fe09c90f1ca4f048aa680613a438c72` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:44.543211 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47b511-2af1-4c7f-93d4-7d9c8e072fa0 None admin] RBAC: Authorizing `identity:get_user(user_id=5fe09c90f1ca4f048aa680613a438c72)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:44.544654 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47b511-2af1-4c7f-93d4-7d9c8e072fa0 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:44.546347 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 571/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:42:44 2022] GET /identity/v3/users/5fe09c90f1ca4f048aa680613a438c72 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:44.552234 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb21e5b-1ab7-4ff1-984f-386077efa8fe None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:44.649880 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb21e5b-1ab7-4ff1-984f-386077efa8fe None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:44.683451 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bf708-9abe-4d8a-9316-41affcd5b3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:44.684100 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bf708-9abe-4d8a-9316-41affcd5b3ec None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:44.684381 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bf708-9abe-4d8a-9316-41affcd5b3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:44.684655 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bf708-9abe-4d8a-9316-41affcd5b3ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:44.726388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:44.756038 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650bf708-9abe-4d8a-9316-41affcd5b3ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:44.757404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650bf708-9abe-4d8a-9316-41affcd5b3ec None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:44.855408 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 573/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:42:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 05:42:44.861500 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47b511-2af1-4c7f-93d4-7d9c8e072fa0 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:44.959158 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47b511-2af1-4c7f-93d4-7d9c8e072fa0 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:44.993071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba39e47-59a3-4edf-a4a8-369cb0e9da58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:44.993964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba39e47-59a3-4edf-a4a8-369cb0e9da58 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:44.994411 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba39e47-59a3-4edf-a4a8-369cb0e9da58 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:44.994687 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba39e47-59a3-4edf-a4a8-369cb0e9da58 None admin] PATH_INFO: `/v3/projects/6589a10b95b74a0bb215970a6fc5271a` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:44.995857 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba39e47-59a3-4edf-a4a8-369cb0e9da58 None admin] RBAC: Authorizing `identity:get_project(project_id=6589a10b95b74a0bb215970a6fc5271a)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:44.997305 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba39e47-59a3-4edf-a4a8-369cb0e9da58 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:44.999023 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 572/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:42:44 2022] GET /identity/v3/projects/6589a10b95b74a0bb215970a6fc5271a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:45.005153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bf708-9abe-4d8a-9316-41affcd5b3ec None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:45.074603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:45.104186 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bf708-9abe-4d8a-9316-41affcd5b3ec None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:45.138571 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da188d8-5f68-4e66-83cf-dff98e3f19c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:45.139226 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da188d8-5f68-4e66-83cf-dff98e3f19c9 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:45.139513 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da188d8-5f68-4e66-83cf-dff98e3f19c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:45.139793 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da188d8-5f68-4e66-83cf-dff98e3f19c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:45.142807 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da188d8-5f68-4e66-83cf-dff98e3f19c9 None admin] RBAC: Adding query filter params (role.id=24aa6040c86049f996560e477e83886f, scope.project.id=6589a10b95b74a0bb215970a6fc5271a, user.id=5fe09c90f1ca4f048aa680613a438c72) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:45.142807 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da188d8-5f68-4e66-83cf-dff98e3f19c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:45.142807 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da188d8-5f68-4e66-83cf-dff98e3f19c9 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:45.148198 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 574/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:42:45 2022] GET /identity/v3/role_assignments?user.id=5fe09c90f1ca4f048aa680613a438c72&scope.project.id=6589a10b95b74a0bb215970a6fc5271a&role.id=24aa6040c86049f996560e477e83886f => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:47.175658 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e435fb-fbe6-4b55-a695-cf3d86bfa812 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:47.176219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e435fb-fbe6-4b55-a695-cf3d86bfa812 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:47.176219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e435fb-fbe6-4b55-a695-cf3d86bfa812 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:47.177584 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 573/1147] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:47.183476 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7797dac-dd3b-427a-bff2-c98239d8f36b None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:47.183869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7797dac-dd3b-427a-bff2-c98239d8f36b None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:47.184028 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7797dac-dd3b-427a-bff2-c98239d8f36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:47.202161 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-d7797dac-dd3b-427a-bff2-c98239d8f36b None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:47.203356 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d7797dac-dd3b-427a-bff2-c98239d8f36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:47.270907 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 575/1148] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:42:47.294079 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e435fb-fbe6-4b55-a695-cf3d86bfa812 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:47.344857 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:47.395400 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e435fb-fbe6-4b55-a695-cf3d86bfa812 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:47.428829 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1492bf0-6bf9-4804-b0de-6c8c2f18a549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:47.429628 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1492bf0-6bf9-4804-b0de-6c8c2f18a549 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:47.429917 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1492bf0-6bf9-4804-b0de-6c8c2f18a549 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:47.430227 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1492bf0-6bf9-4804-b0de-6c8c2f18a549 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:47.441291 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1492bf0-6bf9-4804-b0de-6c8c2f18a549 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:42:47.449640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-b1492bf0-6bf9-4804-b0de-6c8c2f18a549 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:42:47.449640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:47.449640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:47.449640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:47.449640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:47.449640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:47.449640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:47.449640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:47.449640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:47.449640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:47.449640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:47.449640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:47.449640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:42:47.449640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:42:47.449640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:42:47.449640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:42:47.450784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:42:47.450784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:42:47.450784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:42:47.450784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:42:47.450784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:47.450784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:47.450784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:47.450784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:47.450784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:47.450784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:47.450784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:47.450784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:47.450784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:47.450784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:47.450784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:47.450784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:47.451826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:47.451826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:47.451826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:47.451826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:47.451826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:42:47.451826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:42:47.451826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:42:47.451826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:42:47.451826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:42:47.451826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:42:47.451826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:42:47.451826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:47.451826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 574/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:42:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:42:47.457240 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7797dac-dd3b-427a-bff2-c98239d8f36b None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:47.528426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:47.562804 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7797dac-dd3b-427a-bff2-c98239d8f36b None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:47.597342 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67aeea2-035d-40ce-b0b1-5b2ab158d2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:47.598026 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67aeea2-035d-40ce-b0b1-5b2ab158d2aa None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:47.598311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67aeea2-035d-40ce-b0b1-5b2ab158d2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:47.598590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67aeea2-035d-40ce-b0b1-5b2ab158d2aa None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:47.599331 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67aeea2-035d-40ce-b0b1-5b2ab158d2aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:47.599637 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67aeea2-035d-40ce-b0b1-5b2ab158d2aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:47.601004 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67aeea2-035d-40ce-b0b1-5b2ab158d2aa None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:47.609245 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 576/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:42:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:47.615033 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1492bf0-6bf9-4804-b0de-6c8c2f18a549 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:47.721144 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1492bf0-6bf9-4804-b0de-6c8c2f18a549 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:47.732228 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:47.755766 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6dafc9-35f1-4e5e-b2b9-0608fbcfbe85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:47.756644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6dafc9-35f1-4e5e-b2b9-0608fbcfbe85 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:47.756932 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6dafc9-35f1-4e5e-b2b9-0608fbcfbe85 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:47.757214 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6dafc9-35f1-4e5e-b2b9-0608fbcfbe85 None admin] PATH_INFO: `/v3/users/5fe09c90f1ca4f048aa680613a438c72` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:47.758441 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6dafc9-35f1-4e5e-b2b9-0608fbcfbe85 None admin] RBAC: Authorizing `identity:get_user(user_id=5fe09c90f1ca4f048aa680613a438c72)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:47.759877 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6dafc9-35f1-4e5e-b2b9-0608fbcfbe85 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:47.762094 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 575/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:42:47 2022] GET /identity/v3/users/5fe09c90f1ca4f048aa680613a438c72 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:47.768395 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67aeea2-035d-40ce-b0b1-5b2ab158d2aa None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:47.874672 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67aeea2-035d-40ce-b0b1-5b2ab158d2aa None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:47.901835 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:47.909907 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecd2d5-5ebb-408b-b158-05fa90b97847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:47.910804 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecd2d5-5ebb-408b-b158-05fa90b97847 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:47.911090 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecd2d5-5ebb-408b-b158-05fa90b97847 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:47.911369 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecd2d5-5ebb-408b-b158-05fa90b97847 None admin] PATH_INFO: `/v3/projects/6589a10b95b74a0bb215970a6fc5271a` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:47.912577 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eecd2d5-5ebb-408b-b158-05fa90b97847 None admin] RBAC: Authorizing `identity:get_project(project_id=6589a10b95b74a0bb215970a6fc5271a)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:47.914057 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eecd2d5-5ebb-408b-b158-05fa90b97847 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:47.915798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 577/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:42:47 2022] GET /identity/v3/projects/6589a10b95b74a0bb215970a6fc5271a => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:47.922433 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6dafc9-35f1-4e5e-b2b9-0608fbcfbe85 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:48.028326 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6dafc9-35f1-4e5e-b2b9-0608fbcfbe85 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:48.061442 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f14a9-5b8e-4cd1-807d-e795f1d353b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:48.062506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f14a9-5b8e-4cd1-807d-e795f1d353b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:48.062791 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f14a9-5b8e-4cd1-807d-e795f1d353b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:48.063069 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f14a9-5b8e-4cd1-807d-e795f1d353b7 None admin] PATH_INFO: `/v3/projects/6589a10b95b74a0bb215970a6fc5271a/users/5fe09c90f1ca4f048aa680613a438c72/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:48.065012 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f14a9-5b8e-4cd1-807d-e795f1d353b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=6589a10b95b74a0bb215970a6fc5271a, user_id=5fe09c90f1ca4f048aa680613a438c72, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:48.066468 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f14a9-5b8e-4cd1-807d-e795f1d353b7 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:48.080533 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 576/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 21 05:42:47 2022] PUT /identity/v3/projects/6589a10b95b74a0bb215970a6fc5271a/users/5fe09c90f1ca4f048aa680613a438c72/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:42:50.097229 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc6f57-92fc-43fe-8ddb-e330d40f51c1 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:50.097792 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc6f57-92fc-43fe-8ddb-e330d40f51c1 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:50.097887 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc6f57-92fc-43fe-8ddb-e330d40f51c1 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:50.099335 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 578/1154] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:50.105073 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a9a88-e20b-4bc6-bb63-bbbafe62a1de None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:50.105463 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a9a88-e20b-4bc6-bb63-bbbafe62a1de None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:50.105631 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a9a88-e20b-4bc6-bb63-bbbafe62a1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:50.122781 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-358a9a88-e20b-4bc6-bb63-bbbafe62a1de None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:50.123962 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-358a9a88-e20b-4bc6-bb63-bbbafe62a1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:50.153104 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:50.191254 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 577/1155] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:42:50.216551 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc6f57-92fc-43fe-8ddb-e330d40f51c1 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:50.318825 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc6f57-92fc-43fe-8ddb-e330d40f51c1 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:50.352350 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65e170-135d-40f2-9cfc-95dfac37a292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:50.353052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65e170-135d-40f2-9cfc-95dfac37a292 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:50.353336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65e170-135d-40f2-9cfc-95dfac37a292 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:50.353614 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65e170-135d-40f2-9cfc-95dfac37a292 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:50.365464 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65e170-135d-40f2-9cfc-95dfac37a292 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:42:50.373074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-4c65e170-135d-40f2-9cfc-95dfac37a292 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:42:50.373074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:50.373074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:50.373074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:50.373074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:50.373074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:50.373074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:50.373074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:50.373074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:50.373074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:50.373074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:50.373074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:50.373074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:42:50.373074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:42:50.373074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:42:50.373074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:42:50.374167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:42:50.374167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:42:50.374167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:42:50.374167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:42:50.374167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:50.374167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:50.374167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:50.374167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:50.374167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:50.374167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:50.374167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:50.374167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:50.374167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:50.374167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:50.374167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:50.374167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:50.375236 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:50.375236 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:50.375236 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:50.375236 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:50.375236 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:42:50.375236 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:42:50.375236 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:42:50.375236 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:42:50.375236 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:42:50.375236 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:42:50.375236 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:42:50.375236 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:42:50.375236 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 579/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:42:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:42:50.380382 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a9a88-e20b-4bc6-bb63-bbbafe62a1de None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:50.478031 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a9a88-e20b-4bc6-bb63-bbbafe62a1de None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:50.512138 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efee15-6744-48f8-9ae6-6a9bc867cd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:50.512799 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efee15-6744-48f8-9ae6-6a9bc867cd8c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:50.513087 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efee15-6744-48f8-9ae6-6a9bc867cd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:50.513366 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efee15-6744-48f8-9ae6-6a9bc867cd8c None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:50.514146 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65efee15-6744-48f8-9ae6-6a9bc867cd8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:50.514454 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65efee15-6744-48f8-9ae6-6a9bc867cd8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:50.515819 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65efee15-6744-48f8-9ae6-6a9bc867cd8c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:50.524005 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 578/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:42:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:50.530462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65e170-135d-40f2-9cfc-95dfac37a292 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:50.586877 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:50.632477 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65e170-135d-40f2-9cfc-95dfac37a292 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:50.666022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3d7f4-5165-48b5-9c05-e09683007e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:50.666930 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3d7f4-5165-48b5-9c05-e09683007e1c None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:50.667212 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3d7f4-5165-48b5-9c05-e09683007e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:50.667485 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3d7f4-5165-48b5-9c05-e09683007e1c None admin] PATH_INFO: `/v3/users/5fe09c90f1ca4f048aa680613a438c72` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:50.668660 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3d7f4-5165-48b5-9c05-e09683007e1c None admin] RBAC: Authorizing `identity:get_user(user_id=5fe09c90f1ca4f048aa680613a438c72)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:50.670113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3d7f4-5165-48b5-9c05-e09683007e1c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:50.671721 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 580/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:42:50 2022] GET /identity/v3/users/5fe09c90f1ca4f048aa680613a438c72 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:50.677500 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efee15-6744-48f8-9ae6-6a9bc867cd8c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:50.708539 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:50.782671 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efee15-6744-48f8-9ae6-6a9bc867cd8c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:50.815841 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd8650-ac6c-4e30-bcee-654303492378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:50.816494 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd8650-ac6c-4e30-bcee-654303492378 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:50.816783 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd8650-ac6c-4e30-bcee-654303492378 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:50.817066 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd8650-ac6c-4e30-bcee-654303492378 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:50.888529 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd8650-ac6c-4e30-bcee-654303492378 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:50.889894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd8650-ac6c-4e30-bcee-654303492378 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:50.917818 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:50.987231 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 579/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:42:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 05:42:50.993116 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3d7f4-5165-48b5-9c05-e09683007e1c None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:51.088829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3d7f4-5165-48b5-9c05-e09683007e1c None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:51.113786 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:51.125888 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2d027-0cc1-4532-92da-f74918ff7621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:51.126769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2d027-0cc1-4532-92da-f74918ff7621 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:51.127049 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2d027-0cc1-4532-92da-f74918ff7621 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:51.127320 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2d027-0cc1-4532-92da-f74918ff7621 None admin] PATH_INFO: `/v3/projects/6589a10b95b74a0bb215970a6fc5271a` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:51.128485 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2d027-0cc1-4532-92da-f74918ff7621 None admin] RBAC: Authorizing `identity:get_project(project_id=6589a10b95b74a0bb215970a6fc5271a)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:51.129915 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2d027-0cc1-4532-92da-f74918ff7621 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:51.131642 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 581/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:42:50 2022] GET /identity/v3/projects/6589a10b95b74a0bb215970a6fc5271a => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:51.138601 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd8650-ac6c-4e30-bcee-654303492378 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:51.236366 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd8650-ac6c-4e30-bcee-654303492378 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:51.265003 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:51.271154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebacb9-0e48-4740-89db-a09ea746aaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:51.271809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebacb9-0e48-4740-89db-a09ea746aaf7 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:51.272091 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebacb9-0e48-4740-89db-a09ea746aaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:51.272368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebacb9-0e48-4740-89db-a09ea746aaf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:51.273189 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ebacb9-0e48-4740-89db-a09ea746aaf7 None admin] RBAC: Adding query filter params (role.id=24aa6040c86049f996560e477e83886f, scope.project.id=6589a10b95b74a0bb215970a6fc5271a, user.id=5fe09c90f1ca4f048aa680613a438c72) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:51.273500 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ebacb9-0e48-4740-89db-a09ea746aaf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:51.274945 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ebacb9-0e48-4740-89db-a09ea746aaf7 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:51.280986 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 580/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:42:51 2022] GET /identity/v3/role_assignments?user.id=5fe09c90f1ca4f048aa680613a438c72&scope.project.id=6589a10b95b74a0bb215970a6fc5271a&role.id=24aa6040c86049f996560e477e83886f => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:53.325907 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fe05c-a6a4-4c2b-8fe0-7e4b6e95ba4c None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:53.326607 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fe05c-a6a4-4c2b-8fe0-7e4b6e95ba4c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:53.326607 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fe05c-a6a4-4c2b-8fe0-7e4b6e95ba4c None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:53.327859 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 582/1162] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:53.333000 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2fa18-8df0-4bd1-9869-088978b1d417 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:53.333422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2fa18-8df0-4bd1-9869-088978b1d417 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:53.333562 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2fa18-8df0-4bd1-9869-088978b1d417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:53.350338 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-9ed2fa18-8df0-4bd1-9869-088978b1d417 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:53.351511 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9ed2fa18-8df0-4bd1-9869-088978b1d417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:53.415616 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 581/1163] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:42:53.438159 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fe05c-a6a4-4c2b-8fe0-7e4b6e95ba4c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:53.537273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fe05c-a6a4-4c2b-8fe0-7e4b6e95ba4c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:53.569656 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643bee0-bb07-4f49-9897-15f42f1df5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:53.570316 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643bee0-bb07-4f49-9897-15f42f1df5fc None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:53.570598 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643bee0-bb07-4f49-9897-15f42f1df5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:53.570873 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643bee0-bb07-4f49-9897-15f42f1df5fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:53.627347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:53.637091 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643bee0-bb07-4f49-9897-15f42f1df5fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:53.638562 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643bee0-bb07-4f49-9897-15f42f1df5fc None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:53.732247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 583/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:42:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 05:42:53.738251 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2fa18-8df0-4bd1-9869-088978b1d417 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:53.835519 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2fa18-8df0-4bd1-9869-088978b1d417 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:53.858961 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:53.870439 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b819c-5ad0-4e48-a4e5-4f400f6fabdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:53.871230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b819c-5ad0-4e48-a4e5-4f400f6fabdf None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:53.871509 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b819c-5ad0-4e48-a4e5-4f400f6fabdf None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:53.871785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b819c-5ad0-4e48-a4e5-4f400f6fabdf None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:53.878379 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b819c-5ad0-4e48-a4e5-4f400f6fabdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:53.879798 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b819c-5ad0-4e48-a4e5-4f400f6fabdf None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:53.894217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-fb4b819c-5ad0-4e48-a4e5-4f400f6fabdf None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 21 05:42:53.894217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:53.894217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 21 05:42:53.894217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 21 05:42:53.894217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:42:53.894217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:42:53.894217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:42:53.894217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:42:53.894217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 21 05:42:53.894217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:53.894217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:42:53.894217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:53.894217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:42:53.894217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:42:53.894217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:42:53.894217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:42:53.894217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:42:53.895559 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:42:53.895559 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:42:53.895559 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:42:53.895559 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:42:53.895559 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:42:53.895559 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:42:53.895559 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:42:53.895559 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:42:53.895559 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:42:53.895559 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:42:53.895559 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:42:53.895559 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:42:53.895559 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:42:53.895559 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:42:53.895559 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:42:53.895559 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:42:53.896574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:42:53.896574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:42:53.896574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:42:53.896574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:42:53.896574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:42:53.896574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:42:53.896574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:42:53.896574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:42:53.896574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:42:53.896574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:42:53.896574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 21 05:42:53.896574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:42:53.896574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 21 05:42:53.896574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:42:53.896574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 582/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jun 21 05:42:53 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:42:53.901452 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643bee0-bb07-4f49-9897-15f42f1df5fc None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:53.988342 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:53.997947 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643bee0-bb07-4f49-9897-15f42f1df5fc None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:54.031119 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466dcce-5756-4f62-b76b-eb0d9a8ce90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:54.031774 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466dcce-5756-4f62-b76b-eb0d9a8ce90d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:54.032057 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466dcce-5756-4f62-b76b-eb0d9a8ce90d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:54.032337 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466dcce-5756-4f62-b76b-eb0d9a8ce90d None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:54.033051 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466dcce-5756-4f62-b76b-eb0d9a8ce90d None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:42:54.033360 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466dcce-5756-4f62-b76b-eb0d9a8ce90d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:54.034742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466dcce-5756-4f62-b76b-eb0d9a8ce90d None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:54.041842 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 584/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Jun 21 05:42:53 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:56.056040 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79404b1-903a-4edb-a5e9-b76ce0a92e17 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:56.056608 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79404b1-903a-4edb-a5e9-b76ce0a92e17 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:56.056608 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79404b1-903a-4edb-a5e9-b76ce0a92e17 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:56.058713 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 583/1167] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:56.063893 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77a86f-50a7-46f4-ab87-acf0f523ae25 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:56.064284 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77a86f-50a7-46f4-ab87-acf0f523ae25 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:56.064448 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77a86f-50a7-46f4-ab87-acf0f523ae25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:56.080570 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-8d77a86f-50a7-46f4-ab87-acf0f523ae25 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:56.081742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8d77a86f-50a7-46f4-ab87-acf0f523ae25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:56.146716 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 585/1168] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:42:56.170391 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79404b1-903a-4edb-a5e9-b76ce0a92e17 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:56.274641 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79404b1-903a-4edb-a5e9-b76ce0a92e17 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:56.309394 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8d4e2-ac0a-4e97-b584-3bd06384cc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:56.310054 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8d4e2-ac0a-4e97-b584-3bd06384cc44 None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:56.310364 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8d4e2-ac0a-4e97-b584-3bd06384cc44 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:56.310675 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8d4e2-ac0a-4e97-b584-3bd06384cc44 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:56.311484 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8d4e2-ac0a-4e97-b584-3bd06384cc44 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:56.312933 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8d4e2-ac0a-4e97-b584-3bd06384cc44 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:56.328918 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 584/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Tue Jun 21 05:42:56 2022] POST /identity/v3/domains => generated 267 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:42:58.369812 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63bf69-5aad-45fa-9302-fb998165e8d2 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:58.370379 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63bf69-5aad-45fa-9302-fb998165e8d2 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:58.370660 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63bf69-5aad-45fa-9302-fb998165e8d2 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:58.372275 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 586/1170] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:42:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:42:58.377736 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fa9e0-9c8e-4898-a984-bf56bb299f31 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:58.378252 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fa9e0-9c8e-4898-a984-bf56bb299f31 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:58.378347 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fa9e0-9c8e-4898-a984-bf56bb299f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:58.395443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-4b4fa9e0-9c8e-4898-a984-bf56bb299f31 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:42:58.396640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4b4fa9e0-9c8e-4898-a984-bf56bb299f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:42:58.438936 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:58.468116 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 585/1171] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:42:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:42:58.492090 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63bf69-5aad-45fa-9302-fb998165e8d2 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:58.582592 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:42:58.599678 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63bf69-5aad-45fa-9302-fb998165e8d2 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:58.633757 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fad227-6c1a-42cf-8bbb-27d81fd1652c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:58.634573 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fad227-6c1a-42cf-8bbb-27d81fd1652c None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:58.634855 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fad227-6c1a-42cf-8bbb-27d81fd1652c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:58.635700 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fad227-6c1a-42cf-8bbb-27d81fd1652c None admin] PATH_INFO: `/v3/domains/69eabf8c2b6849a1acbd838175c8b975` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:58.646572 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fad227-6c1a-42cf-8bbb-27d81fd1652c None admin] RBAC: Authorizing `identity:get_domain(domain_id=69eabf8c2b6849a1acbd838175c8b975)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:58.648019 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fad227-6c1a-42cf-8bbb-27d81fd1652c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:58.649817 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 587/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Tue Jun 21 05:42:58 2022] GET /identity/v3/domains/69eabf8c2b6849a1acbd838175c8b975 => generated 267 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:42:58.655777 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fa9e0-9c8e-4898-a984-bf56bb299f31 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:42:58.754141 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fa9e0-9c8e-4898-a984-bf56bb299f31 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:42:58.787922 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a744909-9e7a-450c-82e1-1929bff1ed8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:42:58.788584 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a744909-9e7a-450c-82e1-1929bff1ed8b None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:42:58.788869 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a744909-9e7a-450c-82e1-1929bff1ed8b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:42:58.789477 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a744909-9e7a-450c-82e1-1929bff1ed8b None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:42:58.790225 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a744909-9e7a-450c-82e1-1929bff1ed8b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:42:58.792190 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a744909-9e7a-450c-82e1-1929bff1ed8b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:42:58.817233 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 586/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jun 21 05:42:58 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:43:00.912908 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56749208-ce65-47b7-8dcd-e57ac3d7c15d None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:43:00.913441 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56749208-ce65-47b7-8dcd-e57ac3d7c15d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:43:00.913441 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56749208-ce65-47b7-8dcd-e57ac3d7c15d None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:43:00.914861 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 588/1174] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:43:00.920558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678b4d7-0f4b-4dc0-9473-773a98257c38 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:43:00.920956 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678b4d7-0f4b-4dc0-9473-773a98257c38 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:43:00.921119 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678b4d7-0f4b-4dc0-9473-773a98257c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:43:00.937366 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-5678b4d7-0f4b-4dc0-9473-773a98257c38 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:43:00.938580 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-5678b4d7-0f4b-4dc0-9473-773a98257c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:43:00.957851 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:43:01.004157 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 587/1175] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:43:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:43:01.030506 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56749208-ce65-47b7-8dcd-e57ac3d7c15d None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:43:01.131564 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56749208-ce65-47b7-8dcd-e57ac3d7c15d None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:43:01.164780 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2a805-87eb-4f9b-b187-1a26d1084ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:43:01.165582 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2a805-87eb-4f9b-b187-1a26d1084ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:43:01.165862 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2a805-87eb-4f9b-b187-1a26d1084ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:43:01.166189 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2a805-87eb-4f9b-b187-1a26d1084ac4 None admin] PATH_INFO: `/v3/domains/69eabf8c2b6849a1acbd838175c8b975` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:43:01.167344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2a805-87eb-4f9b-b187-1a26d1084ac4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=69eabf8c2b6849a1acbd838175c8b975)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:43:01.168764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2a805-87eb-4f9b-b187-1a26d1084ac4 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:43:01.170474 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 589/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Tue Jun 21 05:43:01 2022] GET /identity/v3/domains/69eabf8c2b6849a1acbd838175c8b975 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:43:01.176339 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678b4d7-0f4b-4dc0-9473-773a98257c38 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:43:01.273089 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678b4d7-0f4b-4dc0-9473-773a98257c38 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:43:01.307255 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837034a-64b9-4229-89a5-9c84fcf8c91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:43:01.307917 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837034a-64b9-4229-89a5-9c84fcf8c91e None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:43:01.308206 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837034a-64b9-4229-89a5-9c84fcf8c91e None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:43:01.308486 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837034a-64b9-4229-89a5-9c84fcf8c91e None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:43:01.309205 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837034a-64b9-4229-89a5-9c84fcf8c91e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:43:01.310665 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837034a-64b9-4229-89a5-9c84fcf8c91e None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:43:01.330704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 588/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 21 05:43:01 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:43:03.408294 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a04c1-1ff9-4f19-a1ce-d8c61c7320e7 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:43:03.408791 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a04c1-1ff9-4f19-a1ce-d8c61c7320e7 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:43:03.408791 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a04c1-1ff9-4f19-a1ce-d8c61c7320e7 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:43:03.410179 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 590/1178] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 05:43:03.415359 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737b26d-1ebc-4b2c-b088-c6a4f760ff92 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:43:03.415798 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737b26d-1ebc-4b2c-b088-c6a4f760ff92 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:43:03.415930 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737b26d-1ebc-4b2c-b088-c6a4f760ff92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:43:03.432417 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-e737b26d-1ebc-4b2c-b088-c6a4f760ff92 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:43:03.433598 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e737b26d-1ebc-4b2c-b088-c6a4f760ff92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:43:03.440772 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:43:03.500903 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 589/1179] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:43:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:43:03.524621 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a04c1-1ff9-4f19-a1ce-d8c61c7320e7 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:43:03.541072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:43:03.627208 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a04c1-1ff9-4f19-a1ce-d8c61c7320e7 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:43:03.661360 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2c456-dd9d-4a11-9c26-9e8cce818aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:43:03.662107 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2c456-dd9d-4a11-9c26-9e8cce818aef None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:43:03.662393 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2c456-dd9d-4a11-9c26-9e8cce818aef None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:43:03.662672 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2c456-dd9d-4a11-9c26-9e8cce818aef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:43:03.672960 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2c456-dd9d-4a11-9c26-9e8cce818aef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:43:03.680585 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-09b2c456-dd9d-4a11-9c26-9e8cce818aef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:43:03.680585 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:43:03.680585 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:43:03.680585 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:43:03.680585 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:43:03.680585 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:43:03.680585 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:43:03.680585 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:43:03.680585 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:43:03.680585 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:43:03.680585 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:43:03.680585 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:43:03.680585 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:43:03.680585 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:43:03.680585 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:43:03.680585 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:43:03.682259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:43:03.682259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:43:03.682259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:43:03.682259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:43:03.682259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:43:03.682259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:43:03.682259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:43:03.682259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:43:03.682259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:43:03.682259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:43:03.682259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:43:03.682259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:43:03.682259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:43:03.682259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:43:03.682259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:43:03.682259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:43:03.683179 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:43:03.683179 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:43:03.683179 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:43:03.683179 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:43:03.683179 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:43:03.683179 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:43:03.683179 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:43:03.683179 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:43:03.683179 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:43:03.683179 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:43:03.683179 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:43:03.683179 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:43:03.683179 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 591/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:43:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:43:03.688503 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737b26d-1ebc-4b2c-b088-c6a4f760ff92 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:43:03.785612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737b26d-1ebc-4b2c-b088-c6a4f760ff92 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:43:03.819657 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852b615-6025-417e-a39a-997e721be017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:43:03.820319 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852b615-6025-417e-a39a-997e721be017 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:43:03.820601 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852b615-6025-417e-a39a-997e721be017 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:43:03.820878 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852b615-6025-417e-a39a-997e721be017 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:43:03.821615 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852b615-6025-417e-a39a-997e721be017 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:43:03.821921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852b615-6025-417e-a39a-997e721be017 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:43:03.823964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852b615-6025-417e-a39a-997e721be017 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:43:03.831851 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 590/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:43:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:43:03.837777 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2c456-dd9d-4a11-9c26-9e8cce818aef None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:43:03.917362 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:43:03.942470 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2c456-dd9d-4a11-9c26-9e8cce818aef None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:43:03.975227 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcfeaf7-40ff-48f2-976d-d1b930ce8a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:43:03.976085 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfeaf7-40ff-48f2-976d-d1b930ce8a59 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:43:03.976365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfeaf7-40ff-48f2-976d-d1b930ce8a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:43:03.976636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfeaf7-40ff-48f2-976d-d1b930ce8a59 None admin] PATH_INFO: `/v3/users/0c58ae95941542e590c988e8a6b60979` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:43:03.989491 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcfeaf7-40ff-48f2-976d-d1b930ce8a59 None admin] RBAC: Authorizing `identity:get_user(user_id=0c58ae95941542e590c988e8a6b60979)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:43:03.990943 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcfeaf7-40ff-48f2-976d-d1b930ce8a59 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:43:03.992585 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 592/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:43:03 2022] GET /identity/v3/users/0c58ae95941542e590c988e8a6b60979 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:43:03.998924 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852b615-6025-417e-a39a-997e721be017 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:43:04.002719 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:43:04.112766 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852b615-6025-417e-a39a-997e721be017 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:43:04.147514 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21402c8-7b67-4b40-a237-0113ef9fecc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:43:04.148173 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21402c8-7b67-4b40-a237-0113ef9fecc3 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:43:04.148460 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21402c8-7b67-4b40-a237-0113ef9fecc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:43:04.148740 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21402c8-7b67-4b40-a237-0113ef9fecc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:43:04.219488 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21402c8-7b67-4b40-a237-0113ef9fecc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:43:04.220863 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21402c8-7b67-4b40-a237-0113ef9fecc3 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:43:04.223614 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:43:04.324471 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 591/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:43:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 05:43:04.330347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcfeaf7-40ff-48f2-976d-d1b930ce8a59 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:43:04.427134 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcfeaf7-40ff-48f2-976d-d1b930ce8a59 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:43:04.454994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:43:04.460296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998e8ba-b5c6-43af-87c3-43bbf6f56b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:43:04.461148 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998e8ba-b5c6-43af-87c3-43bbf6f56b29 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:43:04.461433 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998e8ba-b5c6-43af-87c3-43bbf6f56b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:43:04.461711 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998e8ba-b5c6-43af-87c3-43bbf6f56b29 None admin] PATH_INFO: `/v3/projects/f8370e7f0b334043b6a39a84a37ab768` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:43:04.463431 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998e8ba-b5c6-43af-87c3-43bbf6f56b29 None admin] RBAC: Authorizing `identity:get_project(project_id=f8370e7f0b334043b6a39a84a37ab768)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:43:04.464854 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998e8ba-b5c6-43af-87c3-43bbf6f56b29 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:43:04.466728 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 593/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:43:04 2022] GET /identity/v3/projects/f8370e7f0b334043b6a39a84a37ab768 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:43:04.472898 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21402c8-7b67-4b40-a237-0113ef9fecc3 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:43:04.569195 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21402c8-7b67-4b40-a237-0113ef9fecc3 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:43:04.571730 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:43:04.605587 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6476f-30d7-40e1-a9f4-ca4d51223ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:43:04.606272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6476f-30d7-40e1-a9f4-ca4d51223ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:43:04.606557 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6476f-30d7-40e1-a9f4-ca4d51223ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:43:04.606835 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6476f-30d7-40e1-a9f4-ca4d51223ee8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:43:04.607659 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6476f-30d7-40e1-a9f4-ca4d51223ee8 None admin] RBAC: Adding query filter params (role.id=24aa6040c86049f996560e477e83886f, scope.project.id=f8370e7f0b334043b6a39a84a37ab768, user.id=0c58ae95941542e590c988e8a6b60979) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:43:04.607971 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6476f-30d7-40e1-a9f4-ca4d51223ee8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:43:04.609396 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6476f-30d7-40e1-a9f4-ca4d51223ee8 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:43:04.614792 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 592/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:43:04 2022] GET /identity/v3/role_assignments?user.id=0c58ae95941542e590c988e8a6b60979&scope.project.id=f8370e7f0b334043b6a39a84a37ab768&role.id=24aa6040c86049f996560e477e83886f => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:43:06.653259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c553989-5126-4c0a-9431-843db7aa50af None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:43:06.653799 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c553989-5126-4c0a-9431-843db7aa50af None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:43:06.653799 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c553989-5126-4c0a-9431-843db7aa50af None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:43:06.655224 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 594/1186] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:43:06.660629 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfe2c7-624e-44d8-9127-d3b187246aa8 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:43:06.661024 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfe2c7-624e-44d8-9127-d3b187246aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:43:06.661183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfe2c7-624e-44d8-9127-d3b187246aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:43:06.678168 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-52dfe2c7-624e-44d8-9127-d3b187246aa8 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:43:06.679369 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-52dfe2c7-624e-44d8-9127-d3b187246aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:43:06.746686 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 593/1187] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:43:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:43:06.769117 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c553989-5126-4c0a-9431-843db7aa50af None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:43:06.876486 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c553989-5126-4c0a-9431-843db7aa50af None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:43:06.909190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765877a1-8931-4fe2-b6ba-56dff5b7e55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:43:06.909909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765877a1-8931-4fe2-b6ba-56dff5b7e55c None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:43:06.910231 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765877a1-8931-4fe2-b6ba-56dff5b7e55c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:43:06.910507 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765877a1-8931-4fe2-b6ba-56dff5b7e55c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:43:06.920347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765877a1-8931-4fe2-b6ba-56dff5b7e55c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:43:06.927959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-765877a1-8931-4fe2-b6ba-56dff5b7e55c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:43:06.927959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:43:06.927959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:43:06.927959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:43:06.927959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:43:06.927959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:43:06.927959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:43:06.927959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:43:06.927959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:43:06.927959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:43:06.927959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:43:06.927959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:43:06.927959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:43:06.927959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:43:06.927959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:43:06.927959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:43:06.929073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:43:06.929073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:43:06.929073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:43:06.929073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:43:06.929073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:43:06.929073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:43:06.929073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:43:06.929073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:43:06.929073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:43:06.929073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:43:06.929073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:43:06.929073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:43:06.929073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:43:06.929073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:43:06.929073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:43:06.929073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:43:06.930154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:43:06.930154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:43:06.930154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:43:06.930154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:43:06.930154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:43:06.930154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:43:06.930154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:43:06.930154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:43:06.930154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:43:06.930154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:43:06.930154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:43:06.930154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:43:06.930154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 595/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:43:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:43:06.935981 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfe2c7-624e-44d8-9127-d3b187246aa8 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:43:07.027578 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:43:07.031896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfe2c7-624e-44d8-9127-d3b187246aa8 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:43:07.066894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e1b0e-992d-4a32-8744-1b19bb1fc88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:43:07.067563 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e1b0e-992d-4a32-8744-1b19bb1fc88b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:43:07.067847 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e1b0e-992d-4a32-8744-1b19bb1fc88b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:43:07.068124 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e1b0e-992d-4a32-8744-1b19bb1fc88b None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:43:07.068864 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e1b0e-992d-4a32-8744-1b19bb1fc88b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:43:07.069172 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e1b0e-992d-4a32-8744-1b19bb1fc88b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:43:07.070562 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e1b0e-992d-4a32-8744-1b19bb1fc88b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:43:07.078519 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 594/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:43:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:43:07.084374 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765877a1-8931-4fe2-b6ba-56dff5b7e55c None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:43:07.144038 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:43:07.184353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765877a1-8931-4fe2-b6ba-56dff5b7e55c None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:43:07.215949 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e599e-9e2a-49dd-bb5b-92049274ca89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:43:07.216841 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e599e-9e2a-49dd-bb5b-92049274ca89 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:43:07.217124 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e599e-9e2a-49dd-bb5b-92049274ca89 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:43:07.217402 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e599e-9e2a-49dd-bb5b-92049274ca89 None admin] PATH_INFO: `/v3/users/0c58ae95941542e590c988e8a6b60979` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:43:07.218598 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e599e-9e2a-49dd-bb5b-92049274ca89 None admin] RBAC: Authorizing `identity:get_user(user_id=0c58ae95941542e590c988e8a6b60979)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:43:07.220026 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e599e-9e2a-49dd-bb5b-92049274ca89 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:43:07.221652 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 596/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:43:07 2022] GET /identity/v3/users/0c58ae95941542e590c988e8a6b60979 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:43:07.227579 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e1b0e-992d-4a32-8744-1b19bb1fc88b None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:43:07.324436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e1b0e-992d-4a32-8744-1b19bb1fc88b None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:43:07.357659 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1c84a-34f2-49e4-a632-c699d4cf22fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:43:07.358530 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1c84a-34f2-49e4-a632-c699d4cf22fb None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:43:07.358814 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1c84a-34f2-49e4-a632-c699d4cf22fb None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:43:07.359094 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1c84a-34f2-49e4-a632-c699d4cf22fb None admin] PATH_INFO: `/v3/projects/f8370e7f0b334043b6a39a84a37ab768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:43:07.360258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1c84a-34f2-49e4-a632-c699d4cf22fb None admin] RBAC: Authorizing `identity:get_project(project_id=f8370e7f0b334043b6a39a84a37ab768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:43:07.361673 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1c84a-34f2-49e4-a632-c699d4cf22fb None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:43:07.363372 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 595/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:43:07 2022] GET /identity/v3/projects/f8370e7f0b334043b6a39a84a37ab768 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:43:07.369857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e599e-9e2a-49dd-bb5b-92049274ca89 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:43:07.469178 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e599e-9e2a-49dd-bb5b-92049274ca89 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:43:07.495057 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:43:07.503367 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43195d30-345c-46ca-898c-b496456136a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:43:07.504248 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43195d30-345c-46ca-898c-b496456136a3 None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:43:07.504537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43195d30-345c-46ca-898c-b496456136a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:43:07.504817 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43195d30-345c-46ca-898c-b496456136a3 None admin] PATH_INFO: `/v3/projects/f8370e7f0b334043b6a39a84a37ab768/users/0c58ae95941542e590c988e8a6b60979/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:43:07.506810 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43195d30-345c-46ca-898c-b496456136a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8370e7f0b334043b6a39a84a37ab768, user_id=0c58ae95941542e590c988e8a6b60979, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:43:07.508249 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43195d30-345c-46ca-898c-b496456136a3 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:43:07.520151 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 597/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 21 05:43:07 2022] PUT /identity/v3/projects/f8370e7f0b334043b6a39a84a37ab768/users/0c58ae95941542e590c988e8a6b60979/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:43:09.563263 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f1c7a-0484-4c5f-b234-bd1f46bb327f None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:43:09.563774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f1c7a-0484-4c5f-b234-bd1f46bb327f None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:43:09.563774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f1c7a-0484-4c5f-b234-bd1f46bb327f None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:43:09.565106 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 596/1193] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:43:09.570646 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf589f-406e-4b71-aafa-f143f04a35fa None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:43:09.571116 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf589f-406e-4b71-aafa-f143f04a35fa None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:43:09.571229 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf589f-406e-4b71-aafa-f143f04a35fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:43:09.591728 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-15bf589f-406e-4b71-aafa-f143f04a35fa None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:43:09.592934 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-15bf589f-406e-4b71-aafa-f143f04a35fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:43:09.670718 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 598/1194] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:43:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:43:09.695207 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f1c7a-0484-4c5f-b234-bd1f46bb327f None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:43:09.735270 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:43:09.812030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f1c7a-0484-4c5f-b234-bd1f46bb327f None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:43:09.847775 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f95241-7445-4644-be08-059a91c58242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:43:09.848493 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f95241-7445-4644-be08-059a91c58242 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:43:09.848774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f95241-7445-4644-be08-059a91c58242 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:43:09.849053 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f95241-7445-4644-be08-059a91c58242 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:43:09.859516 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f95241-7445-4644-be08-059a91c58242 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:43:09.867104 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-75f95241-7445-4644-be08-059a91c58242 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:43:09.867104 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:43:09.867104 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:43:09.867104 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:43:09.867104 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:43:09.867104 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:43:09.867104 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:43:09.867104 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:43:09.867104 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:43:09.867104 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:43:09.867104 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:43:09.867104 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:43:09.867104 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:43:09.867104 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:43:09.867104 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:43:09.867104 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:43:09.868230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:43:09.868230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:43:09.868230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:43:09.868230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:43:09.868230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:43:09.868230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:43:09.868230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:43:09.868230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:43:09.868230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:43:09.868230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:43:09.868230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:43:09.868230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:43:09.868230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:43:09.868230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:43:09.868230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:43:09.868230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:43:09.869774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:43:09.869774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:43:09.869774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:43:09.869774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:43:09.869774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:43:09.869774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:43:09.869774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:43:09.869774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:43:09.869774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:43:09.869774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:43:09.869774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:43:09.869774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:43:09.869774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 597/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:43:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:43:09.875309 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf589f-406e-4b71-aafa-f143f04a35fa None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:43:09.989457 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf589f-406e-4b71-aafa-f143f04a35fa None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:43:10.008601 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:43:10.028196 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5bf86-5322-437a-97cf-cc9ef9d181c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:43:10.028999 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5bf86-5322-437a-97cf-cc9ef9d181c8 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:43:10.029356 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5bf86-5322-437a-97cf-cc9ef9d181c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:43:10.029719 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5bf86-5322-437a-97cf-cc9ef9d181c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:43:10.030701 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5bf86-5322-437a-97cf-cc9ef9d181c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:43:10.031013 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5bf86-5322-437a-97cf-cc9ef9d181c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:43:10.032407 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5bf86-5322-437a-97cf-cc9ef9d181c8 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:43:10.042663 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 599/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:43:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:43:10.048788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f95241-7445-4644-be08-059a91c58242 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:43:10.138553 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:43:10.150565 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f95241-7445-4644-be08-059a91c58242 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:43:10.185310 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d162386-8333-4cf6-823d-5078a586795c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:43:10.186332 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d162386-8333-4cf6-823d-5078a586795c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:43:10.186645 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d162386-8333-4cf6-823d-5078a586795c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:43:10.186927 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d162386-8333-4cf6-823d-5078a586795c None admin] PATH_INFO: `/v3/users/0c58ae95941542e590c988e8a6b60979` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:43:10.188352 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d162386-8333-4cf6-823d-5078a586795c None admin] RBAC: Authorizing `identity:get_user(user_id=0c58ae95941542e590c988e8a6b60979)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:43:10.189806 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d162386-8333-4cf6-823d-5078a586795c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:43:10.191506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 598/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jun 21 05:43:10 2022] GET /identity/v3/users/0c58ae95941542e590c988e8a6b60979 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:43:10.198545 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5bf86-5322-437a-97cf-cc9ef9d181c8 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:43:10.299330 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5bf86-5322-437a-97cf-cc9ef9d181c8 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:43:10.333026 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538685a-68d7-41c9-9cb4-e67561cba251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:43:10.333691 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538685a-68d7-41c9-9cb4-e67561cba251 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:43:10.334005 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538685a-68d7-41c9-9cb4-e67561cba251 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:43:10.334286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538685a-68d7-41c9-9cb4-e67561cba251 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:43:10.383309 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:43:10.403155 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538685a-68d7-41c9-9cb4-e67561cba251 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:43:10.404622 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538685a-68d7-41c9-9cb4-e67561cba251 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:43:10.503738 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 600/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:43:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 05:43:10.510471 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d162386-8333-4cf6-823d-5078a586795c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:43:10.614372 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d162386-8333-4cf6-823d-5078a586795c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:43:10.648640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e4c6d-4ed3-4e32-998d-38533de87a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:43:10.649425 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e4c6d-4ed3-4e32-998d-38533de87a7d None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:43:10.649708 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e4c6d-4ed3-4e32-998d-38533de87a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:43:10.650543 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e4c6d-4ed3-4e32-998d-38533de87a7d None admin] PATH_INFO: `/v3/projects/f8370e7f0b334043b6a39a84a37ab768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:43:10.651879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e4c6d-4ed3-4e32-998d-38533de87a7d None admin] RBAC: Authorizing `identity:get_project(project_id=f8370e7f0b334043b6a39a84a37ab768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:43:10.653386 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e4c6d-4ed3-4e32-998d-38533de87a7d None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:43:10.655122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 599/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jun 21 05:43:10 2022] GET /identity/v3/projects/f8370e7f0b334043b6a39a84a37ab768 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:43:10.661490 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538685a-68d7-41c9-9cb4-e67561cba251 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:43:10.749832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:43:10.770575 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538685a-68d7-41c9-9cb4-e67561cba251 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:43:10.808651 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191bef3-f86a-487f-8e27-f29be16b2553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:43:10.809420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191bef3-f86a-487f-8e27-f29be16b2553 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:43:10.809708 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191bef3-f86a-487f-8e27-f29be16b2553 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:43:10.810018 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191bef3-f86a-487f-8e27-f29be16b2553 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:43:10.810853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191bef3-f86a-487f-8e27-f29be16b2553 None admin] RBAC: Adding query filter params (role.id=24aa6040c86049f996560e477e83886f, scope.project.id=f8370e7f0b334043b6a39a84a37ab768, user.id=0c58ae95941542e590c988e8a6b60979) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:43:10.811166 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191bef3-f86a-487f-8e27-f29be16b2553 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:43:10.813102 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191bef3-f86a-487f-8e27-f29be16b2553 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:43:10.819369 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 601/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:43:10 2022] GET /identity/v3/role_assignments?user.id=0c58ae95941542e590c988e8a6b60979&scope.project.id=f8370e7f0b334043b6a39a84a37ab768&role.id=24aa6040c86049f996560e477e83886f => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:43:20.644274 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=88 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:43:20.816346 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=28 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:06.990358 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867363b-a3d4-4a20-9e43-ffa59e45a2bc None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:06.990358 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867363b-a3d4-4a20-9e43-ffa59e45a2bc None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:06.990358 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867363b-a3d4-4a20-9e43-ffa59e45a2bc None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:06.990358 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 600/1201] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:44:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:44:06.997730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ef41c-4438-44f4-a30f-1b7567e4b979 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:06.998382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ef41c-4438-44f4-a30f-1b7567e4b979 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:06.998382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ef41c-4438-44f4-a30f-1b7567e4b979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:07.020324 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-e22ef41c-4438-44f4-a30f-1b7567e4b979 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:44:07.021712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e22ef41c-4438-44f4-a30f-1b7567e4b979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:44:07.115476 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 602/1202] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:44:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:44:07.142779 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867363b-a3d4-4a20-9e43-ffa59e45a2bc None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:07.285798 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867363b-a3d4-4a20-9e43-ffa59e45a2bc None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:07.338336 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f96ca-3d37-494d-922a-abf071b23057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:07.339396 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f96ca-3d37-494d-922a-abf071b23057 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:07.339728 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f96ca-3d37-494d-922a-abf071b23057 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:07.340060 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f96ca-3d37-494d-922a-abf071b23057 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:07.354503 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f96ca-3d37-494d-922a-abf071b23057 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:07.356296 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f96ca-3d37-494d-922a-abf071b23057 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:07.386768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-f01f96ca-3d37-494d-922a-abf071b23057 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:44:07.386768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:07.386768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:07.386768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:07.386768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:07.386768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:07.386768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:07.386768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:07.386768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:07.386768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:07.386768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:07.386768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:07.386768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:44:07.386768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:44:07.386768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:44:07.387955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:44:07.387955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:07.387955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:07.387955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:07.387955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:07.387955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:07.387955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:07.387955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:07.387955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:07.387955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:07.387955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:07.387955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:07.387955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:07.387955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:07.387955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:07.387955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:07.387955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:07.389230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:44:07.389230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:44:07.389230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:44:07.389230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:44:07.389230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 601/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:44:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:44:07.394778 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ef41c-4438-44f4-a30f-1b7567e4b979 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:07.562996 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ef41c-4438-44f4-a30f-1b7567e4b979 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:07.601991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:07.611629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709d9af-66f7-4b6a-93fd-606336064a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:07.612558 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709d9af-66f7-4b6a-93fd-606336064a10 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:07.613004 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709d9af-66f7-4b6a-93fd-606336064a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:07.613289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709d9af-66f7-4b6a-93fd-606336064a10 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:07.614175 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709d9af-66f7-4b6a-93fd-606336064a10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:07.614607 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709d9af-66f7-4b6a-93fd-606336064a10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:07.616113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709d9af-66f7-4b6a-93fd-606336064a10 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:07.634571 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 603/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:07.635859 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f96ca-3d37-494d-922a-abf071b23057 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:07.706539 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:07.781176 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f96ca-3d37-494d-922a-abf071b23057 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:07.824338 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f6f89-f158-4e24-bd55-1af161c58525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:07.825009 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f6f89-f158-4e24-bd55-1af161c58525 None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:07.825294 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f6f89-f158-4e24-bd55-1af161c58525 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:07.825601 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f6f89-f158-4e24-bd55-1af161c58525 None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:07.826351 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f6f89-f158-4e24-bd55-1af161c58525 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:07.827839 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f6f89-f158-4e24-bd55-1af161c58525 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:07.853904 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 602/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jun 21 05:44:07 2022] POST /identity/v3/users => generated 251 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:44:10.125736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553b52a-10f9-404a-9029-3e60ea8e6b50 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:10.126293 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553b52a-10f9-404a-9029-3e60ea8e6b50 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:10.126413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553b52a-10f9-404a-9029-3e60ea8e6b50 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:10.128018 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 604/1206] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:44:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:44:10.134040 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2ca89-a586-43f7-b4cc-fd7238e923cc None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:10.134544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2ca89-a586-43f7-b4cc-fd7238e923cc None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:10.134635 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2ca89-a586-43f7-b4cc-fd7238e923cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:10.152115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-01d2ca89-a586-43f7-b4cc-fd7238e923cc None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:44:10.153295 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-01d2ca89-a586-43f7-b4cc-fd7238e923cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:44:10.230260 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 603/1207] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:44:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:44:10.254261 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553b52a-10f9-404a-9029-3e60ea8e6b50 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:10.372134 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553b52a-10f9-404a-9029-3e60ea8e6b50 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:10.413723 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee77425-a80f-4cf9-976a-765f7c43145d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:10.414562 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee77425-a80f-4cf9-976a-765f7c43145d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:10.414838 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee77425-a80f-4cf9-976a-765f7c43145d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:10.415119 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee77425-a80f-4cf9-976a-765f7c43145d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:10.426290 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee77425-a80f-4cf9-976a-765f7c43145d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:44:10.434077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-5ee77425-a80f-4cf9-976a-765f7c43145d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:44:10.434077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:10.434077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:10.434077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:10.434077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:10.434077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:10.434077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:10.434077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:10.434077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:10.434077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:10.434077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:10.434077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:10.434077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:44:10.434077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:44:10.434077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:44:10.434077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:44:10.435198 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:44:10.435198 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:44:10.435198 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:44:10.435198 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:44:10.435198 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:10.435198 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:10.435198 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:10.435198 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:10.435198 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:10.435198 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:10.435198 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:10.435198 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:10.435198 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:10.435198 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:10.435198 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:10.435198 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:10.436060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:10.436060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:10.436060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:10.436060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:10.436060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:44:10.436060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:44:10.436060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:44:10.436060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:44:10.436060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:44:10.436060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:44:10.436060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:44:10.436060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:44:10.438100 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 605/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 21 05:44:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:44:10.441470 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2ca89-a586-43f7-b4cc-fd7238e923cc None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:10.485811 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:10.552001 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2ca89-a586-43f7-b4cc-fd7238e923cc None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:10.589165 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6024c7-efe7-42a8-85fc-c20a4749e990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:10.589834 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6024c7-efe7-42a8-85fc-c20a4749e990 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:10.590286 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6024c7-efe7-42a8-85fc-c20a4749e990 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:10.590572 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6024c7-efe7-42a8-85fc-c20a4749e990 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:10.591326 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6024c7-efe7-42a8-85fc-c20a4749e990 None admin] RBAC: Adding query filter params (name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:10.591640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6024c7-efe7-42a8-85fc-c20a4749e990 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:10.593040 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6024c7-efe7-42a8-85fc-c20a4749e990 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:10.602610 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 604/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 21 05:44:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:10.608446 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee77425-a80f-4cf9-976a-765f7c43145d None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:10.667773 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:10.722725 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee77425-a80f-4cf9-976a-765f7c43145d None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:10.765829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af99b1b-9f0b-41ff-bc06-8252b5b593bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:10.766806 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af99b1b-9f0b-41ff-bc06-8252b5b593bf None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:10.767172 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af99b1b-9f0b-41ff-bc06-8252b5b593bf None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:10.767533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af99b1b-9f0b-41ff-bc06-8252b5b593bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:10.780058 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af99b1b-9f0b-41ff-bc06-8252b5b593bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:10.781555 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af99b1b-9f0b-41ff-bc06-8252b5b593bf None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:10.801044 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-1af99b1b-9f0b-41ff-bc06-8252b5b593bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:44:10.801044 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:10.801044 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:10.801044 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:10.801044 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:10.801044 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:10.801044 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:10.801044 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:10.801044 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:10.801044 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:10.801044 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:10.801044 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:10.801044 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:44:10.801044 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:44:10.801044 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:44:10.802244 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:44:10.802244 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:10.802244 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:10.802244 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:10.802244 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:10.802244 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:10.802244 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:10.802244 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:10.802244 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:10.802244 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:10.802244 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:10.802244 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:10.802244 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:10.802244 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:10.802244 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:10.802244 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:10.802244 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:10.803509 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:44:10.803509 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:44:10.803509 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:44:10.803509 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:44:10.803509 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 606/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:44:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:44:10.808418 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6024c7-efe7-42a8-85fc-c20a4749e990 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:10.926671 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:10.930417 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6024c7-efe7-42a8-85fc-c20a4749e990 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:10.970118 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8dc2eb-59fe-4e0f-8a56-8172f327fd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:10.970786 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8dc2eb-59fe-4e0f-8a56-8172f327fd4b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:10.971070 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8dc2eb-59fe-4e0f-8a56-8172f327fd4b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:10.971348 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8dc2eb-59fe-4e0f-8a56-8172f327fd4b None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:10.972099 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8dc2eb-59fe-4e0f-8a56-8172f327fd4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:10.972402 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8dc2eb-59fe-4e0f-8a56-8172f327fd4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:10.973840 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8dc2eb-59fe-4e0f-8a56-8172f327fd4b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:10.992192 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 605/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:10.994374 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af99b1b-9f0b-41ff-bc06-8252b5b593bf None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:11.124500 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af99b1b-9f0b-41ff-bc06-8252b5b593bf None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:11.129104 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:11.177825 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401fb38-e7c7-4ae8-8488-415e907b8700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:11.178655 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401fb38-e7c7-4ae8-8488-415e907b8700 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:11.178973 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401fb38-e7c7-4ae8-8488-415e907b8700 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:11.179255 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401fb38-e7c7-4ae8-8488-415e907b8700 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:11.188850 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401fb38-e7c7-4ae8-8488-415e907b8700 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:11.190397 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401fb38-e7c7-4ae8-8488-415e907b8700 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:11.210627 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-4401fb38-e7c7-4ae8-8488-415e907b8700 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 05:44:11.210627 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:11.210627 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:11.210627 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:11.210627 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:11.210627 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:11.210627 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:11.210627 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:11.210627 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:11.210627 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:11.210627 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:11.210627 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:11.210627 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:44:11.210627 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:44:11.210627 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:44:11.210627 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:44:11.212002 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:11.212002 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:11.212002 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:44:11.212002 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:44:11.212002 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:44:11.212002 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:44:11.212002 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:11.212002 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:11.212002 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:11.212002 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:11.212002 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:11.212002 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:11.212002 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:11.212002 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:11.212002 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:11.212002 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:11.212002 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:11.212002 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:11.212971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:11.212971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:11.212971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:44:11.212971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:44:11.212971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:44:11.212971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:44:11.212971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:44:11.212971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:44:11.212971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 05:44:11.212971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:44:11.212971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 607/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:44:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:44:11.219363 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8dc2eb-59fe-4e0f-8a56-8172f327fd4b None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:11.358711 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8dc2eb-59fe-4e0f-8a56-8172f327fd4b None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:11.414338 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b5702-d403-4b62-abcb-ade35529f2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:11.415049 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b5702-d403-4b62-abcb-ade35529f2bf None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:11.415443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b5702-d403-4b62-abcb-ade35529f2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:11.415723 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b5702-d403-4b62-abcb-ade35529f2bf None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:11.416638 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b5702-d403-4b62-abcb-ade35529f2bf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:11.417059 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b5702-d403-4b62-abcb-ade35529f2bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:11.419021 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b5702-d403-4b62-abcb-ade35529f2bf None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:11.456447 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 606/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Jun 21 05:44:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:11.457660 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401fb38-e7c7-4ae8-8488-415e907b8700 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:11.599753 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401fb38-e7c7-4ae8-8488-415e907b8700 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:11.651822 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e45ddb-359e-4422-a5d4-49c55de62988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:11.652692 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e45ddb-359e-4422-a5d4-49c55de62988 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:11.652983 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e45ddb-359e-4422-a5d4-49c55de62988 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:11.654001 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e45ddb-359e-4422-a5d4-49c55de62988 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:11.694086 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:11.744462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e45ddb-359e-4422-a5d4-49c55de62988 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:11.746091 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e45ddb-359e-4422-a5d4-49c55de62988 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:11.903882 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 608/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:44:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 05:44:11.913654 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b5702-d403-4b62-abcb-ade35529f2bf None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:11.947226 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:12.060852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b5702-d403-4b62-abcb-ade35529f2bf None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:12.108364 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da74611-48a2-4928-b9e4-2a84251d6679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:12.109558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da74611-48a2-4928-b9e4-2a84251d6679 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:12.110090 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da74611-48a2-4928-b9e4-2a84251d6679 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:12.110606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da74611-48a2-4928-b9e4-2a84251d6679 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:12.126905 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da74611-48a2-4928-b9e4-2a84251d6679 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:12.128548 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da74611-48a2-4928-b9e4-2a84251d6679 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:12.153904 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-7da74611-48a2-4928-b9e4-2a84251d6679 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:44:12.153904 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:12.153904 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:12.153904 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:12.153904 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:12.153904 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:12.153904 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:12.153904 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:12.153904 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:12.153904 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:12.153904 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:12.153904 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:12.153904 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:44:12.153904 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:44:12.153904 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:44:12.154958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:44:12.154958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:12.154958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:12.154958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:12.154958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:12.154958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:12.154958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:12.154958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:12.154958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:12.154958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:12.154958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:12.154958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:12.154958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:12.154958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:12.154958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:12.154958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:12.154958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:12.160561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:44:12.160561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:44:12.160561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:44:12.160561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:44:12.160561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 607/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:44:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:44:12.163479 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e45ddb-359e-4422-a5d4-49c55de62988 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:12.236505 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:12.285162 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e45ddb-359e-4422-a5d4-49c55de62988 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:12.326689 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a8250-d9fc-4e51-815c-969f184b358e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:12.327456 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a8250-d9fc-4e51-815c-969f184b358e None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:12.327721 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a8250-d9fc-4e51-815c-969f184b358e None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:12.328021 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a8250-d9fc-4e51-815c-969f184b358e None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:12.328805 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a8250-d9fc-4e51-815c-969f184b358e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:12.329152 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a8250-d9fc-4e51-815c-969f184b358e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:12.330752 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a8250-d9fc-4e51-815c-969f184b358e None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:12.346035 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 609/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:12.352466 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da74611-48a2-4928-b9e4-2a84251d6679 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:12.433552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:12.468331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da74611-48a2-4928-b9e4-2a84251d6679 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:12.506457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaff133-991f-4786-8d0d-7f5c8db5f215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:12.507623 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaff133-991f-4786-8d0d-7f5c8db5f215 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:12.508092 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaff133-991f-4786-8d0d-7f5c8db5f215 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:12.508538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaff133-991f-4786-8d0d-7f5c8db5f215 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:12.516907 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaff133-991f-4786-8d0d-7f5c8db5f215 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:12.518619 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaff133-991f-4786-8d0d-7f5c8db5f215 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:12.541376 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-acaff133-991f-4786-8d0d-7f5c8db5f215 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:44:12.541376 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:12.541376 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:12.541376 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:12.541376 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:12.541376 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:12.541376 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:12.541376 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:12.541376 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:12.541376 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:12.541376 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:12.541376 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:12.541376 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:44:12.541376 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:44:12.541376 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:44:12.542765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:44:12.542765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:12.542765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:12.542765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:12.542765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:12.542765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:12.542765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:12.542765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:12.542765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:12.542765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:12.542765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:12.542765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:12.542765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:12.542765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:12.542765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:12.542765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:12.542765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:12.544007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:44:12.544007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:44:12.544007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:44:12.544007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:44:12.544007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:44:12.544007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:44:12.544007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:44:12.544007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:44:12.546252 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 608/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:44:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:44:12.552511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a8250-d9fc-4e51-815c-969f184b358e None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:12.680783 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a8250-d9fc-4e51-815c-969f184b358e None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:12.709394 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:12.738085 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be96f7d-e696-4791-a922-ee2e08994739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:12.738085 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be96f7d-e696-4791-a922-ee2e08994739 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:12.738085 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be96f7d-e696-4791-a922-ee2e08994739 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:12.738085 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be96f7d-e696-4791-a922-ee2e08994739 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:12.739978 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be96f7d-e696-4791-a922-ee2e08994739 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:12.739978 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be96f7d-e696-4791-a922-ee2e08994739 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:12.739978 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be96f7d-e696-4791-a922-ee2e08994739 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:12.753339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 610/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:44:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:12.760429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaff133-991f-4786-8d0d-7f5c8db5f215 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:12.893276 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaff133-991f-4786-8d0d-7f5c8db5f215 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:12.923431 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:12.931147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d67b8-3751-4820-b08a-2f19d274ceb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:12.932028 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d67b8-3751-4820-b08a-2f19d274ceb9 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:12.932519 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d67b8-3751-4820-b08a-2f19d274ceb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:12.932962 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d67b8-3751-4820-b08a-2f19d274ceb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:12.934024 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d67b8-3751-4820-b08a-2f19d274ceb9 None admin] RBAC: Adding query filter params (role.id=b2f95849039f475c904876eb2958a375, scope.project.id=e64b932ef6bf481cb93a04885a93b4b2, user.id=d17a40bea6ba41f19c88e16f9b15cf27) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:12.934546 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d67b8-3751-4820-b08a-2f19d274ceb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:12.936189 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d67b8-3751-4820-b08a-2f19d274ceb9 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:12.945286 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 609/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:44:12 2022] GET /identity/v3/role_assignments?user.id=d17a40bea6ba41f19c88e16f9b15cf27&scope.project.id=e64b932ef6bf481cb93a04885a93b4b2&role.id=b2f95849039f475c904876eb2958a375 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:15.026266 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc88a6-b0fe-48f3-a974-fdfbe83c0c9b None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:15.026916 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc88a6-b0fe-48f3-a974-fdfbe83c0c9b None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:15.026916 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc88a6-b0fe-48f3-a974-fdfbe83c0c9b None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:15.028871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 611/1220] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:44:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:44:15.035448 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f08e6-3413-4721-a74c-e225c8f31764 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:15.036012 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f08e6-3413-4721-a74c-e225c8f31764 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:15.036114 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f08e6-3413-4721-a74c-e225c8f31764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:15.056385 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-0d4f08e6-3413-4721-a74c-e225c8f31764 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:44:15.057898 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0d4f08e6-3413-4721-a74c-e225c8f31764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:44:15.141775 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 610/1221] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:44:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:44:15.165617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc88a6-b0fe-48f3-a974-fdfbe83c0c9b None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:15.281978 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc88a6-b0fe-48f3-a974-fdfbe83c0c9b None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:15.319898 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a5fa8-91b0-4f96-9bc2-965bfcd1e55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:15.320703 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a5fa8-91b0-4f96-9bc2-965bfcd1e55d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:15.321022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a5fa8-91b0-4f96-9bc2-965bfcd1e55d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:15.321260 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a5fa8-91b0-4f96-9bc2-965bfcd1e55d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:15.333860 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a5fa8-91b0-4f96-9bc2-965bfcd1e55d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:44:15.341636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-639a5fa8-91b0-4f96-9bc2-965bfcd1e55d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:44:15.341636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:15.341636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:15.341636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:15.341636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:15.341636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:15.341636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:15.341636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:15.341636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:15.341636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:15.341636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:15.341636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:15.341636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:44:15.341636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:44:15.341636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:44:15.341636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:44:15.342769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:44:15.342769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:44:15.342769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:44:15.342769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:44:15.342769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:15.342769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:15.342769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:15.342769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:15.342769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:15.342769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:15.342769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:15.342769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:15.342769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:15.342769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:15.342769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:15.342769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:15.343623 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:15.343623 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:15.343623 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:15.343623 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:15.343623 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:44:15.343623 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:44:15.343623 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:44:15.343623 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:44:15.343623 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:44:15.343623 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:44:15.343623 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:44:15.343623 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:44:15.343623 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 612/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 21 05:44:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:44:15.349758 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f08e6-3413-4721-a74c-e225c8f31764 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:15.454718 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f08e6-3413-4721-a74c-e225c8f31764 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:15.479641 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:15.490287 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be111607-2eb9-4e86-a139-53cba9a8f5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:15.490955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be111607-2eb9-4e86-a139-53cba9a8f5ac None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:15.491240 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be111607-2eb9-4e86-a139-53cba9a8f5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:15.491538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be111607-2eb9-4e86-a139-53cba9a8f5ac None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:15.492261 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be111607-2eb9-4e86-a139-53cba9a8f5ac None admin] RBAC: Adding query filter params (name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:15.492564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be111607-2eb9-4e86-a139-53cba9a8f5ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:15.493924 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be111607-2eb9-4e86-a139-53cba9a8f5ac None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:15.502806 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 611/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 21 05:44:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:15.509333 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a5fa8-91b0-4f96-9bc2-965bfcd1e55d None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:15.565920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:15.636266 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a5fa8-91b0-4f96-9bc2-965bfcd1e55d None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:15.670584 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2843d-f19e-4f5b-a6aa-9c584ef09ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:15.671377 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2843d-f19e-4f5b-a6aa-9c584ef09ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:15.671663 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2843d-f19e-4f5b-a6aa-9c584ef09ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:15.671938 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2843d-f19e-4f5b-a6aa-9c584ef09ae8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:15.684001 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2843d-f19e-4f5b-a6aa-9c584ef09ae8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:15.685530 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2843d-f19e-4f5b-a6aa-9c584ef09ae8 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:15.704571 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-75e2843d-f19e-4f5b-a6aa-9c584ef09ae8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:44:15.704571 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:15.704571 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:15.704571 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:15.704571 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:15.704571 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:15.704571 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:15.704571 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:15.704571 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:15.704571 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:15.704571 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:15.704571 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:15.704571 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:44:15.704571 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:44:15.704571 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:44:15.705694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:44:15.705694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:15.705694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:15.705694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:15.705694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:15.705694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:15.705694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:15.705694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:15.705694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:15.705694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:15.705694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:15.705694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:15.705694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:15.705694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:15.705694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:15.705694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:15.705694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:15.706766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:44:15.706766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:44:15.706766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:44:15.706766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:44:15.706766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 613/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:44:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:44:15.711934 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be111607-2eb9-4e86-a139-53cba9a8f5ac None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:15.831162 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be111607-2eb9-4e86-a139-53cba9a8f5ac None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:15.868558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae28c4-e83e-4c62-a5d3-a99084e4403e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:15.869234 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae28c4-e83e-4c62-a5d3-a99084e4403e None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:15.869523 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae28c4-e83e-4c62-a5d3-a99084e4403e None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:15.869800 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae28c4-e83e-4c62-a5d3-a99084e4403e None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:15.870573 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae28c4-e83e-4c62-a5d3-a99084e4403e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:15.870906 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae28c4-e83e-4c62-a5d3-a99084e4403e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:15.872251 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae28c4-e83e-4c62-a5d3-a99084e4403e None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:15.885154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 612/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:15.891129 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2843d-f19e-4f5b-a6aa-9c584ef09ae8 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:15.992275 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:15.999601 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2843d-f19e-4f5b-a6aa-9c584ef09ae8 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:16.035977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f007e-fccb-4400-b220-95d1fe3e684d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:16.035977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f007e-fccb-4400-b220-95d1fe3e684d None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:16.035977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f007e-fccb-4400-b220-95d1fe3e684d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:16.035977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f007e-fccb-4400-b220-95d1fe3e684d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:16.045806 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f007e-fccb-4400-b220-95d1fe3e684d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:16.047302 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f007e-fccb-4400-b220-95d1fe3e684d None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:16.062966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-f33f007e-fccb-4400-b220-95d1fe3e684d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 05:44:16.062966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:16.062966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:16.062966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:16.062966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:16.062966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:16.062966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:16.062966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:16.062966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:16.062966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:16.062966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:16.062966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:16.062966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:44:16.062966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:44:16.062966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:44:16.062966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:44:16.064210 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:16.064210 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:16.064210 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:44:16.064210 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:44:16.064210 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:44:16.064210 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:44:16.064210 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:16.064210 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:16.064210 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:16.064210 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:16.064210 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:16.064210 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:16.064210 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:16.064210 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:16.064210 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:16.064210 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:16.064210 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:16.064210 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:16.065391 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:16.065391 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:16.065391 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:44:16.065391 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:44:16.065391 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:44:16.065391 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:44:16.065391 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:44:16.065391 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:44:16.065391 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 05:44:16.065391 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:44:16.065391 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 614/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:44:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:44:16.070028 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae28c4-e83e-4c62-a5d3-a99084e4403e None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:16.128376 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:16.191152 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae28c4-e83e-4c62-a5d3-a99084e4403e None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:16.230370 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13075aa9-36bc-4ee4-8203-2fb070e684fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:16.231054 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13075aa9-36bc-4ee4-8203-2fb070e684fd None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:16.231341 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13075aa9-36bc-4ee4-8203-2fb070e684fd None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:16.231620 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13075aa9-36bc-4ee4-8203-2fb070e684fd None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:16.232464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13075aa9-36bc-4ee4-8203-2fb070e684fd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:16.232774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13075aa9-36bc-4ee4-8203-2fb070e684fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:16.234238 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13075aa9-36bc-4ee4-8203-2fb070e684fd None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:16.253580 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 613/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Jun 21 05:44:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:16.259476 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f007e-fccb-4400-b220-95d1fe3e684d None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:16.374935 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f007e-fccb-4400-b220-95d1fe3e684d None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:16.412877 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d18f62-e756-4257-9fb0-689751af1d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:16.413780 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d18f62-e756-4257-9fb0-689751af1d51 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:16.414093 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d18f62-e756-4257-9fb0-689751af1d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:16.414431 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d18f62-e756-4257-9fb0-689751af1d51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:16.427842 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d18f62-e756-4257-9fb0-689751af1d51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:16.429447 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d18f62-e756-4257-9fb0-689751af1d51 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:16.449022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-00d18f62-e756-4257-9fb0-689751af1d51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:44:16.449022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:16.449022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:16.449022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:16.449022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:16.449022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:16.449022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:16.449022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:16.449022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:16.449022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:16.449022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:16.449022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:16.449022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:44:16.449022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:44:16.449022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:44:16.450311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:44:16.450311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:16.450311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:16.450311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:16.450311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:16.450311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:16.450311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:16.450311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:16.450311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:16.450311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:16.450311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:16.450311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:16.450311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:16.450311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:16.450311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:16.450311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:16.450311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:16.451528 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:44:16.451528 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:44:16.451528 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:44:16.451528 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:44:16.451528 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 615/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:44:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:44:16.456398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13075aa9-36bc-4ee4-8203-2fb070e684fd None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:16.568884 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13075aa9-36bc-4ee4-8203-2fb070e684fd None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:16.571522 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:16.606608 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8f512-f8f2-462c-a972-ededbd2289cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:16.607289 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8f512-f8f2-462c-a972-ededbd2289cb None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:16.607581 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8f512-f8f2-462c-a972-ededbd2289cb None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:16.607868 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8f512-f8f2-462c-a972-ededbd2289cb None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:16.608609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8f512-f8f2-462c-a972-ededbd2289cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:16.608924 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8f512-f8f2-462c-a972-ededbd2289cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:16.610331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8f512-f8f2-462c-a972-ededbd2289cb None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:16.622588 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 614/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:16.628828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d18f62-e756-4257-9fb0-689751af1d51 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:16.638826 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:16.746087 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d18f62-e756-4257-9fb0-689751af1d51 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:16.786212 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480d5dd-4159-472a-a1a1-7d0b3ed13586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:16.787021 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480d5dd-4159-472a-a1a1-7d0b3ed13586 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:16.787310 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480d5dd-4159-472a-a1a1-7d0b3ed13586 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:16.787646 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480d5dd-4159-472a-a1a1-7d0b3ed13586 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:16.795296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480d5dd-4159-472a-a1a1-7d0b3ed13586 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:16.796887 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480d5dd-4159-472a-a1a1-7d0b3ed13586 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:16.813386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-5480d5dd-4159-472a-a1a1-7d0b3ed13586 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:44:16.813386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:16.813386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:16.813386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:16.813386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:16.813386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:16.813386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:16.813386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:16.813386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:16.813386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:16.813386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:16.813386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:16.813386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:44:16.813386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:44:16.813386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:44:16.814569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:44:16.814569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:16.814569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:16.814569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:16.814569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:16.814569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:16.814569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:16.814569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:16.814569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:16.814569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:16.814569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:16.814569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:16.814569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:16.814569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:16.814569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:16.814569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:16.814569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:16.815619 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:44:16.815619 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:44:16.815619 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:44:16.815619 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:44:16.815619 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:44:16.815619 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:44:16.815619 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:44:16.815619 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:44:16.815619 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 616/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:44:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:44:16.821858 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8f512-f8f2-462c-a972-ededbd2289cb None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:16.929863 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8f512-f8f2-462c-a972-ededbd2289cb None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:16.975182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f9c37-3228-4e4c-a8ee-5188dcac16c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:16.975855 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f9c37-3228-4e4c-a8ee-5188dcac16c9 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:16.976142 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f9c37-3228-4e4c-a8ee-5188dcac16c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:16.976682 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f9c37-3228-4e4c-a8ee-5188dcac16c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:16.977477 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f9c37-3228-4e4c-a8ee-5188dcac16c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:16.977788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f9c37-3228-4e4c-a8ee-5188dcac16c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:16.979258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f9c37-3228-4e4c-a8ee-5188dcac16c9 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:16.991825 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 615/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:44:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:44:16.997887 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480d5dd-4159-472a-a1a1-7d0b3ed13586 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:17.075107 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:17.113533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480d5dd-4159-472a-a1a1-7d0b3ed13586 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:17.150028 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f8cf7-60b1-44c2-ba77-5da4970dbc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:17.150939 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f8cf7-60b1-44c2-ba77-5da4970dbc3d None admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:17.151223 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f8cf7-60b1-44c2-ba77-5da4970dbc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:17.151524 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f8cf7-60b1-44c2-ba77-5da4970dbc3d None admin] PATH_INFO: `/v3/projects/e64b932ef6bf481cb93a04885a93b4b2/users/d17a40bea6ba41f19c88e16f9b15cf27/roles/b2f95849039f475c904876eb2958a375` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:17.167445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f8cf7-60b1-44c2-ba77-5da4970dbc3d None admin] RBAC: Authorizing `identity:create_grant(project_id=e64b932ef6bf481cb93a04885a93b4b2, user_id=d17a40bea6ba41f19c88e16f9b15cf27, role_id=b2f95849039f475c904876eb2958a375)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:17.168905 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f8cf7-60b1-44c2-ba77-5da4970dbc3d None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:17.182736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 617/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 21 05:44:16 2022] PUT /identity/v3/projects/e64b932ef6bf481cb93a04885a93b4b2/users/d17a40bea6ba41f19c88e16f9b15cf27/roles/b2f95849039f475c904876eb2958a375 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:44:19.248172 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6f27a-8fa9-4b22-868b-e8bb6f713ec5 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:19.248758 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6f27a-8fa9-4b22-868b-e8bb6f713ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:19.248758 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6f27a-8fa9-4b22-868b-e8bb6f713ec5 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:19.250138 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 616/1233] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:44:19.256024 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308ebdf-2f77-4183-89fa-b9e6277523f8 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:19.256460 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308ebdf-2f77-4183-89fa-b9e6277523f8 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:19.256570 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308ebdf-2f77-4183-89fa-b9e6277523f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:19.273215 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-2308ebdf-2f77-4183-89fa-b9e6277523f8 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:44:19.274454 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-2308ebdf-2f77-4183-89fa-b9e6277523f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:44:19.344626 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 618/1234] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:44:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:44:19.373762 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6f27a-8fa9-4b22-868b-e8bb6f713ec5 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:19.400298 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:19.481886 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6f27a-8fa9-4b22-868b-e8bb6f713ec5 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:19.518228 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f900f-e4b7-4b5b-b948-31910bbf8881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:19.519018 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f900f-e4b7-4b5b-b948-31910bbf8881 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:19.519305 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f900f-e4b7-4b5b-b948-31910bbf8881 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:19.519574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f900f-e4b7-4b5b-b948-31910bbf8881 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:19.530415 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f900f-e4b7-4b5b-b948-31910bbf8881 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:44:19.538780 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-f37f900f-e4b7-4b5b-b948-31910bbf8881 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:44:19.538780 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:19.538780 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:19.538780 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:19.538780 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:19.538780 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:19.538780 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:19.538780 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:19.538780 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:19.538780 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:19.538780 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:19.538780 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:19.538780 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:44:19.538780 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:44:19.538780 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:44:19.538780 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:44:19.539765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:44:19.539765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:44:19.539765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:44:19.539765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:44:19.539765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:19.539765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:19.539765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:19.539765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:19.539765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:19.539765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:19.539765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:19.539765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:19.539765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:19.539765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:19.539765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:19.539765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:19.540704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:19.540704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:19.540704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:19.540704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:19.540704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:44:19.540704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:44:19.540704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:44:19.540704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:44:19.540704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:44:19.540704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:44:19.540704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 05:44:19.540704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:44:19.540704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 617/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jun 21 05:44:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:44:19.546299 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308ebdf-2f77-4183-89fa-b9e6277523f8 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:19.596931 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:19.657083 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308ebdf-2f77-4183-89fa-b9e6277523f8 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:19.695733 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72672f-8eef-4825-920c-22032af524cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:19.696403 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72672f-8eef-4825-920c-22032af524cb None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:19.696687 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72672f-8eef-4825-920c-22032af524cb None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:19.696957 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72672f-8eef-4825-920c-22032af524cb None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:19.697697 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f72672f-8eef-4825-920c-22032af524cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:19.698036 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f72672f-8eef-4825-920c-22032af524cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:19.699408 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f72672f-8eef-4825-920c-22032af524cb None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:19.708911 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 619/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jun 21 05:44:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:19.715808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f900f-e4b7-4b5b-b948-31910bbf8881 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:19.812596 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:19.831023 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f900f-e4b7-4b5b-b948-31910bbf8881 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:19.872601 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3a344-03ad-4d04-a5a1-2924eae72b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:19.873464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3a344-03ad-4d04-a5a1-2924eae72b00 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:19.873756 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3a344-03ad-4d04-a5a1-2924eae72b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:19.874084 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3a344-03ad-4d04-a5a1-2924eae72b00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:19.886482 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3a344-03ad-4d04-a5a1-2924eae72b00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:19.887934 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3a344-03ad-4d04-a5a1-2924eae72b00 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:19.911355 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-57a3a344-03ad-4d04-a5a1-2924eae72b00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:44:19.911355 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:19.911355 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:19.911355 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:19.911355 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:19.911355 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:19.911355 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:19.911355 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:19.911355 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:19.911355 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:19.911355 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:19.911355 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:19.911355 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:44:19.911355 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:44:19.911355 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:44:19.912506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:44:19.912506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:19.912506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:19.912506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:19.912506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:19.912506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:19.912506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:19.912506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:19.912506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:19.912506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:19.912506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:19.912506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:19.912506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:19.912506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:19.912506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:19.912506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:19.912506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:19.913607 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:44:19.913607 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:44:19.913607 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:44:19.913607 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:44:19.913607 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 618/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:44:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:44:19.918739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72672f-8eef-4825-920c-22032af524cb None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:20.029091 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72672f-8eef-4825-920c-22032af524cb None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:20.039560 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:20.067989 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768715d-e0db-4318-9a12-872f5a228549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:20.068649 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768715d-e0db-4318-9a12-872f5a228549 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:20.068947 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768715d-e0db-4318-9a12-872f5a228549 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:20.069200 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768715d-e0db-4318-9a12-872f5a228549 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:20.069913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768715d-e0db-4318-9a12-872f5a228549 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:20.070251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768715d-e0db-4318-9a12-872f5a228549 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:20.071621 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768715d-e0db-4318-9a12-872f5a228549 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:20.084006 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 620/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:20.089410 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3a344-03ad-4d04-a5a1-2924eae72b00 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:20.198827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3a344-03ad-4d04-a5a1-2924eae72b00 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:20.232718 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4e849-c527-4497-b4d7-3534db9fb64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:20.233532 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4e849-c527-4497-b4d7-3534db9fb64d None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:20.233811 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4e849-c527-4497-b4d7-3534db9fb64d None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:20.234122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4e849-c527-4497-b4d7-3534db9fb64d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:20.237294 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:20.243609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4e849-c527-4497-b4d7-3534db9fb64d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:20.245642 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4e849-c527-4497-b4d7-3534db9fb64d None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:20.263531 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-30c4e849-c527-4497-b4d7-3534db9fb64d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 05:44:20.263531 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:20.263531 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:20.263531 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:20.263531 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:20.263531 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:20.263531 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:20.263531 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:20.263531 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:20.263531 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:20.263531 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:20.263531 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:20.263531 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:44:20.263531 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:44:20.263531 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:44:20.263531 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:44:20.265249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:20.265249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:20.265249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:44:20.265249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:44:20.265249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:44:20.265249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:44:20.265249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:20.265249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:20.265249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:20.265249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:20.265249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:20.265249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:20.265249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:20.265249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:20.265249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:20.265249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:20.265249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:20.265249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:20.266570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:20.266570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:20.266570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:44:20.266570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:44:20.266570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:44:20.266570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:44:20.266570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:44:20.266570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:44:20.266570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 05:44:20.266570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:44:20.266570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 619/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:44:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:44:20.272380 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768715d-e0db-4318-9a12-872f5a228549 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:20.382270 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768715d-e0db-4318-9a12-872f5a228549 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:20.419038 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff85680-5f9b-4a38-ae0b-d27e10402fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:20.419715 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff85680-5f9b-4a38-ae0b-d27e10402fbc None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:20.420001 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff85680-5f9b-4a38-ae0b-d27e10402fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:20.420278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff85680-5f9b-4a38-ae0b-d27e10402fbc None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:20.421119 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff85680-5f9b-4a38-ae0b-d27e10402fbc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:20.421429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff85680-5f9b-4a38-ae0b-d27e10402fbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:20.422961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff85680-5f9b-4a38-ae0b-d27e10402fbc None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:20.442364 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 621/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Jun 21 05:44:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:20.451115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4e849-c527-4497-b4d7-3534db9fb64d None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:20.569381 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4e849-c527-4497-b4d7-3534db9fb64d None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:20.607185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83317b-c69b-452c-adb6-15d4441aaa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:20.607806 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83317b-c69b-452c-adb6-15d4441aaa9e None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:20.608140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83317b-c69b-452c-adb6-15d4441aaa9e None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:20.608378 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83317b-c69b-452c-adb6-15d4441aaa9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:20.675880 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:20.682844 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83317b-c69b-452c-adb6-15d4441aaa9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:20.684396 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83317b-c69b-452c-adb6-15d4441aaa9e None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:20.811490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 620/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:44:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 05:44:20.819395 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff85680-5f9b-4a38-ae0b-d27e10402fbc None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:20.857452 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:20.940937 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff85680-5f9b-4a38-ae0b-d27e10402fbc None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:20.978099 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa238b-4383-4ebb-89cf-b38dff58ac76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:20.978890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa238b-4383-4ebb-89cf-b38dff58ac76 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:20.979178 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa238b-4383-4ebb-89cf-b38dff58ac76 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:20.979453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa238b-4383-4ebb-89cf-b38dff58ac76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:20.991997 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa238b-4383-4ebb-89cf-b38dff58ac76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:20.993619 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa238b-4383-4ebb-89cf-b38dff58ac76 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:21.014909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-68aa238b-4383-4ebb-89cf-b38dff58ac76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:44:21.014909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:21.014909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:21.014909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:21.014909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:21.014909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:21.014909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:21.014909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:21.014909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:21.014909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:21.014909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:21.014909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:21.014909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:44:21.014909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:44:21.014909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:44:21.016073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:44:21.016073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:21.016073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:21.016073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:21.016073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:21.016073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:21.016073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:21.016073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:21.016073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:21.016073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:21.016073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:21.016073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:21.016073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:21.016073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:21.016073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:21.016073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:21.016073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:21.017199 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:44:21.017199 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:44:21.017199 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:44:21.017199 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:44:21.017199 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 622/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:44:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:44:21.024359 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83317b-c69b-452c-adb6-15d4441aaa9e None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:21.131412 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:21.138951 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83317b-c69b-452c-adb6-15d4441aaa9e None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:21.177920 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335be91b-e750-4599-8938-f43513d026ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:21.178740 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335be91b-e750-4599-8938-f43513d026ec None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:21.179044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335be91b-e750-4599-8938-f43513d026ec None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:21.179353 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335be91b-e750-4599-8938-f43513d026ec None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:21.180184 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335be91b-e750-4599-8938-f43513d026ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:21.180580 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335be91b-e750-4599-8938-f43513d026ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:21.182175 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335be91b-e750-4599-8938-f43513d026ec None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:21.196036 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 621/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:44:21.202144 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa238b-4383-4ebb-89cf-b38dff58ac76 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:21.311282 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:21.335009 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa238b-4383-4ebb-89cf-b38dff58ac76 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:21.377854 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48957134-fb0b-4125-8c54-09b2371acb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:21.378580 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48957134-fb0b-4125-8c54-09b2371acb2b None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:21.378861 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48957134-fb0b-4125-8c54-09b2371acb2b None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:21.379235 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48957134-fb0b-4125-8c54-09b2371acb2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:21.387693 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48957134-fb0b-4125-8c54-09b2371acb2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:21.388709 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48957134-fb0b-4125-8c54-09b2371acb2b None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:21.404054 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-48957134-fb0b-4125-8c54-09b2371acb2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:44:21.404054 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:21.404054 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:21.404054 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:21.404054 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:21.404054 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:21.404054 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:21.404054 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:21.404054 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:21.404054 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:21.404054 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:21.404054 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:21.404054 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:44:21.404054 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:44:21.404054 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:44:21.405190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:44:21.405190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:21.405190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:21.405190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:21.405190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:21.405190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:21.405190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:21.405190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:21.405190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:21.405190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:21.405190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:21.405190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:21.405190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:21.405190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:21.405190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:21.405190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:21.405190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:21.406388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:44:21.406388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:44:21.406388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:44:21.406388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:44:21.406388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:44:21.406388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:44:21.406388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:44:21.406388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:44:21.406388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 623/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:44:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:44:21.412045 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335be91b-e750-4599-8938-f43513d026ec None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:21.527781 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335be91b-e750-4599-8938-f43513d026ec None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:21.565229 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79a043-3afb-4646-bacb-57782ce09851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:21.566144 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79a043-3afb-4646-bacb-57782ce09851 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:21.566481 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79a043-3afb-4646-bacb-57782ce09851 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:21.566757 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79a043-3afb-4646-bacb-57782ce09851 None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:21.567839 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79a043-3afb-4646-bacb-57782ce09851 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:21.568155 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79a043-3afb-4646-bacb-57782ce09851 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:21.569746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79a043-3afb-4646-bacb-57782ce09851 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:21.585718 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 622/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:44:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:21.591903 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48957134-fb0b-4125-8c54-09b2371acb2b None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:21.702812 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48957134-fb0b-4125-8c54-09b2371acb2b None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:21.742813 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd99403-a760-46ae-a047-38d9ed30e13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:21.743476 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd99403-a760-46ae-a047-38d9ed30e13a None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:21.743763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd99403-a760-46ae-a047-38d9ed30e13a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:21.744047 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd99403-a760-46ae-a047-38d9ed30e13a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:21.744882 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd99403-a760-46ae-a047-38d9ed30e13a None admin] RBAC: Adding query filter params (role.id=b2f95849039f475c904876eb2958a375, scope.project.id=e64b932ef6bf481cb93a04885a93b4b2, user.id=d17a40bea6ba41f19c88e16f9b15cf27) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:21.745202 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd99403-a760-46ae-a047-38d9ed30e13a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:21.746750 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd99403-a760-46ae-a047-38d9ed30e13a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:21.752848 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 624/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:44:21 2022] GET /identity/v3/role_assignments?user.id=d17a40bea6ba41f19c88e16f9b15cf27&scope.project.id=e64b932ef6bf481cb93a04885a93b4b2&role.id=b2f95849039f475c904876eb2958a375 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:44:24.132621 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293cdea-ae1e-4dfb-916e-4d2c3b9c924c None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:24.133186 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293cdea-ae1e-4dfb-916e-4d2c3b9c924c None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:24.133186 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293cdea-ae1e-4dfb-916e-4d2c3b9c924c None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:24.134715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 623/1247] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:44:24.140577 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76acd3d-348c-49cd-884e-2e11f69923f6 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:24.141082 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76acd3d-348c-49cd-884e-2e11f69923f6 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:24.141182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76acd3d-348c-49cd-884e-2e11f69923f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:24.147754 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:24.162170 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-e76acd3d-348c-49cd-884e-2e11f69923f6 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:44:24.163452 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e76acd3d-348c-49cd-884e-2e11f69923f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:44:24.239341 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 625/1248] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:44:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:44:24.266317 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293cdea-ae1e-4dfb-916e-4d2c3b9c924c None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:24.286771 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:24.383051 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293cdea-ae1e-4dfb-916e-4d2c3b9c924c None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:24.422362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b9008-67c1-45e8-9442-da7b7a12113a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:24.423170 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b9008-67c1-45e8-9442-da7b7a12113a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:24.423616 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b9008-67c1-45e8-9442-da7b7a12113a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:24.423816 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b9008-67c1-45e8-9442-da7b7a12113a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:24.436293 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b9008-67c1-45e8-9442-da7b7a12113a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:44:24.445174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-cc1b9008-67c1-45e8-9442-da7b7a12113a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:44:24.445174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:24.445174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:24.445174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:24.445174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:24.445174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:24.445174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:24.445174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:24.445174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:24.445174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:24.445174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:24.445174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:24.445174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:44:24.445174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:44:24.445174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:44:24.445174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:44:24.446724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:44:24.446724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:44:24.446724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:44:24.446724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:44:24.446724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:24.446724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:24.446724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:24.446724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:24.446724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:24.446724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:24.446724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:24.446724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:24.446724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:24.446724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:24.446724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:24.446724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:24.447964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:24.447964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:24.447964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:24.447964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:24.447964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:44:24.447964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:44:24.447964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:44:24.447964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:44:24.447964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:44:24.447964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:44:24.447964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:44:24.447964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:44:24.447964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 624/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:44:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:44:24.453121 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76acd3d-348c-49cd-884e-2e11f69923f6 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:24.570727 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76acd3d-348c-49cd-884e-2e11f69923f6 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:24.607057 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:24.614800 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4024c78c-aea4-4310-96a8-5017ea15cd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:24.615725 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024c78c-aea4-4310-96a8-5017ea15cd40 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:24.616015 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024c78c-aea4-4310-96a8-5017ea15cd40 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:24.616296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024c78c-aea4-4310-96a8-5017ea15cd40 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:24.617067 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4024c78c-aea4-4310-96a8-5017ea15cd40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:24.617383 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4024c78c-aea4-4310-96a8-5017ea15cd40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:24.618998 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4024c78c-aea4-4310-96a8-5017ea15cd40 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:24.630389 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 626/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:44:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:24.636421 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b9008-67c1-45e8-9442-da7b7a12113a None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:24.728055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:24.758500 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b9008-67c1-45e8-9442-da7b7a12113a None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:24.799389 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e6ebe-8478-49a1-9f3b-3c17affca3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:24.800241 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e6ebe-8478-49a1-9f3b-3c17affca3db None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:24.800566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e6ebe-8478-49a1-9f3b-3c17affca3db None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:24.800852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e6ebe-8478-49a1-9f3b-3c17affca3db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:24.814211 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e6ebe-8478-49a1-9f3b-3c17affca3db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:24.815738 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e6ebe-8478-49a1-9f3b-3c17affca3db None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:24.839110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-3c2e6ebe-8478-49a1-9f3b-3c17affca3db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:44:24.839110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:24.839110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:24.839110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:24.839110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:24.839110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:24.839110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:24.839110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:24.839110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:24.839110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:24.839110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:24.839110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:24.839110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:44:24.839110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:44:24.839110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:44:24.840371 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:44:24.840371 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:24.840371 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:24.840371 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:24.840371 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:24.840371 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:24.840371 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:24.840371 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:24.840371 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:24.840371 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:24.840371 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:24.840371 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:24.840371 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:24.840371 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:24.840371 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:24.840371 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:24.840371 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:24.841312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:44:24.841312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:44:24.841312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:44:24.841312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:44:24.841312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 625/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:44:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:44:24.847208 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4024c78c-aea4-4310-96a8-5017ea15cd40 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:24.962749 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4024c78c-aea4-4310-96a8-5017ea15cd40 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:24.999428 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4eae7e-d4d5-4777-af40-625411add24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:25.000174 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4eae7e-d4d5-4777-af40-625411add24c None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:25.000407 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4eae7e-d4d5-4777-af40-625411add24c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:25.000684 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4eae7e-d4d5-4777-af40-625411add24c None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:25.001473 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4eae7e-d4d5-4777-af40-625411add24c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:25.001775 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4eae7e-d4d5-4777-af40-625411add24c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:25.003310 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4eae7e-d4d5-4777-af40-625411add24c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:25.017113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 627/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:25.023272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e6ebe-8478-49a1-9f3b-3c17affca3db None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:25.141162 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e6ebe-8478-49a1-9f3b-3c17affca3db None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:25.170608 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:25.180996 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2f4f0-980f-43b2-8f96-b6696f10cb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:25.181837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2f4f0-980f-43b2-8f96-b6696f10cb88 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:25.182193 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2f4f0-980f-43b2-8f96-b6696f10cb88 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:25.182499 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2f4f0-980f-43b2-8f96-b6696f10cb88 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:25.191678 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2f4f0-980f-43b2-8f96-b6696f10cb88 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:25.193241 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2f4f0-980f-43b2-8f96-b6696f10cb88 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:25.209566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-b9f2f4f0-980f-43b2-8f96-b6696f10cb88 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 05:44:25.209566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:25.209566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:25.209566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:25.209566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:25.209566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:25.209566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:25.209566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:25.209566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:25.209566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:25.209566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:25.209566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:25.209566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:44:25.209566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:44:25.209566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:44:25.209566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:44:25.210748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:25.210748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:25.210748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:44:25.210748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:44:25.210748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:44:25.210748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:44:25.210748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:25.210748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:25.210748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:25.210748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:25.210748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:25.210748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:25.210748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:25.210748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:25.210748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:25.210748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:25.210748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:25.210748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:25.212319 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:25.212319 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:25.212319 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:44:25.212319 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:44:25.212319 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:44:25.212319 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:44:25.212319 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:44:25.212319 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:44:25.212319 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 05:44:25.212319 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:44:25.212319 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 626/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:44:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:44:25.217060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4eae7e-d4d5-4777-af40-625411add24c None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:25.286305 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:25.339504 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4eae7e-d4d5-4777-af40-625411add24c None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:25.380405 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f8cb7-f95a-480e-a008-dd8c783146c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:25.381467 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f8cb7-f95a-480e-a008-dd8c783146c1 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:25.381820 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f8cb7-f95a-480e-a008-dd8c783146c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:25.382143 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f8cb7-f95a-480e-a008-dd8c783146c1 None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:25.383512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f8cb7-f95a-480e-a008-dd8c783146c1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:25.384065 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f8cb7-f95a-480e-a008-dd8c783146c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:25.386319 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f8cb7-f95a-480e-a008-dd8c783146c1 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:25.406210 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 628/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Jun 21 05:44:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:25.412726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2f4f0-980f-43b2-8f96-b6696f10cb88 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:25.532173 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2f4f0-980f-43b2-8f96-b6696f10cb88 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:25.569258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68366f37-55e4-4363-a4f0-c60644f8fcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:25.569915 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68366f37-55e4-4363-a4f0-c60644f8fcc3 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:25.570223 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68366f37-55e4-4363-a4f0-c60644f8fcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:25.570501 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68366f37-55e4-4363-a4f0-c60644f8fcc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:25.629062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:25.643473 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68366f37-55e4-4363-a4f0-c60644f8fcc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:25.646191 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68366f37-55e4-4363-a4f0-c60644f8fcc3 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:25.757166 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 627/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:44:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 05:44:25.763565 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f8cb7-f95a-480e-a008-dd8c783146c1 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:25.892588 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f8cb7-f95a-480e-a008-dd8c783146c1 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:25.908587 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:25.933456 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b066a-1139-4d2c-9415-d9cf2de0f2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:25.934272 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b066a-1139-4d2c-9415-d9cf2de0f2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:25.934559 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b066a-1139-4d2c-9415-d9cf2de0f2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:25.934836 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b066a-1139-4d2c-9415-d9cf2de0f2e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:25.945469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b066a-1139-4d2c-9415-d9cf2de0f2e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:25.946948 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b066a-1139-4d2c-9415-d9cf2de0f2e8 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:25.965141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-a56b066a-1139-4d2c-9415-d9cf2de0f2e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:44:25.965141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:25.965141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:25.965141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:25.965141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:25.965141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:25.965141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:25.965141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:25.965141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:25.965141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:25.965141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:25.965141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:25.965141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:44:25.965141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:44:25.965141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:44:25.966247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:44:25.966247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:25.966247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:25.966247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:25.966247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:25.966247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:25.966247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:25.966247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:25.966247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:25.966247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:25.966247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:25.966247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:25.966247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:25.966247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:25.966247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:25.966247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:25.966247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:25.967169 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:44:25.967169 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:44:25.967169 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:44:25.967169 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:44:25.967169 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 629/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:44:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:44:25.974513 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68366f37-55e4-4363-a4f0-c60644f8fcc3 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:26.075311 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:26.089589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68366f37-55e4-4363-a4f0-c60644f8fcc3 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:26.135112 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4c2ea-1567-467b-b341-133edd04bc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:26.135744 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4c2ea-1567-467b-b341-133edd04bc79 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:26.136051 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4c2ea-1567-467b-b341-133edd04bc79 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:26.136301 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4c2ea-1567-467b-b341-133edd04bc79 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:26.137029 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4c2ea-1567-467b-b341-133edd04bc79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:26.137337 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4c2ea-1567-467b-b341-133edd04bc79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:26.138740 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4c2ea-1567-467b-b341-133edd04bc79 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:26.151190 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 628/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:44:26.156775 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b066a-1139-4d2c-9415-d9cf2de0f2e8 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:26.268851 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b066a-1139-4d2c-9415-d9cf2de0f2e8 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:26.303919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd06ba-9544-4c02-8167-338e3d7a9128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:26.304705 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd06ba-9544-4c02-8167-338e3d7a9128 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:26.304985 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd06ba-9544-4c02-8167-338e3d7a9128 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:26.305260 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd06ba-9544-4c02-8167-338e3d7a9128 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:26.311837 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd06ba-9544-4c02-8167-338e3d7a9128 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:26.313274 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd06ba-9544-4c02-8167-338e3d7a9128 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:26.326853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-07cd06ba-9544-4c02-8167-338e3d7a9128 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:44:26.326853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:26.326853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:26.326853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:26.326853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:26.326853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:26.326853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:26.326853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:26.326853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:26.326853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:26.326853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:26.326853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:26.326853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:44:26.326853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:44:26.326853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:44:26.327940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:44:26.327940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:26.327940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:26.327940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:26.327940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:26.327940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:26.327940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:26.327940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:26.327940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:26.327940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:26.327940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:26.327940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:26.327940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:26.327940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:26.327940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:26.327940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:26.327940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:26.328924 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:44:26.328924 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:44:26.328924 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:44:26.328924 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:44:26.328924 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:44:26.328924 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:44:26.328924 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:44:26.328924 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:44:26.328924 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 630/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:44:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:44:26.334654 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4c2ea-1567-467b-b341-133edd04bc79 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:26.441632 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4c2ea-1567-467b-b341-133edd04bc79 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:26.483738 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6af9b4-88a6-4ef1-93e1-4bd3b1879c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:26.484378 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6af9b4-88a6-4ef1-93e1-4bd3b1879c3e None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:26.484702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6af9b4-88a6-4ef1-93e1-4bd3b1879c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:26.485027 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6af9b4-88a6-4ef1-93e1-4bd3b1879c3e None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:26.485875 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6af9b4-88a6-4ef1-93e1-4bd3b1879c3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:26.486258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6af9b4-88a6-4ef1-93e1-4bd3b1879c3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:26.487832 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6af9b4-88a6-4ef1-93e1-4bd3b1879c3e None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:26.501393 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 629/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:44:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:26.508079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd06ba-9544-4c02-8167-338e3d7a9128 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:26.535637 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:26.614138 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd06ba-9544-4c02-8167-338e3d7a9128 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:26.648976 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e41ed8-6217-409a-b852-fa5248793107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:26.649633 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e41ed8-6217-409a-b852-fa5248793107 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:26.649919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e41ed8-6217-409a-b852-fa5248793107 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:26.650225 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e41ed8-6217-409a-b852-fa5248793107 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:26.651050 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e41ed8-6217-409a-b852-fa5248793107 None admin] RBAC: Adding query filter params (role.id=24aa6040c86049f996560e477e83886f, scope.project.id=e64b932ef6bf481cb93a04885a93b4b2, user.id=d17a40bea6ba41f19c88e16f9b15cf27) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:26.651364 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e41ed8-6217-409a-b852-fa5248793107 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:26.652856 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e41ed8-6217-409a-b852-fa5248793107 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:26.659075 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 631/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:44:26 2022] GET /identity/v3/role_assignments?user.id=d17a40bea6ba41f19c88e16f9b15cf27&scope.project.id=e64b932ef6bf481cb93a04885a93b4b2&role.id=24aa6040c86049f996560e477e83886f => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:28.713481 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571488f1-cfa9-4fa4-aac5-dc6cf236b705 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:28.714056 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571488f1-cfa9-4fa4-aac5-dc6cf236b705 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:28.714056 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571488f1-cfa9-4fa4-aac5-dc6cf236b705 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:28.715464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 630/1261] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:44:28.720556 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c823ba-f2f6-4ab1-97af-b2688f74b93e None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:28.720978 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c823ba-f2f6-4ab1-97af-b2688f74b93e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:28.721119 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c823ba-f2f6-4ab1-97af-b2688f74b93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:28.738455 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-f5c823ba-f2f6-4ab1-97af-b2688f74b93e None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:44:28.739646 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f5c823ba-f2f6-4ab1-97af-b2688f74b93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:44:28.810002 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 632/1262] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:44:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:44:28.835922 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571488f1-cfa9-4fa4-aac5-dc6cf236b705 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:28.847225 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:28.936551 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571488f1-cfa9-4fa4-aac5-dc6cf236b705 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:28.970783 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12897b-ca0e-4cfb-823c-439143d89ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:28.971494 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12897b-ca0e-4cfb-823c-439143d89ffa None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:28.971780 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12897b-ca0e-4cfb-823c-439143d89ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:28.972079 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12897b-ca0e-4cfb-823c-439143d89ffa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:28.982211 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12897b-ca0e-4cfb-823c-439143d89ffa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:44:28.989796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-ea12897b-ca0e-4cfb-823c-439143d89ffa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:44:28.989796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:28.989796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:28.989796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:28.989796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:28.989796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:28.989796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:28.989796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:28.989796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:28.989796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:28.989796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:28.989796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:28.989796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:44:28.989796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:44:28.989796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:44:28.989796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:44:28.990909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:44:28.990909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:44:28.990909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:44:28.990909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:44:28.990909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:28.990909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:28.990909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:28.990909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:28.990909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:28.990909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:28.990909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:28.990909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:28.990909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:28.990909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:28.990909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:28.990909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:28.991938 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:28.991938 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:28.991938 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:28.991938 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:28.991938 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:44:28.991938 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:44:28.991938 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:44:28.991938 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:44:28.991938 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:44:28.991938 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:44:28.991938 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:44:28.991938 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:44:28.991938 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 631/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:44:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:44:28.997145 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c823ba-f2f6-4ab1-97af-b2688f74b93e None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:29.015625 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:29.094378 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c823ba-f2f6-4ab1-97af-b2688f74b93e None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:29.128384 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc694f-9893-4573-9011-c2150c116b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:29.129675 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc694f-9893-4573-9011-c2150c116b90 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:29.130027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc694f-9893-4573-9011-c2150c116b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:29.130303 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc694f-9893-4573-9011-c2150c116b90 None admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:29.131036 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc694f-9893-4573-9011-c2150c116b90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:29.131339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc694f-9893-4573-9011-c2150c116b90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:29.132699 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc694f-9893-4573-9011-c2150c116b90 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:29.140657 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 633/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:44:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:29.146371 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12897b-ca0e-4cfb-823c-439143d89ffa None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:29.212222 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:29.246106 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12897b-ca0e-4cfb-823c-439143d89ffa None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:29.278889 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b12d7-b023-40ec-93bc-1c8c70e72a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:29.279698 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b12d7-b023-40ec-93bc-1c8c70e72a56 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:29.279969 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b12d7-b023-40ec-93bc-1c8c70e72a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:29.280248 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b12d7-b023-40ec-93bc-1c8c70e72a56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:29.290774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b12d7-b023-40ec-93bc-1c8c70e72a56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:29.292215 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b12d7-b023-40ec-93bc-1c8c70e72a56 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:29.309550 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-0c2b12d7-b023-40ec-93bc-1c8c70e72a56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:44:29.309550 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:29.309550 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:29.309550 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:29.309550 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:29.309550 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:29.309550 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:29.309550 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:29.309550 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:29.309550 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:29.309550 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:29.309550 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:29.309550 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:44:29.309550 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:44:29.309550 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:44:29.310712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:44:29.310712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:29.310712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:29.310712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:29.310712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:29.310712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:29.310712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:29.310712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:29.310712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:29.310712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:29.310712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:29.310712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:29.310712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:29.310712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:29.310712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:29.310712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:29.310712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:29.311846 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:44:29.311846 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:44:29.311846 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:44:29.311846 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:44:29.311846 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 632/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:44:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:44:29.317264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc694f-9893-4573-9011-c2150c116b90 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:29.398289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:29.417074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc694f-9893-4573-9011-c2150c116b90 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:29.452156 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ecb47-adfd-43e9-8870-a5f389393cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:29.452845 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ecb47-adfd-43e9-8870-a5f389393cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:29.453128 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ecb47-adfd-43e9-8870-a5f389393cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:29.453403 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ecb47-adfd-43e9-8870-a5f389393cf3 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:29.454169 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ecb47-adfd-43e9-8870-a5f389393cf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:29.454479 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ecb47-adfd-43e9-8870-a5f389393cf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:29.455895 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ecb47-adfd-43e9-8870-a5f389393cf3 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:29.468669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 634/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:29.474388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b12d7-b023-40ec-93bc-1c8c70e72a56 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:29.574935 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b12d7-b023-40ec-93bc-1c8c70e72a56 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:29.594722 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:29.609584 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8ebfe-23ea-4dbe-b384-d837e9aa58de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:29.610429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8ebfe-23ea-4dbe-b384-d837e9aa58de None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:29.610720 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8ebfe-23ea-4dbe-b384-d837e9aa58de None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:29.611002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8ebfe-23ea-4dbe-b384-d837e9aa58de None admin] PATH_INFO: `/v3/users/placement` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:29.619282 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb8ebfe-23ea-4dbe-b384-d837e9aa58de None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:29.620728 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb8ebfe-23ea-4dbe-b384-d837e9aa58de None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:29.635006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-3cb8ebfe-23ea-4dbe-b384-d837e9aa58de None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 05:44:29.635006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:29.635006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:29.635006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:29.635006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:29.635006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:29.635006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:29.635006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:29.635006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:29.635006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:29.635006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:29.635006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:29.635006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:44:29.635006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:44:29.635006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:44:29.635006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:44:29.636145 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:29.636145 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:29.636145 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:44:29.636145 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:44:29.636145 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:44:29.636145 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:44:29.636145 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:29.636145 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:29.636145 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:29.636145 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:29.636145 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:29.636145 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:29.636145 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:29.636145 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:29.636145 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:29.636145 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:29.636145 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:29.636145 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:29.637329 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:29.637329 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:29.637329 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:44:29.637329 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:44:29.637329 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:44:29.637329 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:44:29.637329 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:44:29.637329 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:44:29.637329 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 05:44:29.637329 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:44:29.637329 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 633/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:44:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:44:29.642154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ecb47-adfd-43e9-8870-a5f389393cf3 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:29.740575 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ecb47-adfd-43e9-8870-a5f389393cf3 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:29.773126 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e98fd-5a74-4a03-a3df-9b82d546739f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:29.773786 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e98fd-5a74-4a03-a3df-9b82d546739f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:29.774104 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e98fd-5a74-4a03-a3df-9b82d546739f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:29.774384 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e98fd-5a74-4a03-a3df-9b82d546739f None admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:29.775214 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e98fd-5a74-4a03-a3df-9b82d546739f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:29.775524 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e98fd-5a74-4a03-a3df-9b82d546739f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:29.776959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e98fd-5a74-4a03-a3df-9b82d546739f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:29.786144 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:29.795982 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 635/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Jun 21 05:44:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:29.802823 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8ebfe-23ea-4dbe-b384-d837e9aa58de None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:29.903245 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8ebfe-23ea-4dbe-b384-d837e9aa58de None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:29.935327 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968551a-2af5-48a2-9355-5b5a2fb08b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:29.936106 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968551a-2af5-48a2-9355-5b5a2fb08b02 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:29.936387 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968551a-2af5-48a2-9355-5b5a2fb08b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:29.936662 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968551a-2af5-48a2-9355-5b5a2fb08b02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:29.946908 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e968551a-2af5-48a2-9355-5b5a2fb08b02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:29.948339 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e968551a-2af5-48a2-9355-5b5a2fb08b02 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:29.965461 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-e968551a-2af5-48a2-9355-5b5a2fb08b02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:44:29.965461 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:29.965461 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:29.965461 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:29.965461 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:29.965461 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:29.965461 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:29.965461 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:29.965461 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:29.965461 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:29.965461 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:29.965461 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:29.965461 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:44:29.965461 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:44:29.965461 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:44:29.966504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:44:29.966504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:29.966504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:29.966504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:29.966504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:29.966504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:29.966504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:29.966504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:29.966504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:29.966504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:29.966504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:29.966504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:29.966504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:29.966504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:29.966504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:29.966504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:29.966504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:29.967450 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:44:29.967450 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:44:29.967450 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:44:29.967450 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:44:29.967450 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 634/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:44:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 05:44:29.972379 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e98fd-5a74-4a03-a3df-9b82d546739f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:30.070057 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e98fd-5a74-4a03-a3df-9b82d546739f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:30.103244 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac4b94-1af2-4783-8794-4959f2d472a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:30.103902 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac4b94-1af2-4783-8794-4959f2d472a6 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:30.104185 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac4b94-1af2-4783-8794-4959f2d472a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:30.104469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac4b94-1af2-4783-8794-4959f2d472a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:30.105184 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac4b94-1af2-4783-8794-4959f2d472a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:30.105493 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac4b94-1af2-4783-8794-4959f2d472a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:30.106902 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac4b94-1af2-4783-8794-4959f2d472a6 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:30.118598 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 636/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:30.124076 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968551a-2af5-48a2-9355-5b5a2fb08b02 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:30.155087 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:30.221750 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968551a-2af5-48a2-9355-5b5a2fb08b02 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:30.255230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e0be9-f30b-487e-af20-c732cbb3c75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:30.256013 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e0be9-f30b-487e-af20-c732cbb3c75a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:30.256299 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e0be9-f30b-487e-af20-c732cbb3c75a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:30.256576 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e0be9-f30b-487e-af20-c732cbb3c75a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:30.263068 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e0be9-f30b-487e-af20-c732cbb3c75a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:30.264503 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e0be9-f30b-487e-af20-c732cbb3c75a None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:30.279140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-296e0be9-f30b-487e-af20-c732cbb3c75a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:44:30.279140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:30.279140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:30.279140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:30.279140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:30.279140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:30.279140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:30.279140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:30.279140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:30.279140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:30.279140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:30.279140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:30.279140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:44:30.279140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:44:30.279140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:44:30.280055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:44:30.280055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:30.280055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:30.280055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:30.280055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:30.280055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:30.280055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:30.280055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:30.280055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:30.280055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:30.280055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:30.280055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:30.280055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:30.280055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:30.280055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:30.280055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:30.280055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:30.281034 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:44:30.281034 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:44:30.281034 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:44:30.281034 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:44:30.281034 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:44:30.281034 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:44:30.281034 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:44:30.281034 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:44:30.281034 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 635/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:44:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:44:30.286643 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac4b94-1af2-4783-8794-4959f2d472a6 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:30.343156 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:30.384713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac4b94-1af2-4783-8794-4959f2d472a6 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:30.419019 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc15664-12d1-4fed-b836-577528af7b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:30.419586 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc15664-12d1-4fed-b836-577528af7b48 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:30.419867 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc15664-12d1-4fed-b836-577528af7b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:30.420141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc15664-12d1-4fed-b836-577528af7b48 None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:30.420918 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc15664-12d1-4fed-b836-577528af7b48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:30.421222 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc15664-12d1-4fed-b836-577528af7b48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:30.422672 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc15664-12d1-4fed-b836-577528af7b48 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:30.434161 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 637/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:44:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:30.440063 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e0be9-f30b-487e-af20-c732cbb3c75a None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:30.529659 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:30.538402 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e0be9-f30b-487e-af20-c732cbb3c75a None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:30.571887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199db51-9c96-488c-b246-187265fa1710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:30.572765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199db51-9c96-488c-b246-187265fa1710 None admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:30.573042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199db51-9c96-488c-b246-187265fa1710 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:30.573314 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199db51-9c96-488c-b246-187265fa1710 None admin] PATH_INFO: `/v3/projects/e64b932ef6bf481cb93a04885a93b4b2/users/d17a40bea6ba41f19c88e16f9b15cf27/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:30.575271 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199db51-9c96-488c-b246-187265fa1710 None admin] RBAC: Authorizing `identity:create_grant(project_id=e64b932ef6bf481cb93a04885a93b4b2, user_id=d17a40bea6ba41f19c88e16f9b15cf27, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:30.576679 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199db51-9c96-488c-b246-187265fa1710 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:30.590484 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 636/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jun 21 05:44:30 2022] PUT /identity/v3/projects/e64b932ef6bf481cb93a04885a93b4b2/users/d17a40bea6ba41f19c88e16f9b15cf27/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:44:32.585785 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51dc222-83d9-47c4-acd4-ca933486c987 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:32.586331 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51dc222-83d9-47c4-acd4-ca933486c987 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:32.586331 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51dc222-83d9-47c4-acd4-ca933486c987 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:32.587664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 638/1274] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:44:32.593156 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60a851-76ab-46a8-951c-01080028ddae None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:32.593628 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60a851-76ab-46a8-951c-01080028ddae None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:32.593738 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60a851-76ab-46a8-951c-01080028ddae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:32.610556 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-5f60a851-76ab-46a8-951c-01080028ddae None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:44:32.611751 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-5f60a851-76ab-46a8-951c-01080028ddae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:44:32.680340 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 637/1275] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:44:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:44:32.704578 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51dc222-83d9-47c4-acd4-ca933486c987 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:32.815620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51dc222-83d9-47c4-acd4-ca933486c987 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:32.840635 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:32.858342 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c982a27-5564-4b46-a0d3-839d415e9988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:32.859121 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c982a27-5564-4b46-a0d3-839d415e9988 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:32.859406 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c982a27-5564-4b46-a0d3-839d415e9988 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:32.859683 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c982a27-5564-4b46-a0d3-839d415e9988 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:32.870239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c982a27-5564-4b46-a0d3-839d415e9988 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 05:44:32.877798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-8c982a27-5564-4b46-a0d3-839d415e9988 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:44:32.877798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:32.877798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:32.877798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:32.877798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:32.877798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:32.877798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:32.877798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:32.877798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:32.877798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:32.877798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:32.877798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:32.877798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 05:44:32.877798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 05:44:32.877798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 05:44:32.877798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 05:44:32.879541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 05:44:32.879541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 05:44:32.879541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 05:44:32.879541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 05:44:32.879541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:32.879541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:32.879541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:32.879541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:32.879541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:32.879541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:32.879541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:32.879541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:32.879541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:32.879541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:32.879541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:32.879541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:32.880415 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:32.880415 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:32.880415 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:32.880415 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:32.880415 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 05:44:32.880415 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 05:44:32.880415 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 05:44:32.880415 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 05:44:32.880415 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 05:44:32.880415 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 05:44:32.880415 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 05:44:32.880415 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:44:32.880415 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 639/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jun 21 05:44:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:44:32.885755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60a851-76ab-46a8-951c-01080028ddae None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:32.968262 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:32.987122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60a851-76ab-46a8-951c-01080028ddae None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:33.020701 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd832ae-a288-4983-9d11-96248dd58839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:33.021366 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd832ae-a288-4983-9d11-96248dd58839 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:33.021652 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd832ae-a288-4983-9d11-96248dd58839 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:33.021950 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd832ae-a288-4983-9d11-96248dd58839 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:33.022699 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd832ae-a288-4983-9d11-96248dd58839 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:33.023008 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd832ae-a288-4983-9d11-96248dd58839 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:33.024370 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd832ae-a288-4983-9d11-96248dd58839 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:33.032305 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 638/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jun 21 05:44:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:33.037974 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c982a27-5564-4b46-a0d3-839d415e9988 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:33.137749 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c982a27-5564-4b46-a0d3-839d415e9988 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:33.169881 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74305c-db9d-42c6-ae25-de79b69a572f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:33.170701 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74305c-db9d-42c6-ae25-de79b69a572f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:33.170975 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74305c-db9d-42c6-ae25-de79b69a572f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:33.171253 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74305c-db9d-42c6-ae25-de79b69a572f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:33.181998 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74305c-db9d-42c6-ae25-de79b69a572f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:33.183443 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74305c-db9d-42c6-ae25-de79b69a572f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:33.200605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-0c74305c-db9d-42c6-ae25-de79b69a572f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:44:33.200605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:33.200605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:33.200605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:33.200605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:33.200605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:33.200605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:33.200605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:33.200605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:33.200605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:33.200605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:33.200605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:33.200605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:44:33.200605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:44:33.200605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:44:33.201645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:44:33.201645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:33.201645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:33.201645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:33.201645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:33.201645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:33.201645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:33.201645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:33.201645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:33.201645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:33.201645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:33.201645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:33.201645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:33.201645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:33.201645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:33.201645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:33.201645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:33.202684 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:44:33.202684 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:44:33.202684 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:44:33.202684 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:44:33.202684 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 640/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:44:33.207544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd832ae-a288-4983-9d11-96248dd58839 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:33.305254 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd832ae-a288-4983-9d11-96248dd58839 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:33.337309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997f589-6024-4989-806a-0e5db1bd1b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:33.337982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997f589-6024-4989-806a-0e5db1bd1b53 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:33.338274 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997f589-6024-4989-806a-0e5db1bd1b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:33.338555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997f589-6024-4989-806a-0e5db1bd1b53 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:33.339277 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997f589-6024-4989-806a-0e5db1bd1b53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:33.339589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997f589-6024-4989-806a-0e5db1bd1b53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:33.340947 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997f589-6024-4989-806a-0e5db1bd1b53 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:33.353160 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 639/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:33.358765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74305c-db9d-42c6-ae25-de79b69a572f None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:33.389506 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:33.462713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74305c-db9d-42c6-ae25-de79b69a572f None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:33.498056 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd483e-b415-4ade-b937-4f9495702262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:33.498855 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd483e-b415-4ade-b937-4f9495702262 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:33.499143 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd483e-b415-4ade-b937-4f9495702262 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:33.499421 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd483e-b415-4ade-b937-4f9495702262 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:33.507087 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd483e-b415-4ade-b937-4f9495702262 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:33.508552 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd483e-b415-4ade-b937-4f9495702262 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:33.522764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-5ebd483e-b415-4ade-b937-4f9495702262 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 05:44:33.522764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:33.522764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:33.522764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:33.522764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:33.522764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:33.522764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:33.522764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:33.522764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:33.522764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:33.522764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:33.522764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:33.522764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 05:44:33.522764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 05:44:33.522764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 05:44:33.522764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 05:44:33.523930 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:33.523930 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:33.523930 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 05:44:33.523930 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:44:33.523930 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 05:44:33.523930 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 05:44:33.523930 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:33.523930 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:33.523930 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:33.523930 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:33.523930 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:33.523930 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:33.523930 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:33.523930 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:33.523930 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:33.523930 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:33.523930 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:33.523930 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:33.529618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:33.529618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:33.529618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 05:44:33.529618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 05:44:33.529618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 05:44:33.529618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 05:44:33.529618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 05:44:33.529618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 05:44:33.529618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 05:44:33.529618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:44:33.529618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 641/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:44:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:44:33.530396 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997f589-6024-4989-806a-0e5db1bd1b53 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:33.533550 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:33.628167 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997f589-6024-4989-806a-0e5db1bd1b53 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:33.661645 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb889b-bc42-4baa-ac04-7dd800852498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:33.662254 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb889b-bc42-4baa-ac04-7dd800852498 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:33.662539 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb889b-bc42-4baa-ac04-7dd800852498 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:33.662815 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb889b-bc42-4baa-ac04-7dd800852498 None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:33.663641 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb889b-bc42-4baa-ac04-7dd800852498 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:33.663946 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb889b-bc42-4baa-ac04-7dd800852498 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:33.665354 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb889b-bc42-4baa-ac04-7dd800852498 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:33.682844 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 640/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Jun 21 05:44:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:33.688800 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd483e-b415-4ade-b937-4f9495702262 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:33.778232 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:33.789563 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd483e-b415-4ade-b937-4f9495702262 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:33.828280 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119f622-24ab-49cb-aad1-abcac479a264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:33.828932 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119f622-24ab-49cb-aad1-abcac479a264 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:33.829219 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119f622-24ab-49cb-aad1-abcac479a264 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:33.829506 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119f622-24ab-49cb-aad1-abcac479a264 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:33.897188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119f622-24ab-49cb-aad1-abcac479a264 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:33.898695 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119f622-24ab-49cb-aad1-abcac479a264 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:33.986096 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:33.996394 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 642/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jun 21 05:44:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 05:44:34.002248 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb889b-bc42-4baa-ac04-7dd800852498 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:34.065688 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:34.105266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb889b-bc42-4baa-ac04-7dd800852498 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:34.140029 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42711a-fb3e-4f25-9b97-9f2d3f163ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:34.140818 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42711a-fb3e-4f25-9b97-9f2d3f163ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:34.141100 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42711a-fb3e-4f25-9b97-9f2d3f163ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:34.141375 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42711a-fb3e-4f25-9b97-9f2d3f163ec3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:34.152365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42711a-fb3e-4f25-9b97-9f2d3f163ec3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:34.153813 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42711a-fb3e-4f25-9b97-9f2d3f163ec3 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:34.171194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-7d42711a-fb3e-4f25-9b97-9f2d3f163ec3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:44:34.171194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:34.171194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:34.171194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:34.171194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:34.171194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:34.171194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:34.171194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:34.171194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:34.171194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:34.171194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:34.171194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:34.171194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 05:44:34.171194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 05:44:34.171194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 05:44:34.172395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 05:44:34.172395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:34.172395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:34.172395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:34.172395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:34.172395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:34.172395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:34.172395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:34.172395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:34.172395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:34.172395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:34.172395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:34.172395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:34.172395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:34.172395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:34.172395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:34.172395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:34.173328 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 05:44:34.173328 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 05:44:34.173328 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 05:44:34.173328 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:44:34.173328 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 641/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:44:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:44:34.178112 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119f622-24ab-49cb-aad1-abcac479a264 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:34.274744 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119f622-24ab-49cb-aad1-abcac479a264 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:34.307002 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd470d4-3b1b-4748-9ca1-7e29a0bab764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:34.307659 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd470d4-3b1b-4748-9ca1-7e29a0bab764 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:34.307944 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd470d4-3b1b-4748-9ca1-7e29a0bab764 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:34.308220 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd470d4-3b1b-4748-9ca1-7e29a0bab764 None admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:34.308933 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd470d4-3b1b-4748-9ca1-7e29a0bab764 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:34.309243 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd470d4-3b1b-4748-9ca1-7e29a0bab764 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:34.310642 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd470d4-3b1b-4748-9ca1-7e29a0bab764 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:34.322232 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 643/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jun 21 05:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:34.328096 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42711a-fb3e-4f25-9b97-9f2d3f163ec3 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:34.426527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42711a-fb3e-4f25-9b97-9f2d3f163ec3 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:34.440304 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:34.460867 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65eea68-c156-4075-90ed-a94c12ee6ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:34.461666 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65eea68-c156-4075-90ed-a94c12ee6ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:34.461975 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65eea68-c156-4075-90ed-a94c12ee6ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:34.462261 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65eea68-c156-4075-90ed-a94c12ee6ef7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:34.469025 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65eea68-c156-4075-90ed-a94c12ee6ef7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:34.470511 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65eea68-c156-4075-90ed-a94c12ee6ef7 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:34.484451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-a65eea68-c156-4075-90ed-a94c12ee6ef7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:44:34.484451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:34.484451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:34.484451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:34.484451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:34.484451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:34.484451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:34.484451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:34.484451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:34.484451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:34.484451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:34.484451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:34.484451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 05:44:34.484451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 05:44:34.484451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 05:44:34.485762 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 05:44:34.485762 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:34.485762 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:34.485762 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:34.485762 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:34.485762 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:34.485762 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:34.485762 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:34.485762 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:34.485762 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:34.485762 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:34.485762 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:34.485762 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:34.485762 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:34.485762 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:34.485762 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:34.485762 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:34.487065 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 05:44:34.487065 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 05:44:34.487065 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 05:44:34.487065 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 05:44:34.487065 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 05:44:34.487065 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 05:44:34.487065 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 05:44:34.487065 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 21 05:44:34.487065 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 642/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jun 21 05:44:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:44:34.493779 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd470d4-3b1b-4748-9ca1-7e29a0bab764 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:34.542568 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:34.592386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd470d4-3b1b-4748-9ca1-7e29a0bab764 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:34.626250 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d83249-7b41-4bf1-9bfc-bf78be57208f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:34.626916 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d83249-7b41-4bf1-9bfc-bf78be57208f None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:34.627204 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d83249-7b41-4bf1-9bfc-bf78be57208f None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:34.627487 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d83249-7b41-4bf1-9bfc-bf78be57208f None admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:34.628270 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d83249-7b41-4bf1-9bfc-bf78be57208f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:34.629190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d83249-7b41-4bf1-9bfc-bf78be57208f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:34.630655 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d83249-7b41-4bf1-9bfc-bf78be57208f None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:34.642486 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 644/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jun 21 05:44:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:34.648594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65eea68-c156-4075-90ed-a94c12ee6ef7 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:34.748009 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65eea68-c156-4075-90ed-a94c12ee6ef7 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:34.782129 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e993ad4b-b97a-415d-b9e8-eb1a6f76b685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:34.782782 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993ad4b-b97a-415d-b9e8-eb1a6f76b685 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:34.783065 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993ad4b-b97a-415d-b9e8-eb1a6f76b685 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:34.783341 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993ad4b-b97a-415d-b9e8-eb1a6f76b685 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:34.784198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e993ad4b-b97a-415d-b9e8-eb1a6f76b685 None admin] RBAC: Adding query filter params (role.id=24aa6040c86049f996560e477e83886f, scope.project.id=e64b932ef6bf481cb93a04885a93b4b2, user.id=d17a40bea6ba41f19c88e16f9b15cf27) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:34.784515 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e993ad4b-b97a-415d-b9e8-eb1a6f76b685 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:34.786607 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e993ad4b-b97a-415d-b9e8-eb1a6f76b685 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:34.801248 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 643/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jun 21 05:44:34 2022] GET /identity/v3/role_assignments?user.id=d17a40bea6ba41f19c88e16f9b15cf27&scope.project.id=e64b932ef6bf481cb93a04885a93b4b2&role.id=24aa6040c86049f996560e477e83886f => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:36.834303 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a19bfb-d264-4462-8272-103d3ec1afd1 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:36.834839 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a19bfb-d264-4462-8272-103d3ec1afd1 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:36.834839 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a19bfb-d264-4462-8272-103d3ec1afd1 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:36.836213 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 645/1288] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:44:36.841339 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335848b-d90d-4180-9706-c9ced4525d85 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:36.841761 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335848b-d90d-4180-9706-c9ced4525d85 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:36.841911 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335848b-d90d-4180-9706-c9ced4525d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:36.858717 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-9335848b-d90d-4180-9706-c9ced4525d85 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:44:36.859904 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9335848b-d90d-4180-9706-c9ced4525d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:44:36.889559 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:36.928182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 644/1289] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:44:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:44:36.951571 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a19bfb-d264-4462-8272-103d3ec1afd1 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:37.051625 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a19bfb-d264-4462-8272-103d3ec1afd1 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:37.062182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:37.091286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630f44e-12de-4ec5-acdf-9b0885574ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:37.092004 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630f44e-12de-4ec5-acdf-9b0885574ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:37.092289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630f44e-12de-4ec5-acdf-9b0885574ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:37.092568 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630f44e-12de-4ec5-acdf-9b0885574ec8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:37.093233 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630f44e-12de-4ec5-acdf-9b0885574ec8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:37.094631 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630f44e-12de-4ec5-acdf-9b0885574ec8 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:37.107426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-7630f44e-12de-4ec5-acdf-9b0885574ec8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 05:44:37.107426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:37.107426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 05:44:37.107426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 05:44:37.107426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 05:44:37.107426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 05:44:37.107426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 05:44:37.107426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:44:37.107426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 05:44:37.107426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:44:37.107426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:44:37.107426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:44:37.107426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:37.107426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:37.107426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:37.107426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:37.107426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:37.108688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:37.108688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:37.108688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:37.108688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:37.108688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:37.108688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:37.108688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 05:44:37.108688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 05:44:37.108688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 05:44:37.108688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 05:44:37.108688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:37.108688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:37.108688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:37.108688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:37.108688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:37.108688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:37.109790 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:37.109790 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:37.109790 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:37.109790 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:37.109790 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:37.109790 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:37.109790 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:37.109790 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:37.109790 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:37.109790 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:37.109790 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 05:44:37.109790 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:44:37.109790 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 05:44:37.109790 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:44:37.109790 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 646/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jun 21 05:44:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:44:37.116087 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335848b-d90d-4180-9706-c9ced4525d85 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:37.212793 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335848b-d90d-4180-9706-c9ced4525d85 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:37.247037 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4796c9b-8fda-4046-a60f-20a2339228a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:37.247698 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4796c9b-8fda-4046-a60f-20a2339228a1 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:37.247987 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4796c9b-8fda-4046-a60f-20a2339228a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:37.248278 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4796c9b-8fda-4046-a60f-20a2339228a1 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:37.248990 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4796c9b-8fda-4046-a60f-20a2339228a1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:37.249303 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4796c9b-8fda-4046-a60f-20a2339228a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:37.250699 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4796c9b-8fda-4046-a60f-20a2339228a1 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:37.255501 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 645/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Jun 21 05:44:37 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:37.261291 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630f44e-12de-4ec5-acdf-9b0885574ec8 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:37.358618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630f44e-12de-4ec5-acdf-9b0885574ec8 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:37.390643 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089ec88-832a-405e-8c17-68b0f7e914dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:37.391293 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089ec88-832a-405e-8c17-68b0f7e914dc None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:37.391575 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089ec88-832a-405e-8c17-68b0f7e914dc None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:37.391850 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089ec88-832a-405e-8c17-68b0f7e914dc None admin] PATH_INFO: `/v3/services` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:37.392543 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089ec88-832a-405e-8c17-68b0f7e914dc None admin] RBAC: Adding query filter params (type=placement) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:37.392848 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089ec88-832a-405e-8c17-68b0f7e914dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:37.394760 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089ec88-832a-405e-8c17-68b0f7e914dc None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:37.399090 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 647/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Jun 21 05:44:37 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:39.435555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef575fe-be9d-4505-96d8-c6f2481cc23d None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:39.436061 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef575fe-be9d-4505-96d8-c6f2481cc23d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:39.436061 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef575fe-be9d-4505-96d8-c6f2481cc23d None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:39.437395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 646/1293] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:44:39.443079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8ad0a-687f-499e-9e8c-a8ffcbfcc085 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:39.443527 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8ad0a-687f-499e-9e8c-a8ffcbfcc085 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:39.443622 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8ad0a-687f-499e-9e8c-a8ffcbfcc085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:39.460629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-25c8ad0a-687f-499e-9e8c-a8ffcbfcc085 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:44:39.461828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-25c8ad0a-687f-499e-9e8c-a8ffcbfcc085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:44:39.490965 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:39.529236 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 648/1294] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:44:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:44:39.551879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef575fe-be9d-4505-96d8-c6f2481cc23d None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:39.582964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:39.653385 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef575fe-be9d-4505-96d8-c6f2481cc23d None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:39.686266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3bdff-0807-4b48-ac33-7adc74000fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:39.686859 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3bdff-0807-4b48-ac33-7adc74000fce None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:39.687141 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3bdff-0807-4b48-ac33-7adc74000fce None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:39.687416 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3bdff-0807-4b48-ac33-7adc74000fce None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:39.688126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3bdff-0807-4b48-ac33-7adc74000fce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:39.689474 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3bdff-0807-4b48-ac33-7adc74000fce None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:39.703210 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 647/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jun 21 05:44:39 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:44:41.753919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0cc5a-f1d8-4fd9-956b-702e82593b6f None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:41.754499 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0cc5a-f1d8-4fd9-956b-702e82593b6f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:41.754499 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0cc5a-f1d8-4fd9-956b-702e82593b6f None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:41.755984 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 649/1296] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:44:41.761070 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a95b4-690e-4db6-b644-a28549d48ac8 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:41.761492 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a95b4-690e-4db6-b644-a28549d48ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:41.761634 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a95b4-690e-4db6-b644-a28549d48ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:41.778087 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-699a95b4-690e-4db6-b644-a28549d48ac8 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:44:41.779278 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-699a95b4-690e-4db6-b644-a28549d48ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:44:41.861807 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 648/1297] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:44:41 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:44:41.886323 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0cc5a-f1d8-4fd9-956b-702e82593b6f None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:41.986341 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0cc5a-f1d8-4fd9-956b-702e82593b6f None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:42.019827 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187647a-2bb0-4148-bed2-33fdaed57692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:42.020541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187647a-2bb0-4148-bed2-33fdaed57692 None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:42.020828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187647a-2bb0-4148-bed2-33fdaed57692 None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:42.021107 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187647a-2bb0-4148-bed2-33fdaed57692 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:42.021760 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187647a-2bb0-4148-bed2-33fdaed57692 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:42.023167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187647a-2bb0-4148-bed2-33fdaed57692 None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:42.035358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-1187647a-2bb0-4148-bed2-33fdaed57692 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 05:44:42.035358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:42.035358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 05:44:42.035358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 05:44:42.035358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 05:44:42.035358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 05:44:42.035358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 05:44:42.035358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:44:42.035358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 05:44:42.035358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:44:42.035358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:44:42.035358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:44:42.035358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:42.035358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:42.035358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:42.035358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:42.035358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:42.036512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:42.036512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:42.036512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:42.036512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:42.036512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:42.036512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:42.036512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 05:44:42.036512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 05:44:42.036512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 05:44:42.036512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 05:44:42.036512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:42.036512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:42.036512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:42.036512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:42.036512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:42.036512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:42.037575 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:42.037575 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:42.037575 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:42.037575 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:42.037575 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:42.037575 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:42.037575 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:42.037575 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:42.037575 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:42.037575 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:42.037575 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 05:44:42.037575 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:44:42.037575 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 05:44:42.037575 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:44:42.037575 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 650/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jun 21 05:44:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:44:42.042792 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a95b4-690e-4db6-b644-a28549d48ac8 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:42.061051 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:42.145020 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a95b4-690e-4db6-b644-a28549d48ac8 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:42.177794 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7d6cc-2645-43a1-9b08-1b4084d5b0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:42.178491 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7d6cc-2645-43a1-9b08-1b4084d5b0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:42.178786 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7d6cc-2645-43a1-9b08-1b4084d5b0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:42.179065 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7d6cc-2645-43a1-9b08-1b4084d5b0a3 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:42.179794 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d7d6cc-2645-43a1-9b08-1b4084d5b0a3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:42.180103 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d7d6cc-2645-43a1-9b08-1b4084d5b0a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:42.181466 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d7d6cc-2645-43a1-9b08-1b4084d5b0a3 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:42.186536 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 649/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Jun 21 05:44:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:42.192571 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187647a-2bb0-4148-bed2-33fdaed57692 None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:42.224270 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:42.291611 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187647a-2bb0-4148-bed2-33fdaed57692 None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:42.323754 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a54fa-2446-435b-a975-f7d843aad86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:42.324406 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a54fa-2446-435b-a975-f7d843aad86c None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:42.324690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a54fa-2446-435b-a975-f7d843aad86c None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:42.324967 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a54fa-2446-435b-a975-f7d843aad86c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:42.325747 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a54fa-2446-435b-a975-f7d843aad86c None admin] RBAC: Adding query filter params (interface=public, service_id=8fa6ee4d38b9446ab297576cfe19d9d2, region_id=RegionOne) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:42.326091 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a54fa-2446-435b-a975-f7d843aad86c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:42.327457 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a54fa-2446-435b-a975-f7d843aad86c None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:42.333033 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 651/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jun 21 05:44:42 2022] GET /identity/v3/endpoints?service_id=8fa6ee4d38b9446ab297576cfe19d9d2&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:42.338845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7d6cc-2645-43a1-9b08-1b4084d5b0a3 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:42.417718 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:42.435597 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7d6cc-2645-43a1-9b08-1b4084d5b0a3 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:42.468636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2cb44-5bbe-4e21-aa93-c385535b2982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:42.469287 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2cb44-5bbe-4e21-aa93-c385535b2982 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:42.469567 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2cb44-5bbe-4e21-aa93-c385535b2982 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:42.469843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2cb44-5bbe-4e21-aa93-c385535b2982 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:42.470546 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2cb44-5bbe-4e21-aa93-c385535b2982 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:42.471985 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2cb44-5bbe-4e21-aa93-c385535b2982 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:42.478970 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 650/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jun 21 05:44:42 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:44:44.500420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5de3a-f370-4964-ab7d-935470973c49 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:44.500940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5de3a-f370-4964-ab7d-935470973c49 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:44.500940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5de3a-f370-4964-ab7d-935470973c49 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:44.502312 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 652/1302] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:44:44.508013 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e54cd-9a87-4543-922f-d432dea594f6 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:44.508433 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e54cd-9a87-4543-922f-d432dea594f6 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:44.508571 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e54cd-9a87-4543-922f-d432dea594f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:44.524901 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-4b2e54cd-9a87-4543-922f-d432dea594f6 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:44:44.526114 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4b2e54cd-9a87-4543-922f-d432dea594f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:44:44.590455 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 651/1303] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:44:44 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 05:44:44.614852 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5de3a-f370-4964-ab7d-935470973c49 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:44.708353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:44.715530 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5de3a-f370-4964-ab7d-935470973c49 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:44.749833 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a64bfa-69d0-46db-9dd7-166f9cb33cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:44.750709 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a64bfa-69d0-46db-9dd7-166f9cb33cbb None admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:44.750939 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a64bfa-69d0-46db-9dd7-166f9cb33cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:44.751219 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a64bfa-69d0-46db-9dd7-166f9cb33cbb None admin] PATH_INFO: `/v3/services/placement` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:44.751867 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a64bfa-69d0-46db-9dd7-166f9cb33cbb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:44.753272 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a64bfa-69d0-46db-9dd7-166f9cb33cbb None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:44.765073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application [None req-c6a64bfa-69d0-46db-9dd7-166f9cb33cbb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 05:44:44.765073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:44.765073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 05:44:44.765073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 05:44:44.765073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 05:44:44.765073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 05:44:44.765073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 05:44:44.765073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:44:44.765073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 05:44:44.765073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:44:44.765073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 05:44:44.765073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:44:44.765073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 05:44:44.765073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 05:44:44.765073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 05:44:44.765073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 05:44:44.765073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 05:44:44.766306 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 05:44:44.766306 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 05:44:44.766306 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 05:44:44.766306 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 05:44:44.766306 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 05:44:44.766306 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 05:44:44.766306 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 05:44:44.766306 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 05:44:44.766306 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 05:44:44.766306 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 05:44:44.766306 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 05:44:44.766306 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 05:44:44.766306 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 05:44:44.766306 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 05:44:44.766306 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 05:44:44.766306 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 05:44:44.767346 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 05:44:44.767346 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application with Lock( Jun 21 05:44:44.767346 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 05:44:44.767346 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self._enter() Jun 21 05:44:44.767346 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 05:44:44.767346 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 05:44:44.767346 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 05:44:44.767346 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application return self.creator() Jun 21 05:44:44.767346 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 05:44:44.767346 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application created_value = creator( Jun 21 05:44:44.767346 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 05:44:44.767346 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 05:44:44.767346 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 05:44:44.767346 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: ERROR keystone.server.flask.application Jun 21 05:44:44.767346 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 653/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jun 21 05:44:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 05:44:44.772336 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e54cd-9a87-4543-922f-d432dea594f6 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:44.849034 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:44.872333 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e54cd-9a87-4543-922f-d432dea594f6 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:44.905660 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2469769-3307-4647-95e8-054086941e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:44.906356 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2469769-3307-4647-95e8-054086941e49 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:44.906645 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2469769-3307-4647-95e8-054086941e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:44.906925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2469769-3307-4647-95e8-054086941e49 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:44.907633 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2469769-3307-4647-95e8-054086941e49 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:44:44.907944 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2469769-3307-4647-95e8-054086941e49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:44.909893 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2469769-3307-4647-95e8-054086941e49 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:44.915025 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 652/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Jun 21 05:44:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:44:44.920847 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a64bfa-69d0-46db-9dd7-166f9cb33cbb None admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:44:45.017973 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a64bfa-69d0-46db-9dd7-166f9cb33cbb None admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:44:45.051445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dede38-8dd5-405d-92a8-ee7a2112a28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:44:45.052094 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dede38-8dd5-405d-92a8-ee7a2112a28a None admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:44:45.052378 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dede38-8dd5-405d-92a8-ee7a2112a28a None admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:44:45.052656 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dede38-8dd5-405d-92a8-ee7a2112a28a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:44:45.053399 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dede38-8dd5-405d-92a8-ee7a2112a28a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:44:45.054811 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dede38-8dd5-405d-92a8-ee7a2112a28a None admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:44:45.074601 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 654/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jun 21 05:44:44 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:44:54.912232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=30 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:44:55.068770 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:45:48.057774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ec076-e26c-4dbf-bcd1-59ad1d07c087 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:45:48.058372 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ec076-e26c-4dbf-bcd1-59ad1d07c087 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:45:48.058372 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ec076-e26c-4dbf-bcd1-59ad1d07c087 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:45:48.067163 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e703fc-07aa-443e-8859-a529fce1da23 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:45:48.067683 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e703fc-07aa-443e-8859-a529fce1da23 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:45:48.067778 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e703fc-07aa-443e-8859-a529fce1da23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:45:48.072014 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 653/1307] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:45:48 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:45:48.164092 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-90e703fc-07aa-443e-8859-a529fce1da23 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:45:48.165410 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-90e703fc-07aa-443e-8859-a529fce1da23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:45:48.323149 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 655/1308] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:45:48.353752 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d596ad-0250-4290-94cb-96a4c501cb00 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:45:48.354611 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d596ad-0250-4290-94cb-96a4c501cb00 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:45:48.355050 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d596ad-0250-4290-94cb-96a4c501cb00 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:45:48.356928 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 654/1309] 10.222.0.18 () {54 vars in 964 bytes} [Tue Jun 21 05:45:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:45:48.363327 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ced1c-7a60-43eb-b738-8b564a947e33 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:45:48.364168 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ced1c-7a60-43eb-b738-8b564a947e33 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:45:48.364429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ced1c-7a60-43eb-b738-8b564a947e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:45:48.450134 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-3c1ced1c-7a60-43eb-b738-8b564a947e33 None None] MFA Rules not processed for user `51e845d0dc2c4a1fa612556c1aa73ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:45:48.451363 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3c1ced1c-7a60-43eb-b738-8b564a947e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:45:48.474153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:45:48.568323 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 656/1310] 10.222.0.18 () {58 vars in 1061 bytes} [Tue Jun 21 05:45:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:45:48.578885 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d596ad-0250-4290-94cb-96a4c501cb00 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:45:48.580664 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-98d596ad-0250-4290-94cb-96a4c501cb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:45:48.750439 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d596ad-0250-4290-94cb-96a4c501cb00 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:45:48.830143 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d70c6-f433-430d-a674-4229199dad00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:45:48.830715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d70c6-f433-430d-a674-4229199dad00 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:45:48.830999 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d70c6-f433-430d-a674-4229199dad00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:45:48.831282 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d70c6-f433-430d-a674-4229199dad00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:45:48.832929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-fb9d70c6-f433-430d-a674-4229199dad00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:45:48.889775 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:45:48.946060 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d70c6-f433-430d-a674-4229199dad00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:45:48.947507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d70c6-f433-430d-a674-4229199dad00 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:45:48.967791 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 655/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:45:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:45:51.367438 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d8eef-35a8-4610-9203-a2b6b45d9fc1 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:45:51.367951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d8eef-35a8-4610-9203-a2b6b45d9fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:45:51.367951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d8eef-35a8-4610-9203-a2b6b45d9fc1 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:45:51.369978 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 657/1312] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:45:51.375259 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25a4a0-fdaa-4281-9e12-03c5a1474239 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:45:51.375847 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25a4a0-fdaa-4281-9e12-03c5a1474239 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:45:51.375847 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25a4a0-fdaa-4281-9e12-03c5a1474239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:45:51.459785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-0c25a4a0-fdaa-4281-9e12-03c5a1474239 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:45:51.460985 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0c25a4a0-fdaa-4281-9e12-03c5a1474239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:45:51.565104 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 656/1313] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:45:51.604558 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d8eef-35a8-4610-9203-a2b6b45d9fc1 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:45:51.606175 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5c2d8eef-35a8-4610-9203-a2b6b45d9fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:45:51.718044 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d8eef-35a8-4610-9203-a2b6b45d9fc1 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:45:51.798139 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:45:51.801021 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e75c27-dff4-4a36-850b-c4d3ab4b0b2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:45:51.801872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e75c27-dff4-4a36-850b-c4d3ab4b0b2b service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:45:51.802351 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e75c27-dff4-4a36-850b-c4d3ab4b0b2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:45:51.802816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e75c27-dff4-4a36-850b-c4d3ab4b0b2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:45:51.804677 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-25e75c27-dff4-4a36-850b-c4d3ab4b0b2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:45:51.919511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e75c27-dff4-4a36-850b-c4d3ab4b0b2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:45:51.920956 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e75c27-dff4-4a36-850b-c4d3ab4b0b2b service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:45:51.940010 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 658/1314] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:45:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:45:54.268885 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940a9f5-192a-493d-9a58-c42e8eeb7928 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:45:54.269421 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940a9f5-192a-493d-9a58-c42e8eeb7928 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:45:54.269421 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940a9f5-192a-493d-9a58-c42e8eeb7928 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:45:54.270829 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 657/1315] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:45:54.275876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9a957-e68b-45da-8ae9-6980dc1ac670 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:45:54.276309 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9a957-e68b-45da-8ae9-6980dc1ac670 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:45:54.276472 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9a957-e68b-45da-8ae9-6980dc1ac670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:45:54.340142 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-eae9a957-e68b-45da-8ae9-6980dc1ac670 None None] MFA Rules not processed for user `ff7d725fbdd346cbad2f26c6701d1cc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:45:54.341342 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-eae9a957-e68b-45da-8ae9-6980dc1ac670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:45:54.392131 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:45:54.434883 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 659/1316] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:45:54 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:45:54.489008 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f890b4c-b834-4bba-bcba-10b77697c6a5 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:45:54.489294 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f890b4c-b834-4bba-bcba-10b77697c6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:45:54.489573 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f890b4c-b834-4bba-bcba-10b77697c6a5 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:45:54.490978 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 658/1317] 10.222.0.18 () {54 vars in 964 bytes} [Tue Jun 21 05:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:45:54.496877 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcb26f-2dbc-48ef-a015-4572068a5dda None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:45:54.497172 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcb26f-2dbc-48ef-a015-4572068a5dda None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:45:54.497459 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcb26f-2dbc-48ef-a015-4572068a5dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:45:54.571171 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-83fcb26f-2dbc-48ef-a015-4572068a5dda None None] MFA Rules not processed for user `51e845d0dc2c4a1fa612556c1aa73ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:45:54.572388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-83fcb26f-2dbc-48ef-a015-4572068a5dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:45:54.650029 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 660/1318] 10.222.0.18 () {58 vars in 1061 bytes} [Tue Jun 21 05:45:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:45:54.659019 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f890b4c-b834-4bba-bcba-10b77697c6a5 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:45:54.660550 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-2f890b4c-b834-4bba-bcba-10b77697c6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:45:54.671051 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:45:54.765218 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f890b4c-b834-4bba-bcba-10b77697c6a5 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:45:54.837804 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb991072-6da9-4856-ae8b-e3cca6532837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:45:54.838469 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb991072-6da9-4856-ae8b-e3cca6532837 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:45:54.838751 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb991072-6da9-4856-ae8b-e3cca6532837 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:45:54.839024 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb991072-6da9-4856-ae8b-e3cca6532837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:45:54.840643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-fb991072-6da9-4856-ae8b-e3cca6532837 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:45:54.901355 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:45:54.948979 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb991072-6da9-4856-ae8b-e3cca6532837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:45:54.950447 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb991072-6da9-4856-ae8b-e3cca6532837 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:45:54.967897 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 659/1319] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:45:54 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:45:57.925722 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd5cc0-d586-43fb-872c-56182977c062 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:45:57.926369 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd5cc0-d586-43fb-872c-56182977c062 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:45:57.926369 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd5cc0-d586-43fb-872c-56182977c062 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:45:57.927704 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 661/1320] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:45:57.932930 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f9588-563f-42b8-a73f-2612bc359eb5 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:45:57.933388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f9588-563f-42b8-a73f-2612bc359eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:45:57.933505 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f9588-563f-42b8-a73f-2612bc359eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:45:57.997624 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-107f9588-563f-42b8-a73f-2612bc359eb5 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:45:57.999493 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-107f9588-563f-42b8-a73f-2612bc359eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:45:58.096307 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 660/1321] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:45:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:45:58.136066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd5cc0-d586-43fb-872c-56182977c062 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:45:58.137641 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-05cd5cc0-d586-43fb-872c-56182977c062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:45:58.189022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:45:58.243481 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd5cc0-d586-43fb-872c-56182977c062 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:45:58.315542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d0f53-6c7f-42c2-9c3c-d1fb741ba20a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:45:58.316185 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d0f53-6c7f-42c2-9c3c-d1fb741ba20a service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:45:58.316470 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d0f53-6c7f-42c2-9c3c-d1fb741ba20a service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:45:58.316751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d0f53-6c7f-42c2-9c3c-d1fb741ba20a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:45:58.318443 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-7b4d0f53-6c7f-42c2-9c3c-d1fb741ba20a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:45:58.414353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:45:58.427903 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d0f53-6c7f-42c2-9c3c-d1fb741ba20a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:45:58.429353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d0f53-6c7f-42c2-9c3c-d1fb741ba20a service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:45:58.447384 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 662/1322] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:45:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:46:01.231460 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc449e-87d3-4843-8acf-5e4091f6239a None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:01.232581 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc449e-87d3-4843-8acf-5e4091f6239a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:01.232685 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc449e-87d3-4843-8acf-5e4091f6239a None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:01.234073 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 661/1323] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:46:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:46:01.239637 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7f188-4104-4aa8-a5a9-3e3d6b7bc53e None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:01.240126 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7f188-4104-4aa8-a5a9-3e3d6b7bc53e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:01.240230 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7f188-4104-4aa8-a5a9-3e3d6b7bc53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:01.306056 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-98d7f188-4104-4aa8-a5a9-3e3d6b7bc53e None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:46:01.307281 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-98d7f188-4104-4aa8-a5a9-3e3d6b7bc53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:01.415288 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 663/1324] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:46:01.451732 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc449e-87d3-4843-8acf-5e4091f6239a None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:46:01.453319 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-04dc449e-87d3-4843-8acf-5e4091f6239a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:01.474753 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:46:01.568038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc449e-87d3-4843-8acf-5e4091f6239a None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:46:01.645027 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1294bd3-9679-4c85-81ed-ba6cfa7bba20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:46:01.645688 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1294bd3-9679-4c85-81ed-ba6cfa7bba20 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:01.645999 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1294bd3-9679-4c85-81ed-ba6cfa7bba20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:01.646287 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1294bd3-9679-4c85-81ed-ba6cfa7bba20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:01.647963 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a1294bd3-9679-4c85-81ed-ba6cfa7bba20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:01.721871 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:46:01.761693 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1294bd3-9679-4c85-81ed-ba6cfa7bba20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:46:01.763945 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1294bd3-9679-4c85-81ed-ba6cfa7bba20 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:46:01.782286 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 662/1325] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:46:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:46:03.906538 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10665b-8c1c-4797-816f-549a0f2d267c None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:03.907076 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10665b-8c1c-4797-816f-549a0f2d267c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:03.907204 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10665b-8c1c-4797-816f-549a0f2d267c None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:03.908497 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 664/1326] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:46:03.913858 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1f3d0-973b-49dc-a38a-1a3544fe538c None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:03.914395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1f3d0-973b-49dc-a38a-1a3544fe538c None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:03.914478 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1f3d0-973b-49dc-a38a-1a3544fe538c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:03.980358 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-7dd1f3d0-973b-49dc-a38a-1a3544fe538c None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:46:03.981570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-7dd1f3d0-973b-49dc-a38a-1a3544fe538c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:04.081890 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 663/1327] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:46:04.117794 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10665b-8c1c-4797-816f-549a0f2d267c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:46:04.119368 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3e10665b-8c1c-4797-816f-549a0f2d267c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:04.180726 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:46:04.225103 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10665b-8c1c-4797-816f-549a0f2d267c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:46:04.305955 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b888946-5975-4df1-9523-32a187f531b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:46:04.306603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b888946-5975-4df1-9523-32a187f531b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:04.306883 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b888946-5975-4df1-9523-32a187f531b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:04.307158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b888946-5975-4df1-9523-32a187f531b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:04.308786 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-7b888946-5975-4df1-9523-32a187f531b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:04.414382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:46:04.416970 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b888946-5975-4df1-9523-32a187f531b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:46:04.418665 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b888946-5975-4df1-9523-32a187f531b3 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:46:04.437960 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 665/1328] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:46:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:46:06.568550 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a8f68-3937-4867-9c3e-d537bbb0d736 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:06.569081 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a8f68-3937-4867-9c3e-d537bbb0d736 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:06.569081 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a8f68-3937-4867-9c3e-d537bbb0d736 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:06.570455 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 664/1329] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:46:06.576889 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2569c3-4795-41d5-b480-e74a3c7936ef None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:06.577453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2569c3-4795-41d5-b480-e74a3c7936ef None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:06.577560 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2569c3-4795-41d5-b480-e74a3c7936ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:06.650644 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-8f2569c3-4795-41d5-b480-e74a3c7936ef None None] MFA Rules not processed for user `ff7d725fbdd346cbad2f26c6701d1cc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:46:06.651899 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8f2569c3-4795-41d5-b480-e74a3c7936ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:06.757881 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 666/1330] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:46:06 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:46:06.795148 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a8f68-3937-4867-9c3e-d537bbb0d736 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:46:06.796987 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-885a8f68-3937-4867-9c3e-d537bbb0d736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:06.829372 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:46:06.902945 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a8f68-3937-4867-9c3e-d537bbb0d736 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:46:06.979227 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a268ac6-426b-47cd-be8b-c3e80c5de373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:46:06.979878 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a268ac6-426b-47cd-be8b-c3e80c5de373 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:06.980160 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a268ac6-426b-47cd-be8b-c3e80c5de373 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:06.980429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a268ac6-426b-47cd-be8b-c3e80c5de373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:06.982606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1a268ac6-426b-47cd-be8b-c3e80c5de373 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:07.064741 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:46:07.098722 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a268ac6-426b-47cd-be8b-c3e80c5de373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:46:07.100559 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a268ac6-426b-47cd-be8b-c3e80c5de373 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:46:07.142216 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 665/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:46:06 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 05:46:09.454303 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c779c8e-112d-4bc7-81b1-6118dbab50c0 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:09.454858 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c779c8e-112d-4bc7-81b1-6118dbab50c0 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:09.454858 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c779c8e-112d-4bc7-81b1-6118dbab50c0 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:09.456259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 667/1332] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:46:09.461885 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b80b1-9c84-43b7-aea1-816d2f560133 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:09.462438 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b80b1-9c84-43b7-aea1-816d2f560133 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:09.462536 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b80b1-9c84-43b7-aea1-816d2f560133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:09.533502 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-770b80b1-9c84-43b7-aea1-816d2f560133 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:46:09.534775 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-770b80b1-9c84-43b7-aea1-816d2f560133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:09.632891 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 666/1333] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:46:09.669235 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c779c8e-112d-4bc7-81b1-6118dbab50c0 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:46:09.670812 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5c779c8e-112d-4bc7-81b1-6118dbab50c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:09.744528 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:46:09.791975 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c779c8e-112d-4bc7-81b1-6118dbab50c0 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:46:09.891033 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d128a-fb2e-4dc6-8d9b-b9b124acc3da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:46:09.891745 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d128a-fb2e-4dc6-8d9b-b9b124acc3da service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:09.892079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d128a-fb2e-4dc6-8d9b-b9b124acc3da service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:09.892409 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d128a-fb2e-4dc6-8d9b-b9b124acc3da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:09.894401 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-224d128a-fb2e-4dc6-8d9b-b9b124acc3da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:10.023290 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d128a-fb2e-4dc6-8d9b-b9b124acc3da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:46:10.024642 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d128a-fb2e-4dc6-8d9b-b9b124acc3da service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:46:10.036550 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:46:10.045441 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 668/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:46:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:46:12.171053 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3adf1a-c41b-416a-89e0-73fd36e0205c None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:12.171616 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3adf1a-c41b-416a-89e0-73fd36e0205c None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:12.171616 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3adf1a-c41b-416a-89e0-73fd36e0205c None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:12.172999 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 667/1335] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:46:12.178464 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b393c8-0591-4713-8848-a1b1ed0320a5 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:12.178928 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b393c8-0591-4713-8848-a1b1ed0320a5 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:12.179052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b393c8-0591-4713-8848-a1b1ed0320a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:12.242808 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-31b393c8-0591-4713-8848-a1b1ed0320a5 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:46:12.244019 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-31b393c8-0591-4713-8848-a1b1ed0320a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:12.345626 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 669/1336] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:46:12.400093 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3adf1a-c41b-416a-89e0-73fd36e0205c None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:46:12.401620 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-cb3adf1a-c41b-416a-89e0-73fd36e0205c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:12.441380 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:46:12.509519 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3adf1a-c41b-416a-89e0-73fd36e0205c None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:46:12.583040 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92abd9-ac28-487b-b94d-56427bbac031 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:46:12.583684 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92abd9-ac28-487b-b94d-56427bbac031 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:12.583963 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92abd9-ac28-487b-b94d-56427bbac031 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:12.584237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92abd9-ac28-487b-b94d-56427bbac031 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:12.585861 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3a92abd9-ac28-487b-b94d-56427bbac031 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:12.670796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:46:12.701259 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92abd9-ac28-487b-b94d-56427bbac031 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:46:12.703044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92abd9-ac28-487b-b94d-56427bbac031 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:46:12.721017 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 668/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:46:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:46:15.123886 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcb1df-8c3c-4831-a0d4-ba310f99a101 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:15.124422 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcb1df-8c3c-4831-a0d4-ba310f99a101 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:15.124422 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcb1df-8c3c-4831-a0d4-ba310f99a101 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:15.125839 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 670/1338] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:46:15.131817 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e466df-1855-4703-9c4a-f68ee31f62d0 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:15.132336 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e466df-1855-4703-9c4a-f68ee31f62d0 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:15.132430 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e466df-1855-4703-9c4a-f68ee31f62d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:15.201024 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-a8e466df-1855-4703-9c4a-f68ee31f62d0 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:46:15.202318 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a8e466df-1855-4703-9c4a-f68ee31f62d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:15.303410 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 669/1339] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:46:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:46:15.340885 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdcb1df-8c3c-4831-a0d4-ba310f99a101 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:46:15.342466 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1fdcb1df-8c3c-4831-a0d4-ba310f99a101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:15.419777 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:46:15.447773 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdcb1df-8c3c-4831-a0d4-ba310f99a101 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:46:15.523710 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8945dc-27ef-4437-be9a-5996f8d4c46f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:46:15.524365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8945dc-27ef-4437-be9a-5996f8d4c46f service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:15.524650 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8945dc-27ef-4437-be9a-5996f8d4c46f service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:15.524928 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8945dc-27ef-4437-be9a-5996f8d4c46f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:15.526628 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-fe8945dc-27ef-4437-be9a-5996f8d4c46f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:15.636533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8945dc-27ef-4437-be9a-5996f8d4c46f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:46:15.638543 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8945dc-27ef-4437-be9a-5996f8d4c46f service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:46:15.657124 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 671/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:46:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:46:19.763494 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae836c0-f669-4dd3-a620-b3978e96fdd6 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:19.764055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae836c0-f669-4dd3-a620-b3978e96fdd6 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:19.764055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae836c0-f669-4dd3-a620-b3978e96fdd6 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:19.765405 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 670/1341] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:46:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:46:19.770860 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e8242-1347-49a2-8841-66edf2604221 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:19.771285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e8242-1347-49a2-8841-66edf2604221 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:19.771426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e8242-1347-49a2-8841-66edf2604221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:19.778103 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:46:19.849821 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-b54e8242-1347-49a2-8841-66edf2604221 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:46:19.851022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b54e8242-1347-49a2-8841-66edf2604221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:19.968239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 672/1342] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:46:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:46:20.006970 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae836c0-f669-4dd3-a620-b3978e96fdd6 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:46:20.009075 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-dae836c0-f669-4dd3-a620-b3978e96fdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:20.059701 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:46:20.114404 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae836c0-f669-4dd3-a620-b3978e96fdd6 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:46:20.118051 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db641443-8507-4fe3-a782-eef2c8b8714c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:46:20.118705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db641443-8507-4fe3-a782-eef2c8b8714c service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:20.118988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db641443-8507-4fe3-a782-eef2c8b8714c service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:20.119267 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db641443-8507-4fe3-a782-eef2c8b8714c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:20.129260 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db641443-8507-4fe3-a782-eef2c8b8714c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:46:20.130759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db641443-8507-4fe3-a782-eef2c8b8714c service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:46:20.140792 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 671/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:46:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:46:22.826954 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4832abc-9cf6-4036-bd8d-016a2ae58ae0 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:22.827674 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4832abc-9cf6-4036-bd8d-016a2ae58ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:22.827674 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4832abc-9cf6-4036-bd8d-016a2ae58ae0 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:22.828900 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 673/1344] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:46:22.834547 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a2449-3d3a-46b4-8ed9-dbff9df99419 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:22.834992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a2449-3d3a-46b4-8ed9-dbff9df99419 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:22.835112 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a2449-3d3a-46b4-8ed9-dbff9df99419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:22.866436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-df8a2449-3d3a-46b4-8ed9-dbff9df99419 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:46:22.867657 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-df8a2449-3d3a-46b4-8ed9-dbff9df99419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:22.952720 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 672/1345] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:46:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:46:22.992816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4832abc-9cf6-4036-bd8d-016a2ae58ae0 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:46:23.004603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4832abc-9cf6-4036-bd8d-016a2ae58ae0 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:46:23.008321 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c315d3-dbf1-48cc-b19b-78709b46922b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:46:23.009270 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c315d3-dbf1-48cc-b19b-78709b46922b service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:23.009559 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c315d3-dbf1-48cc-b19b-78709b46922b service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:23.009838 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c315d3-dbf1-48cc-b19b-78709b46922b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:23.021842 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c315d3-dbf1-48cc-b19b-78709b46922b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:46:23.023394 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c315d3-dbf1-48cc-b19b-78709b46922b service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:46:23.035071 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 674/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:46:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:46:27.237159 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d7e76-5017-4b81-92aa-3ee3c574ae6e None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:27.237874 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d7e76-5017-4b81-92aa-3ee3c574ae6e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:27.237874 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d7e76-5017-4b81-92aa-3ee3c574ae6e None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:27.239138 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 673/1347] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:46:27.244478 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf401c0-3177-4132-96d5-052be7776847 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:27.244948 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf401c0-3177-4132-96d5-052be7776847 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:27.244948 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf401c0-3177-4132-96d5-052be7776847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:27.265746 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-abf401c0-3177-4132-96d5-052be7776847 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:46:27.267016 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-abf401c0-3177-4132-96d5-052be7776847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:27.275103 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 675/1348] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:46:27.313288 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d7e76-5017-4b81-92aa-3ee3c574ae6e None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:46:27.325443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d7e76-5017-4b81-92aa-3ee3c574ae6e None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:46:27.330361 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b28a45-5bc7-405b-b3b8-e60a4b528739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:46:27.331165 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b28a45-5bc7-405b-b3b8-e60a4b528739 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:27.331316 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b28a45-5bc7-405b-b3b8-e60a4b528739 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:27.331597 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b28a45-5bc7-405b-b3b8-e60a4b528739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:27.341283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b28a45-5bc7-405b-b3b8-e60a4b528739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:46:27.342743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b28a45-5bc7-405b-b3b8-e60a4b528739 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:46:27.354047 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 674/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:46:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:46:32.328225 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ce39a-07c6-48cd-95bb-fc39cbf464cc None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:32.328731 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ce39a-07c6-48cd-95bb-fc39cbf464cc None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:32.329653 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ce39a-07c6-48cd-95bb-fc39cbf464cc None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:32.331171 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 676/1350] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jun 21 05:46:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:46:32.341039 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea3bac-fa4d-4d0b-b1ac-e5b2dce02d65 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:32.342650 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea3bac-fa4d-4d0b-b1ac-e5b2dce02d65 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:32.343706 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea3bac-fa4d-4d0b-b1ac-e5b2dce02d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:32.466388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-d8ea3bac-fa4d-4d0b-b1ac-e5b2dce02d65 None None] MFA Rules not processed for user `d17a40bea6ba41f19c88e16f9b15cf27`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:46:32.467875 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d8ea3bac-fa4d-4d0b-b1ac-e5b2dce02d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:32.497746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:46:32.574954 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 675/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jun 21 05:46:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:46:36.714280 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79b45a-5478-4231-8ec0-d1d626c92f34 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:36.715115 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79b45a-5478-4231-8ec0-d1d626c92f34 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:36.715115 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79b45a-5478-4231-8ec0-d1d626c92f34 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:36.716368 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 677/1352] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jun 21 05:46:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:46:36.721555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd40a8a-4d20-4a44-924f-98890540806b None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:36.722107 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd40a8a-4d20-4a44-924f-98890540806b None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:36.722214 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd40a8a-4d20-4a44-924f-98890540806b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:36.741808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-5fd40a8a-4d20-4a44-924f-98890540806b None None] MFA Rules not processed for user `d17a40bea6ba41f19c88e16f9b15cf27`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:46:36.743029 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-5fd40a8a-4d20-4a44-924f-98890540806b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:36.752986 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 676/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jun 21 05:46:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:46:37.259863 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=72 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:46:38.512023 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee4a05-dcee-4913-90b9-2a027205171f None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:38.512617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee4a05-dcee-4913-90b9-2a027205171f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:38.512617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee4a05-dcee-4913-90b9-2a027205171f None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:38.513862 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 678/1354] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jun 21 05:46:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:46:38.519122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f792f14-6551-45ae-8944-05de788222f9 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:38.519621 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f792f14-6551-45ae-8944-05de788222f9 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:38.519766 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f792f14-6551-45ae-8944-05de788222f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:38.538449 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-6f792f14-6551-45ae-8944-05de788222f9 None None] MFA Rules not processed for user `d17a40bea6ba41f19c88e16f9b15cf27`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:46:38.539638 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6f792f14-6551-45ae-8944-05de788222f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:38.548364 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 677/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jun 21 05:46:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:46:42.133894 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d48bb6-29fd-48e7-9bc3-01a4cf6ff099 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:42.134786 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d48bb6-29fd-48e7-9bc3-01a4cf6ff099 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:42.135067 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d48bb6-29fd-48e7-9bc3-01a4cf6ff099 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:42.136652 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 679/1356] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:46:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:46:42.143351 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8ff3f-ed81-4952-a094-0d8bf80bc40a None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:42.144166 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8ff3f-ed81-4952-a094-0d8bf80bc40a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:42.145432 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8ff3f-ed81-4952-a094-0d8bf80bc40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:42.167918 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-67e8ff3f-ed81-4952-a094-0d8bf80bc40a None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:46:42.169355 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-67e8ff3f-ed81-4952-a094-0d8bf80bc40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:42.186322 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 678/1357] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:46:42.233669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ced4a-60e3-4211-a3cf-5f0a89cbdf80 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:42.234284 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ced4a-60e3-4211-a3cf-5f0a89cbdf80 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:42.234805 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ced4a-60e3-4211-a3cf-5f0a89cbdf80 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:42.236426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 680/1358] 10.222.0.18 () {54 vars in 961 bytes} [Tue Jun 21 05:46:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:46:42.244469 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fd34c-ce14-4aa4-9d35-e6853f92505d None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:42.245789 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fd34c-ce14-4aa4-9d35-e6853f92505d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:42.246179 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fd34c-ce14-4aa4-9d35-e6853f92505d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:42.318180 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-279fd34c-ce14-4aa4-9d35-e6853f92505d None None] MFA Rules not processed for user `f702830987ba4548a4c2ee3d0e302d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:46:42.319309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-279fd34c-ce14-4aa4-9d35-e6853f92505d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:42.419500 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 679/1359] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Jun 21 05:46:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:46:42.427506 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ced4a-60e3-4211-a3cf-5f0a89cbdf80 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:46:42.442422 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ced4a-60e3-4211-a3cf-5f0a89cbdf80 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:46:42.448011 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9989a-1f54-4f39-9342-01340dcc78e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:46:42.448764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9989a-1f54-4f39-9342-01340dcc78e3 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:42.449258 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9989a-1f54-4f39-9342-01340dcc78e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:42.449601 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9989a-1f54-4f39-9342-01340dcc78e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:42.459152 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9989a-1f54-4f39-9342-01340dcc78e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:46:42.461162 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9989a-1f54-4f39-9342-01340dcc78e3 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:46:42.472800 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 681/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:46:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:46:44.742443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b53c3-f2c4-49f4-a8fb-f4056279e74c None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:44.743002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b53c3-f2c4-49f4-a8fb-f4056279e74c None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:44.743002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b53c3-f2c4-49f4-a8fb-f4056279e74c None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:44.744591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 680/1361] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:46:44.749905 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae9972-eb37-4ddd-97fa-0967c4aa4fa8 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:44.750405 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae9972-eb37-4ddd-97fa-0967c4aa4fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:44.750495 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae9972-eb37-4ddd-97fa-0967c4aa4fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:44.769069 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-93ae9972-eb37-4ddd-97fa-0967c4aa4fa8 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:46:44.770327 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-93ae9972-eb37-4ddd-97fa-0967c4aa4fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:44.778996 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 682/1362] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:46:44.823445 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b53c3-f2c4-49f4-a8fb-f4056279e74c None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:46:44.838906 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b53c3-f2c4-49f4-a8fb-f4056279e74c None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:46:44.844551 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55418e20-25b4-4c02-b68e-042440f68a29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:46:44.845217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55418e20-25b4-4c02-b68e-042440f68a29 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:44.845772 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55418e20-25b4-4c02-b68e-042440f68a29 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:44.846090 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55418e20-25b4-4c02-b68e-042440f68a29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:44.855908 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55418e20-25b4-4c02-b68e-042440f68a29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:46:44.857578 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55418e20-25b4-4c02-b68e-042440f68a29 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:46:44.868409 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 681/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:46:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:46:47.252511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cad50a-20e4-4edb-b672-ce019c689c3a None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:47.253740 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cad50a-20e4-4edb-b672-ce019c689c3a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:47.254285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cad50a-20e4-4edb-b672-ce019c689c3a None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:47.256086 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 683/1364] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:46:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:46:47.261680 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf104977-8db9-4798-8bab-10db0fab5293 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:47.262583 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf104977-8db9-4798-8bab-10db0fab5293 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:47.263059 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf104977-8db9-4798-8bab-10db0fab5293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:47.298391 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-cf104977-8db9-4798-8bab-10db0fab5293 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:46:47.299627 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-cf104977-8db9-4798-8bab-10db0fab5293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:47.322403 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 682/1365] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:46:47.362884 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a59e1-71ba-4f96-aaa0-1e2bc5315631 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:47.363267 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a59e1-71ba-4f96-aaa0-1e2bc5315631 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:47.363616 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a59e1-71ba-4f96-aaa0-1e2bc5315631 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:47.365080 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 684/1366] 10.222.0.18 () {54 vars in 961 bytes} [Tue Jun 21 05:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:46:47.371060 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b4815-aab2-4c58-b92e-701d90551dd3 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:47.371354 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b4815-aab2-4c58-b92e-701d90551dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:47.371636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b4815-aab2-4c58-b92e-701d90551dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:47.389719 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-676b4815-aab2-4c58-b92e-701d90551dd3 None None] MFA Rules not processed for user `f702830987ba4548a4c2ee3d0e302d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:46:47.390941 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-676b4815-aab2-4c58-b92e-701d90551dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:47.400177 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 683/1367] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Jun 21 05:46:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:46:47.408140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a59e1-71ba-4f96-aaa0-1e2bc5315631 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:46:47.423382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a59e1-71ba-4f96-aaa0-1e2bc5315631 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:46:47.428802 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41c5b9-e123-4800-9fe8-d343b85057f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:46:47.429441 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41c5b9-e123-4800-9fe8-d343b85057f7 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:47.429729 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41c5b9-e123-4800-9fe8-d343b85057f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:47.430040 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41c5b9-e123-4800-9fe8-d343b85057f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:47.439060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a41c5b9-e123-4800-9fe8-d343b85057f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:46:47.440651 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a41c5b9-e123-4800-9fe8-d343b85057f7 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:46:47.450131 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 685/1368] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:46:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:46:49.597294 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104c5c4-4c83-4ee1-9906-f199dd0837cf None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:49.597819 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104c5c4-4c83-4ee1-9906-f199dd0837cf None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:49.598084 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104c5c4-4c83-4ee1-9906-f199dd0837cf None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:49.599981 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 684/1369] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:46:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:46:49.605880 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf043f3-984b-4915-91be-fe09419414c6 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:49.606478 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf043f3-984b-4915-91be-fe09419414c6 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:49.606745 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf043f3-984b-4915-91be-fe09419414c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:49.626482 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-caf043f3-984b-4915-91be-fe09419414c6 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:46:49.627788 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-caf043f3-984b-4915-91be-fe09419414c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:49.637052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 686/1370] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:46:49.681098 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104c5c4-4c83-4ee1-9906-f199dd0837cf None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:46:49.695496 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104c5c4-4c83-4ee1-9906-f199dd0837cf None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:46:49.701490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6f9a1-fd37-490a-bcde-288a8afbd046 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:46:49.702211 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6f9a1-fd37-490a-bcde-288a8afbd046 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:49.702494 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6f9a1-fd37-490a-bcde-288a8afbd046 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:49.702771 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6f9a1-fd37-490a-bcde-288a8afbd046 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:49.712224 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6f9a1-fd37-490a-bcde-288a8afbd046 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:46:49.714440 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6f9a1-fd37-490a-bcde-288a8afbd046 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:46:49.725499 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 685/1371] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:46:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:46:50.357774 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cc906-1b0a-4d5c-bf5c-8ccf0dd65910 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:50.358103 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cc906-1b0a-4d5c-bf5c-8ccf0dd65910 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:50.358603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cc906-1b0a-4d5c-bf5c-8ccf0dd65910 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:50.359998 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 687/1372] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:46:50.365428 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726f97f-44c4-4c19-97af-cbcaccd496a2 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:50.365720 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726f97f-44c4-4c19-97af-cbcaccd496a2 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:50.366423 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726f97f-44c4-4c19-97af-cbcaccd496a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:50.386988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-9726f97f-44c4-4c19-97af-cbcaccd496a2 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:46:50.388236 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9726f97f-44c4-4c19-97af-cbcaccd496a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:50.396717 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 686/1373] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:46:50.762182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3a5a0-8637-47f1-a80c-12e663d7c114 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:50.762182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3a5a0-8637-47f1-a80c-12e663d7c114 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:50.762182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3a5a0-8637-47f1-a80c-12e663d7c114 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:50.764270 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 688/1374] 10.222.0.18 () {54 vars in 963 bytes} [Tue Jun 21 05:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:46:50.768857 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff056a-4410-415c-88ce-a76c2f887d91 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:50.769348 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff056a-4410-415c-88ce-a76c2f887d91 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:50.769456 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff056a-4410-415c-88ce-a76c2f887d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:50.777055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:46:50.827932 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-c4ff056a-4410-415c-88ce-a76c2f887d91 None None] MFA Rules not processed for user `5c13a614e6b04b3a93247e3790f96240`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:46:50.829446 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c4ff056a-4410-415c-88ce-a76c2f887d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:50.899334 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 687/1375] 10.222.0.18 () {58 vars in 1060 bytes} [Tue Jun 21 05:46:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:46:50.908912 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3a5a0-8637-47f1-a80c-12e663d7c114 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:46:50.919953 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3a5a0-8637-47f1-a80c-12e663d7c114 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:46:50.923488 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6071f-c81d-4600-9ef5-d8d803e87cd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:46:50.924135 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6071f-c81d-4600-9ef5-d8d803e87cd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:50.924423 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6071f-c81d-4600-9ef5-d8d803e87cd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:50.924702 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6071f-c81d-4600-9ef5-d8d803e87cd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:50.934460 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6071f-c81d-4600-9ef5-d8d803e87cd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:46:50.935898 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6071f-c81d-4600-9ef5-d8d803e87cd6 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:46:50.950208 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 689/1376] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:46:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 05:46:51.827547 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bce1b4-e1c7-4245-83e0-a94bb883f48f None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:51.828078 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bce1b4-e1c7-4245-83e0-a94bb883f48f None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:51.828078 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bce1b4-e1c7-4245-83e0-a94bb883f48f None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:51.829490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 688/1377] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:46:51.834835 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f63f46-13e9-41c0-9253-f7ad09e5b2ef None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:51.835286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f63f46-13e9-41c0-9253-f7ad09e5b2ef None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:51.835381 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f63f46-13e9-41c0-9253-f7ad09e5b2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:51.853947 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-36f63f46-13e9-41c0-9253-f7ad09e5b2ef None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:46:51.855093 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-36f63f46-13e9-41c0-9253-f7ad09e5b2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:51.862898 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 690/1378] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:46:51.906878 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bce1b4-e1c7-4245-83e0-a94bb883f48f None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:46:51.921764 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bce1b4-e1c7-4245-83e0-a94bb883f48f None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:46:51.927102 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582c068-1c26-4b61-aaba-c37c28668ad2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:46:51.927743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582c068-1c26-4b61-aaba-c37c28668ad2 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:51.928024 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582c068-1c26-4b61-aaba-c37c28668ad2 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:51.928298 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582c068-1c26-4b61-aaba-c37c28668ad2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:51.937255 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6582c068-1c26-4b61-aaba-c37c28668ad2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:46:51.938858 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6582c068-1c26-4b61-aaba-c37c28668ad2 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:46:51.948316 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 689/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:46:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:46:54.033142 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2800f-7c76-497e-bd89-949c6b397de8 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:54.033646 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2800f-7c76-497e-bd89-949c6b397de8 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:54.033765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2800f-7c76-497e-bd89-949c6b397de8 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:54.035305 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 691/1380] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:46:54.041090 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95b521-a340-4808-9b31-3469de5eb9c5 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:54.042251 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95b521-a340-4808-9b31-3469de5eb9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:54.042484 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95b521-a340-4808-9b31-3469de5eb9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:54.061731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-4f95b521-a340-4808-9b31-3469de5eb9c5 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:46:54.062955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4f95b521-a340-4808-9b31-3469de5eb9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:54.071252 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 690/1381] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:46:54.114958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2800f-7c76-497e-bd89-949c6b397de8 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:46:54.129996 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2800f-7c76-497e-bd89-949c6b397de8 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:46:54.135565 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b807a4-9e75-44fb-8c28-e5691c3d751e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:46:54.136205 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b807a4-9e75-44fb-8c28-e5691c3d751e service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:54.136493 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b807a4-9e75-44fb-8c28-e5691c3d751e service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:54.136774 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b807a4-9e75-44fb-8c28-e5691c3d751e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:54.145027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b807a4-9e75-44fb-8c28-e5691c3d751e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:46:54.146648 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b807a4-9e75-44fb-8c28-e5691c3d751e service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:46:54.156712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 692/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:46:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:46:56.256108 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f29257-45b7-41e9-a265-7738c9a4b0ae None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:56.256656 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f29257-45b7-41e9-a265-7738c9a4b0ae None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:56.256656 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f29257-45b7-41e9-a265-7738c9a4b0ae None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:56.258044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 691/1383] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:46:56.264052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3b802-44ac-49e0-a7ad-b9744c3ed46a None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:56.264511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3b802-44ac-49e0-a7ad-b9744c3ed46a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:56.264706 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3b802-44ac-49e0-a7ad-b9744c3ed46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:56.283314 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-13c3b802-44ac-49e0-a7ad-b9744c3ed46a None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:46:56.284513 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-13c3b802-44ac-49e0-a7ad-b9744c3ed46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:56.293382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 693/1384] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:46:56.335449 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f29257-45b7-41e9-a265-7738c9a4b0ae None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:46:56.351689 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f29257-45b7-41e9-a265-7738c9a4b0ae None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:46:56.357195 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefd07f-d74a-4151-9cdd-393e73c48cee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:46:56.357856 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefd07f-d74a-4151-9cdd-393e73c48cee service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:56.358189 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefd07f-d74a-4151-9cdd-393e73c48cee service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:56.358471 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefd07f-d74a-4151-9cdd-393e73c48cee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:56.367535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefd07f-d74a-4151-9cdd-393e73c48cee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:46:56.369089 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefd07f-d74a-4151-9cdd-393e73c48cee service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:46:56.379633 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 692/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:46:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:46:58.457161 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7728e4c-56f8-4b48-b525-8b32a708afc2 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:58.457640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7728e4c-56f8-4b48-b525-8b32a708afc2 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:58.457797 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7728e4c-56f8-4b48-b525-8b32a708afc2 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:58.459934 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 694/1386] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:46:58.467930 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1eac74-c9d8-4c66-aa15-133c6ab87c14 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:58.468433 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1eac74-c9d8-4c66-aa15-133c6ab87c14 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:58.468879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1eac74-c9d8-4c66-aa15-133c6ab87c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:58.495031 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-cb1eac74-c9d8-4c66-aa15-133c6ab87c14 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:46:58.498095 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-cb1eac74-c9d8-4c66-aa15-133c6ab87c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:46:58.509780 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 693/1387] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:46:58.553828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7728e4c-56f8-4b48-b525-8b32a708afc2 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:46:58.568769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7728e4c-56f8-4b48-b525-8b32a708afc2 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:46:58.575275 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136ff21-29b6-453f-818d-589844768953 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:46:58.575949 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136ff21-29b6-453f-818d-589844768953 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:46:58.576237 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136ff21-29b6-453f-818d-589844768953 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:46:58.576563 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136ff21-29b6-453f-818d-589844768953 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:46:58.585723 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136ff21-29b6-453f-818d-589844768953 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:46:58.588107 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136ff21-29b6-453f-818d-589844768953 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:46:58.598732 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 695/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:46:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:47:00.749661 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c7b50-e5ba-4104-a6fb-b4a895d8dd7d None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:00.751917 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c7b50-e5ba-4104-a6fb-b4a895d8dd7d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:00.751917 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c7b50-e5ba-4104-a6fb-b4a895d8dd7d None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:00.752263 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 694/1389] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:47:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:47:00.758361 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a0e85-ced5-4c17-8ac8-652ef8b2e491 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:00.759010 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a0e85-ced5-4c17-8ac8-652ef8b2e491 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:00.759010 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a0e85-ced5-4c17-8ac8-652ef8b2e491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:00.776903 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-e11a0e85-ced5-4c17-8ac8-652ef8b2e491 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:47:00.778145 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e11a0e85-ced5-4c17-8ac8-652ef8b2e491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:47:00.786012 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 696/1390] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:47:00.841318 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c7b50-e5ba-4104-a6fb-b4a895d8dd7d None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:47:00.856611 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c7b50-e5ba-4104-a6fb-b4a895d8dd7d None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:47:00.862810 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045b143-fee4-42d7-bfa0-16d6d6c1b998 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:47:00.863464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045b143-fee4-42d7-bfa0-16d6d6c1b998 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:00.863748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045b143-fee4-42d7-bfa0-16d6d6c1b998 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:00.864028 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045b143-fee4-42d7-bfa0-16d6d6c1b998 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:00.873784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045b143-fee4-42d7-bfa0-16d6d6c1b998 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:47:00.875381 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045b143-fee4-42d7-bfa0-16d6d6c1b998 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:47:00.885194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 695/1391] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:47:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:47:03.038011 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3e5fc-17a8-47ad-9fb5-85afa840f2c6 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:03.038609 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3e5fc-17a8-47ad-9fb5-85afa840f2c6 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:03.038609 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3e5fc-17a8-47ad-9fb5-85afa840f2c6 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:03.039977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 697/1392] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:47:03.045991 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54eaa5-9bd7-4d02-a1b9-323e4b423913 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:03.046448 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54eaa5-9bd7-4d02-a1b9-323e4b423913 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:03.046570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54eaa5-9bd7-4d02-a1b9-323e4b423913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:03.064898 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-2a54eaa5-9bd7-4d02-a1b9-323e4b423913 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:47:03.066143 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-2a54eaa5-9bd7-4d02-a1b9-323e4b423913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:47:03.074252 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 696/1393] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:47:03.118372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3e5fc-17a8-47ad-9fb5-85afa840f2c6 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:47:03.133246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3e5fc-17a8-47ad-9fb5-85afa840f2c6 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:47:03.138913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812169f0-dedc-46f5-84fb-1026be42dce3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:47:03.139552 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812169f0-dedc-46f5-84fb-1026be42dce3 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:03.139883 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812169f0-dedc-46f5-84fb-1026be42dce3 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:03.140156 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812169f0-dedc-46f5-84fb-1026be42dce3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:03.149064 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812169f0-dedc-46f5-84fb-1026be42dce3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:47:03.151215 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812169f0-dedc-46f5-84fb-1026be42dce3 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:47:03.163017 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 698/1394] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:47:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:47:05.254397 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028bfcd-bb47-43a6-9b27-2575cd5043c2 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:05.255048 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028bfcd-bb47-43a6-9b27-2575cd5043c2 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:05.255048 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028bfcd-bb47-43a6-9b27-2575cd5043c2 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:05.256337 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 697/1395] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:47:05.261804 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107992b-9f19-4ad6-9f65-29a620021861 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:05.262307 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107992b-9f19-4ad6-9f65-29a620021861 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:05.262424 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107992b-9f19-4ad6-9f65-29a620021861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:05.280379 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-8107992b-9f19-4ad6-9f65-29a620021861 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:47:05.281630 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8107992b-9f19-4ad6-9f65-29a620021861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:47:05.289613 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 699/1396] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:47:05.334498 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028bfcd-bb47-43a6-9b27-2575cd5043c2 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:47:05.350931 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028bfcd-bb47-43a6-9b27-2575cd5043c2 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:47:05.357052 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e91ba-55a4-4120-b997-fa8c49adab08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:47:05.357870 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e91ba-55a4-4120-b997-fa8c49adab08 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:05.358037 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e91ba-55a4-4120-b997-fa8c49adab08 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:05.358277 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e91ba-55a4-4120-b997-fa8c49adab08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:05.367033 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e91ba-55a4-4120-b997-fa8c49adab08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:47:05.368606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e91ba-55a4-4120-b997-fa8c49adab08 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:47:05.379068 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 698/1397] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:47:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:47:06.162306 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf5797-beb7-4907-a57f-a1c16616d739 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:06.162609 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf5797-beb7-4907-a57f-a1c16616d739 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:06.162978 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf5797-beb7-4907-a57f-a1c16616d739 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:06.164246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 700/1398] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:47:06.170436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a987d-142c-4fd4-ab48-fa899666ca5b None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:06.170725 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a987d-142c-4fd4-ab48-fa899666ca5b None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:06.171011 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a987d-142c-4fd4-ab48-fa899666ca5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:06.189783 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-820a987d-142c-4fd4-ab48-fa899666ca5b None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:47:06.191021 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-820a987d-142c-4fd4-ab48-fa899666ca5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:47:06.198995 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 699/1399] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:47:06.255506 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20338d-94e1-4660-a4b4-dbdfade46407 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:06.255870 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20338d-94e1-4660-a4b4-dbdfade46407 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:06.256216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20338d-94e1-4660-a4b4-dbdfade46407 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:06.257685 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 701/1400] 10.222.0.18 () {54 vars in 962 bytes} [Tue Jun 21 05:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:47:06.263009 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e6344-c9ce-431e-b7df-96553aa55625 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:06.263524 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e6344-c9ce-431e-b7df-96553aa55625 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:06.263618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e6344-c9ce-431e-b7df-96553aa55625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:06.319906 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-ab5e6344-c9ce-431e-b7df-96553aa55625 None None] MFA Rules not processed for user `d44776834b134ae98fa28d4741cc4ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:47:06.321138 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ab5e6344-c9ce-431e-b7df-96553aa55625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:47:06.361944 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:47:06.392184 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 700/1401] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Jun 21 05:47:06 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:47:06.399673 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20338d-94e1-4660-a4b4-dbdfade46407 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:47:06.411791 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20338d-94e1-4660-a4b4-dbdfade46407 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:47:06.415395 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b8f42-b5a7-4498-b2ab-6cb280c9f646 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44776834b134ae98fa28d4741cc4ec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:47:06.416577 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b8f42-b5a7-4498-b2ab-6cb280c9f646 service glance] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:06.416869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b8f42-b5a7-4498-b2ab-6cb280c9f646 service glance] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:06.417147 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b8f42-b5a7-4498-b2ab-6cb280c9f646 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:06.426619 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b8f42-b5a7-4498-b2ab-6cb280c9f646 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:47:06.428055 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b8f42-b5a7-4498-b2ab-6cb280c9f646 service glance] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:47:06.438248 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 702/1402] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:47:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:47:07.178723 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fce96a-2fa0-440c-9fd3-952e10f30644 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:07.179016 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fce96a-2fa0-440c-9fd3-952e10f30644 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:07.179300 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fce96a-2fa0-440c-9fd3-952e10f30644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:07.239519 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-e7fce96a-2fa0-440c-9fd3-952e10f30644 None None] MFA Rules not processed for user `af8e0eb5ff8c40ae848929780d99e72d`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:47:07.240747 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e7fce96a-2fa0-440c-9fd3-952e10f30644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:47:07.307855 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 701/1403] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jun 21 05:47:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:47:07.357821 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa791b2c-5e0f-4ade-841a-aeecbdf2a668 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:07.358156 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa791b2c-5e0f-4ade-841a-aeecbdf2a668 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:07.358437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa791b2c-5e0f-4ade-841a-aeecbdf2a668 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:07.359984 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 703/1404] 10.222.0.18 () {54 vars in 942 bytes} [Tue Jun 21 05:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:47:07.366239 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3912a-efcc-4bfc-af7e-e43bea7034bd None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:07.366531 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3912a-efcc-4bfc-af7e-e43bea7034bd None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:07.366815 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3912a-efcc-4bfc-af7e-e43bea7034bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:07.433454 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-04a3912a-efcc-4bfc-af7e-e43bea7034bd None None] MFA Rules not processed for user `ac485a336d8b4360bce4f495bd02dbde`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:47:07.435399 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-04a3912a-efcc-4bfc-af7e-e43bea7034bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:47:07.476831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa1f2c-ef99-40bc-bddd-811ca1519980 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:07.477640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa1f2c-ef99-40bc-bddd-811ca1519980 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:07.477640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa1f2c-ef99-40bc-bddd-811ca1519980 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:07.478799 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 704/1405] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 05:47:07.484569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75f95f-1d6e-4dbe-9a74-a7b25494af97 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:07.484853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75f95f-1d6e-4dbe-9a74-a7b25494af97 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:07.485284 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75f95f-1d6e-4dbe-9a74-a7b25494af97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:07.491773 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=61 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:47:07.504857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-8b75f95f-1d6e-4dbe-9a74-a7b25494af97 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:47:07.506102 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8b75f95f-1d6e-4dbe-9a74-a7b25494af97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:47:07.514707 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 705/1406] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:47:07.547762 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 702/1407] 10.222.0.18 () {58 vars in 1039 bytes} [Tue Jun 21 05:47:07 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:47:07.557146 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75f95f-1d6e-4dbe-9a74-a7b25494af97 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:47:07.569656 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3912a-efcc-4bfc-af7e-e43bea7034bd None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:47:07.569959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75f95f-1d6e-4dbe-9a74-a7b25494af97 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:47:07.577416 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fd156-e66b-4aa3-ade6-672cb039091a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac485a336d8b4360bce4f495bd02dbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:47:07.577416 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fd156-e66b-4aa3-ade6-672cb039091a service swift] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:07.577416 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fd156-e66b-4aa3-ade6-672cb039091a service swift] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:07.577416 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fd156-e66b-4aa3-ade6-672cb039091a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:07.583781 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3912a-efcc-4bfc-af7e-e43bea7034bd None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:47:07.589871 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9378b1-2f34-496d-8090-a22d5f091cb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:47:07.591514 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fd156-e66b-4aa3-ade6-672cb039091a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:47:07.591654 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9378b1-2f34-496d-8090-a22d5f091cb6 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:07.591654 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9378b1-2f34-496d-8090-a22d5f091cb6 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:07.591654 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9378b1-2f34-496d-8090-a22d5f091cb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:07.592032 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fd156-e66b-4aa3-ade6-672cb039091a service swift] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:47:07.600593 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9378b1-2f34-496d-8090-a22d5f091cb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:47:07.602266 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 706/1408] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 21 05:47:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 21 05:47:07.602394 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9378b1-2f34-496d-8090-a22d5f091cb6 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:47:07.608295 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:47:07.614443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 703/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:47:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 05:47:17.598650 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=8 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:47:29.846756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5df218-b24f-4582-a975-a3da2f36e429 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:29.847423 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5df218-b24f-4582-a975-a3da2f36e429 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:29.847423 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5df218-b24f-4582-a975-a3da2f36e429 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:29.848714 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 707/1410] 10.222.0.18 () {54 vars in 918 bytes} [Tue Jun 21 05:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:47:29.854578 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e494b-21fc-42df-8834-1f6554cb5fcf None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:29.855056 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e494b-21fc-42df-8834-1f6554cb5fcf None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:29.855163 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e494b-21fc-42df-8834-1f6554cb5fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:29.872760 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-748e494b-21fc-42df-8834-1f6554cb5fcf None None] MFA Rules not processed for user `d17a40bea6ba41f19c88e16f9b15cf27`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:47:29.873990 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-748e494b-21fc-42df-8834-1f6554cb5fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:47:29.882446 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 704/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Tue Jun 21 05:47:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:47:29.897339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca4f80-9922-45e7-810e-986b222599e9 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:29.897627 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca4f80-9922-45e7-810e-986b222599e9 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:29.897910 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca4f80-9922-45e7-810e-986b222599e9 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:29.899326 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 708/1412] 10.222.0.18 () {54 vars in 918 bytes} [Tue Jun 21 05:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:47:29.904597 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3ebe9-5fa9-4123-8cc5-c4c43b4883b5 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:29.904885 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3ebe9-5fa9-4123-8cc5-c4c43b4883b5 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:29.905164 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3ebe9-5fa9-4123-8cc5-c4c43b4883b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:29.922973 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-76c3ebe9-5fa9-4123-8cc5-c4c43b4883b5 None None] MFA Rules not processed for user `f702830987ba4548a4c2ee3d0e302d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:47:29.924181 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-76c3ebe9-5fa9-4123-8cc5-c4c43b4883b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:47:29.933390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 705/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Tue Jun 21 05:47:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:47:32.443215 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42809462-47eb-402e-8a3e-cfc1d9a0531e None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:32.443742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42809462-47eb-402e-8a3e-cfc1d9a0531e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:32.443742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42809462-47eb-402e-8a3e-cfc1d9a0531e None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:32.445063 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 05:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:47:32.450243 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809ca06-cb1c-4ba3-9e1d-926363affc3f None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:32.450660 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809ca06-cb1c-4ba3-9e1d-926363affc3f None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:32.450809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809ca06-cb1c-4ba3-9e1d-926363affc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:32.468280 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-1809ca06-cb1c-4ba3-9e1d-926363affc3f None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:47:32.469511 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1809ca06-cb1c-4ba3-9e1d-926363affc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:47:32.477587 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 05:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:47:32.520414 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42809462-47eb-402e-8a3e-cfc1d9a0531e None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:47:32.535155 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42809462-47eb-402e-8a3e-cfc1d9a0531e None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:47:32.540553 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4acdc07-abfc-49fe-a4d4-b999138d774a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:47:32.541843 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acdc07-abfc-49fe-a4d4-b999138d774a service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:32.542150 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acdc07-abfc-49fe-a4d4-b999138d774a service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:32.542425 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acdc07-abfc-49fe-a4d4-b999138d774a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:32.550469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4acdc07-abfc-49fe-a4d4-b999138d774a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:47:32.552036 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4acdc07-abfc-49fe-a4d4-b999138d774a service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:47:32.561337 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 710/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:47:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:47:33.462981 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5628bc-2f5d-45d3-b2df-299d60261738 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:33.463510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5628bc-2f5d-45d3-b2df-299d60261738 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:33.463510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5628bc-2f5d-45d3-b2df-299d60261738 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:33.464846 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 05:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:47:33.469818 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53a48f-4132-44f2-9759-5b2144817b74 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:33.470228 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53a48f-4132-44f2-9759-5b2144817b74 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:33.470414 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53a48f-4132-44f2-9759-5b2144817b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:33.488962 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-df53a48f-4132-44f2-9759-5b2144817b74 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:47:33.490191 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-df53a48f-4132-44f2-9759-5b2144817b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:47:33.498469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 05:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:47:33.648258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5628bc-2f5d-45d3-b2df-299d60261738 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:47:33.662509 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5628bc-2f5d-45d3-b2df-299d60261738 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:47:33.668371 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189316f5-62c0-4bde-a719-58a808413d87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:47:33.669008 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189316f5-62c0-4bde-a719-58a808413d87 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:33.669293 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189316f5-62c0-4bde-a719-58a808413d87 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:33.669575 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189316f5-62c0-4bde-a719-58a808413d87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:33.677629 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189316f5-62c0-4bde-a719-58a808413d87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:47:33.679230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189316f5-62c0-4bde-a719-58a808413d87 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:47:33.689314 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 708/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:47:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:47:34.566953 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e4674-de61-49e2-8f9e-bcbc25de1f23 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:34.567482 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e4674-de61-49e2-8f9e-bcbc25de1f23 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:34.567482 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e4674-de61-49e2-8f9e-bcbc25de1f23 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:34.568817 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 05:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:47:34.574269 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468772fa-140a-4479-a631-1dbc767245c1 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:34.574727 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468772fa-140a-4479-a631-1dbc767245c1 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:34.574837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468772fa-140a-4479-a631-1dbc767245c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:34.593746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-468772fa-140a-4479-a631-1dbc767245c1 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:47:34.594994 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-468772fa-140a-4479-a631-1dbc767245c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:47:34.603047 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 05:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:47:34.754585 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e4674-de61-49e2-8f9e-bcbc25de1f23 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:47:34.769026 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e4674-de61-49e2-8f9e-bcbc25de1f23 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:47:34.774352 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e10ff-3ddd-444d-8b85-f438d3cd7a79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:47:34.774976 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e10ff-3ddd-444d-8b85-f438d3cd7a79 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:34.775296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e10ff-3ddd-444d-8b85-f438d3cd7a79 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:34.775650 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e10ff-3ddd-444d-8b85-f438d3cd7a79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:34.784041 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e10ff-3ddd-444d-8b85-f438d3cd7a79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:47:34.786122 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e10ff-3ddd-444d-8b85-f438d3cd7a79 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:47:34.796439 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 713/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:47:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:47:35.649096 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fcfe9-4a3f-4f57-9687-54b1c316e308 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:35.649636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fcfe9-4a3f-4f57-9687-54b1c316e308 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:35.649636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fcfe9-4a3f-4f57-9687-54b1c316e308 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:35.651628 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 05:47:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:47:35.656747 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db37e4-ccda-4a82-b44e-04763ececbe6 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:35.657181 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db37e4-ccda-4a82-b44e-04763ececbe6 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:35.657304 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db37e4-ccda-4a82-b44e-04763ececbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:35.675255 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-e0db37e4-ccda-4a82-b44e-04763ececbe6 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:47:35.676431 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e0db37e4-ccda-4a82-b44e-04763ececbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:47:35.684158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 05:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:47:35.835450 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fcfe9-4a3f-4f57-9687-54b1c316e308 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:47:35.850527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fcfe9-4a3f-4f57-9687-54b1c316e308 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:47:35.856591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dad578-860b-450e-ac77-2b2070d29055 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:47:35.857231 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dad578-860b-450e-ac77-2b2070d29055 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:35.857517 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dad578-860b-450e-ac77-2b2070d29055 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:35.857799 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dad578-860b-450e-ac77-2b2070d29055 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:35.866188 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dad578-860b-450e-ac77-2b2070d29055 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:47:35.867758 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dad578-860b-450e-ac77-2b2070d29055 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:47:35.877352 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 711/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:47:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:47:36.742195 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d970427-065f-4dd1-a04c-4441a5240863 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:36.742763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d970427-065f-4dd1-a04c-4441a5240863 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:36.742763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d970427-065f-4dd1-a04c-4441a5240863 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:36.744149 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 05:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:47:36.749057 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c0979-e48c-485a-86db-566affa98084 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:36.749499 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c0979-e48c-485a-86db-566affa98084 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:36.749605 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c0979-e48c-485a-86db-566affa98084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:36.767702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-cd9c0979-e48c-485a-86db-566affa98084 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:47:36.768883 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-cd9c0979-e48c-485a-86db-566affa98084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:47:36.779765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 05:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:47:36.929117 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d970427-065f-4dd1-a04c-4441a5240863 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:47:36.943580 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d970427-065f-4dd1-a04c-4441a5240863 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:47:36.949798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ad1bb-6300-4a0a-8b57-a3c1728c72df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:47:36.950673 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ad1bb-6300-4a0a-8b57-a3c1728c72df service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:36.951060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ad1bb-6300-4a0a-8b57-a3c1728c72df service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:36.951433 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ad1bb-6300-4a0a-8b57-a3c1728c72df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:36.959961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ad1bb-6300-4a0a-8b57-a3c1728c72df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:47:36.961534 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ad1bb-6300-4a0a-8b57-a3c1728c72df service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:47:36.972173 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 716/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:47:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:47:37.780066 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02258a23-5bbf-4712-85cf-ce94d15cac88 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:37.780636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02258a23-5bbf-4712-85cf-ce94d15cac88 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:37.780636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02258a23-5bbf-4712-85cf-ce94d15cac88 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:37.782004 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 05:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:47:37.787102 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99151df7-b9b9-43f8-a7ee-d486ec7d40f1 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:37.787503 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99151df7-b9b9-43f8-a7ee-d486ec7d40f1 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:37.787618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99151df7-b9b9-43f8-a7ee-d486ec7d40f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:37.806451 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-99151df7-b9b9-43f8-a7ee-d486ec7d40f1 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:47:37.807647 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-99151df7-b9b9-43f8-a7ee-d486ec7d40f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:47:37.817580 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 05:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:47:37.967450 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02258a23-5bbf-4712-85cf-ce94d15cac88 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:47:37.982958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02258a23-5bbf-4712-85cf-ce94d15cac88 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:47:37.988198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9ee05-1343-4bff-ab8a-f3044a78460f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:47:37.988830 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9ee05-1343-4bff-ab8a-f3044a78460f service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:37.989114 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9ee05-1343-4bff-ab8a-f3044a78460f service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:37.989386 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9ee05-1343-4bff-ab8a-f3044a78460f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:37.997799 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9ee05-1343-4bff-ab8a-f3044a78460f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:47:37.999403 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9ee05-1343-4bff-ab8a-f3044a78460f service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:47:38.008755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 714/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:47:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:47:38.822270 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8f9b4-6dec-40ca-99da-fb917d89ab10 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:38.822814 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8f9b4-6dec-40ca-99da-fb917d89ab10 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:38.822814 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8f9b4-6dec-40ca-99da-fb917d89ab10 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:38.824186 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 05:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:47:38.829573 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b330a80-d76e-47c3-92c0-e0e89a6a4119 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:38.830006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b330a80-d76e-47c3-92c0-e0e89a6a4119 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:38.830163 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b330a80-d76e-47c3-92c0-e0e89a6a4119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:38.848362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-3b330a80-d76e-47c3-92c0-e0e89a6a4119 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:47:38.849559 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3b330a80-d76e-47c3-92c0-e0e89a6a4119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:47:38.857952 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 05:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:47:39.008240 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8f9b4-6dec-40ca-99da-fb917d89ab10 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:47:39.022990 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8f9b4-6dec-40ca-99da-fb917d89ab10 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:47:39.029007 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbcbd3e-e76c-4d18-a6a0-fc2bed612e66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:47:39.029645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcbd3e-e76c-4d18-a6a0-fc2bed612e66 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:39.029948 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcbd3e-e76c-4d18-a6a0-fc2bed612e66 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:39.030226 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcbd3e-e76c-4d18-a6a0-fc2bed612e66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:39.038478 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbcbd3e-e76c-4d18-a6a0-fc2bed612e66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:47:39.040133 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbcbd3e-e76c-4d18-a6a0-fc2bed612e66 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:47:39.049605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 719/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:47:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:47:39.855846 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e693a-6913-4499-82cb-987e2f61f709 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:39.856411 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e693a-6913-4499-82cb-987e2f61f709 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:39.856523 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e693a-6913-4499-82cb-987e2f61f709 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:39.857832 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 05:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:47:39.862793 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21755c56-1156-43e9-aa5d-fa4d1a3b3cc9 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:39.863196 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21755c56-1156-43e9-aa5d-fa4d1a3b3cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:39.863360 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21755c56-1156-43e9-aa5d-fa4d1a3b3cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:39.881418 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-21755c56-1156-43e9-aa5d-fa4d1a3b3cc9 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:47:39.882648 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-21755c56-1156-43e9-aa5d-fa4d1a3b3cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:47:39.890376 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 05:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:47:40.038394 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e693a-6913-4499-82cb-987e2f61f709 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:47:40.052995 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e693a-6913-4499-82cb-987e2f61f709 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:47:40.058440 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4defc93-911b-44d5-b52a-167295ab4e29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:47:40.059073 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4defc93-911b-44d5-b52a-167295ab4e29 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:40.059360 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4defc93-911b-44d5-b52a-167295ab4e29 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:40.059643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4defc93-911b-44d5-b52a-167295ab4e29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:40.067912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4defc93-911b-44d5-b52a-167295ab4e29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:47:40.069478 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4defc93-911b-44d5-b52a-167295ab4e29 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:47:40.079036 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 717/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:47:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:47:40.883769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3a9b4-4b38-4393-ba2f-e04c72e24224 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:40.884338 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3a9b4-4b38-4393-ba2f-e04c72e24224 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:40.884338 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3a9b4-4b38-4393-ba2f-e04c72e24224 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:40.886361 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 05:47:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:47:40.891265 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b1efe-1efd-4e12-9640-bd46dc2753e8 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:40.891672 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b1efe-1efd-4e12-9640-bd46dc2753e8 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:40.891821 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b1efe-1efd-4e12-9640-bd46dc2753e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:40.909241 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-206b1efe-1efd-4e12-9640-bd46dc2753e8 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:47:40.910456 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-206b1efe-1efd-4e12-9640-bd46dc2753e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:47:40.918224 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 05:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:47:41.065273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3a9b4-4b38-4393-ba2f-e04c72e24224 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:47:41.080162 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3a9b4-4b38-4393-ba2f-e04c72e24224 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:47:41.085422 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1babfa-a2d7-4625-ab3c-3c2a98a1701a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:47:41.086072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1babfa-a2d7-4625-ab3c-3c2a98a1701a service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:41.086354 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1babfa-a2d7-4625-ab3c-3c2a98a1701a service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:41.086629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1babfa-a2d7-4625-ab3c-3c2a98a1701a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:41.094912 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1babfa-a2d7-4625-ab3c-3c2a98a1701a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:47:41.096516 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1babfa-a2d7-4625-ab3c-3c2a98a1701a service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:47:41.106846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 722/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:47:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:47:43.029857 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de114fd-562b-4646-91e8-54fe3949fe76 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:43.030541 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de114fd-562b-4646-91e8-54fe3949fe76 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:43.030541 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de114fd-562b-4646-91e8-54fe3949fe76 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:43.031813 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 05:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:47:43.037056 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d14241-d696-48f2-b477-8de7f9b53827 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:43.037520 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d14241-d696-48f2-b477-8de7f9b53827 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:43.037624 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d14241-d696-48f2-b477-8de7f9b53827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:43.058024 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-67d14241-d696-48f2-b477-8de7f9b53827 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:47:43.059268 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-67d14241-d696-48f2-b477-8de7f9b53827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:47:43.067066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 05:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:47:43.105450 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de114fd-562b-4646-91e8-54fe3949fe76 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:47:43.116201 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de114fd-562b-4646-91e8-54fe3949fe76 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:47:43.120261 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4bfa4-bbf6-47a4-bf90-d6127402e6d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:47:43.120908 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4bfa4-bbf6-47a4-bf90-d6127402e6d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:43.121195 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4bfa4-bbf6-47a4-bf90-d6127402e6d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:43.121476 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4bfa4-bbf6-47a4-bf90-d6127402e6d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:43.130438 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4bfa4-bbf6-47a4-bf90-d6127402e6d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:47:43.132132 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4bfa4-bbf6-47a4-bf90-d6127402e6d0 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:47:43.142317 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 720/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:47:45.347915 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a58e0-be50-4f6a-b184-67fdd6aa73f2 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:45.348472 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a58e0-be50-4f6a-b184-67fdd6aa73f2 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:45.348472 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a58e0-be50-4f6a-b184-67fdd6aa73f2 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:45.349880 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 05:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:47:45.355078 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60c39b-e683-4a54-8d95-766c40b37818 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:45.355529 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60c39b-e683-4a54-8d95-766c40b37818 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:45.355664 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60c39b-e683-4a54-8d95-766c40b37818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:45.373738 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-da60c39b-e683-4a54-8d95-766c40b37818 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:47:45.374900 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-da60c39b-e683-4a54-8d95-766c40b37818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:47:45.382474 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 05:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:47:45.426453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a58e0-be50-4f6a-b184-67fdd6aa73f2 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:47:45.428146 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-119a58e0-be50-4f6a-b184-67fdd6aa73f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:47:45.441329 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a58e0-be50-4f6a-b184-67fdd6aa73f2 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:47:45.444888 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c56ad-ed0b-4cdd-be81-ffde911a6183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:47:45.445520 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c56ad-ed0b-4cdd-be81-ffde911a6183 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:45.445851 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c56ad-ed0b-4cdd-be81-ffde911a6183 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:45.446186 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c56ad-ed0b-4cdd-be81-ffde911a6183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:45.456071 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c56ad-ed0b-4cdd-be81-ffde911a6183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:47:45.457508 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c56ad-ed0b-4cdd-be81-ffde911a6183 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:47:45.467177 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 725/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:47:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:47:47.844664 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e22ea-76ac-4d95-a65b-d77017dd97ae None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:47.845232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e22ea-76ac-4d95-a65b-d77017dd97ae None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:47.845232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e22ea-76ac-4d95-a65b-d77017dd97ae None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:47.846687 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 05:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:47:47.852200 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6f51a-f9ff-40e5-b4e2-6206fee0423f None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:47.852639 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6f51a-f9ff-40e5-b4e2-6206fee0423f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:47.852744 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6f51a-f9ff-40e5-b4e2-6206fee0423f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:47.870738 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-ecb6f51a-f9ff-40e5-b4e2-6206fee0423f None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:47:47.871937 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ecb6f51a-f9ff-40e5-b4e2-6206fee0423f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:47:47.880076 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 05:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:47:47.918671 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e22ea-76ac-4d95-a65b-d77017dd97ae None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:47:47.929205 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e22ea-76ac-4d95-a65b-d77017dd97ae None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:47:47.932602 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a7b32-1ecb-4e01-92df-579d6c74ec49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:47:47.933232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a7b32-1ecb-4e01-92df-579d6c74ec49 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:47.933513 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a7b32-1ecb-4e01-92df-579d6c74ec49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:47.933787 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a7b32-1ecb-4e01-92df-579d6c74ec49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:47.944092 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a7b32-1ecb-4e01-92df-579d6c74ec49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:47:47.945528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a7b32-1ecb-4e01-92df-579d6c74ec49 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:47:47.955661 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 723/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:47:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:47:50.098167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77e3b1-20e3-4334-967c-bc7ceb781d7a None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:50.098720 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77e3b1-20e3-4334-967c-bc7ceb781d7a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:50.098826 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77e3b1-20e3-4334-967c-bc7ceb781d7a None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:50.100202 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 05:47:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:47:50.106292 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52cc17-ffc1-494e-893c-37fdcb3eb0c2 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:50.106710 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52cc17-ffc1-494e-893c-37fdcb3eb0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:50.106852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52cc17-ffc1-494e-893c-37fdcb3eb0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:50.124564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-cd52cc17-ffc1-494e-893c-37fdcb3eb0c2 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:47:50.125677 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-cd52cc17-ffc1-494e-893c-37fdcb3eb0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:47:50.133320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 05:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:47:50.172318 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77e3b1-20e3-4334-967c-bc7ceb781d7a None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:47:50.183004 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77e3b1-20e3-4334-967c-bc7ceb781d7a None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:47:50.186569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f2fa4-b3ac-4ab1-9311-ac368188c56f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:47:50.187199 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f2fa4-b3ac-4ab1-9311-ac368188c56f service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:50.187832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f2fa4-b3ac-4ab1-9311-ac368188c56f service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:50.187832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f2fa4-b3ac-4ab1-9311-ac368188c56f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:50.196661 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f2fa4-b3ac-4ab1-9311-ac368188c56f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:47:50.198666 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f2fa4-b3ac-4ab1-9311-ac368188c56f service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:47:50.208081 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 728/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:47:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:47:52.355824 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728667a-0646-4c1a-9813-c6dd2b35f75a None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:52.356395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728667a-0646-4c1a-9813-c6dd2b35f75a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:52.356395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728667a-0646-4c1a-9813-c6dd2b35f75a None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:52.357767 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 05:47:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:47:52.363179 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237bea2-245c-481e-89d8-6334f6dd91cc None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:52.363661 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237bea2-245c-481e-89d8-6334f6dd91cc None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:52.363775 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237bea2-245c-481e-89d8-6334f6dd91cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:52.380893 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-8237bea2-245c-481e-89d8-6334f6dd91cc None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:47:52.382136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8237bea2-245c-481e-89d8-6334f6dd91cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:47:52.390310 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 05:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:47:52.427760 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728667a-0646-4c1a-9813-c6dd2b35f75a None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:47:52.438693 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728667a-0646-4c1a-9813-c6dd2b35f75a None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:47:52.442312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e50b82-4a89-4215-917b-58792f00fa3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:47:52.443179 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e50b82-4a89-4215-917b-58792f00fa3d service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:52.443506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e50b82-4a89-4215-917b-58792f00fa3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:52.443784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e50b82-4a89-4215-917b-58792f00fa3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:52.453028 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e50b82-4a89-4215-917b-58792f00fa3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:47:52.454488 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e50b82-4a89-4215-917b-58792f00fa3d service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:47:52.464547 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 726/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:47:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:47:54.558307 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbe413-b495-44dc-af8c-4945d5616f84 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:54.558819 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbe413-b495-44dc-af8c-4945d5616f84 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:54.558819 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbe413-b495-44dc-af8c-4945d5616f84 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:54.560142 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 05:47:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:47:54.565279 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea083595-1680-4b1d-9866-242c629379f7 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:54.565738 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea083595-1680-4b1d-9866-242c629379f7 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:54.565869 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea083595-1680-4b1d-9866-242c629379f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:54.584034 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-ea083595-1680-4b1d-9866-242c629379f7 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:47:54.585231 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ea083595-1680-4b1d-9866-242c629379f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:47:54.592954 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 05:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:47:54.631300 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbe413-b495-44dc-af8c-4945d5616f84 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:47:54.642114 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbe413-b495-44dc-af8c-4945d5616f84 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:47:54.645523 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745125c-1aaf-4fd8-b9ab-5aff28890b66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:47:54.646180 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745125c-1aaf-4fd8-b9ab-5aff28890b66 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:54.646465 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745125c-1aaf-4fd8-b9ab-5aff28890b66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:54.646740 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745125c-1aaf-4fd8-b9ab-5aff28890b66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:54.655484 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745125c-1aaf-4fd8-b9ab-5aff28890b66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:47:54.656896 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745125c-1aaf-4fd8-b9ab-5aff28890b66 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:47:54.666730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 731/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:47:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:47:56.711274 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9608ca9-1319-4462-bd8d-0947043116a7 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:56.711692 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9608ca9-1319-4462-bd8d-0947043116a7 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:56.711837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9608ca9-1319-4462-bd8d-0947043116a7 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:56.713748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 05:47:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:47:56.718970 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69429b3-9630-4a14-acfe-6826f2edc62b None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:56.719388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69429b3-9630-4a14-acfe-6826f2edc62b None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:56.719487 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69429b3-9630-4a14-acfe-6826f2edc62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:56.737687 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-e69429b3-9630-4a14-acfe-6826f2edc62b None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:47:56.738907 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e69429b3-9630-4a14-acfe-6826f2edc62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:47:56.746669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 05:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:47:56.783809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9608ca9-1319-4462-bd8d-0947043116a7 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:47:56.795054 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9608ca9-1319-4462-bd8d-0947043116a7 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:47:56.798505 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9019c-09a6-46d8-b3c7-159f307c288c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:47:56.799142 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9019c-09a6-46d8-b3c7-159f307c288c service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:56.799427 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9019c-09a6-46d8-b3c7-159f307c288c service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:56.799706 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9019c-09a6-46d8-b3c7-159f307c288c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:56.808479 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9019c-09a6-46d8-b3c7-159f307c288c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:47:56.809900 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9019c-09a6-46d8-b3c7-159f307c288c service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:47:56.819645 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 729/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:47:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:47:58.903334 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01803223-e05b-49f6-8a1a-984f654e365e None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:58.903863 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01803223-e05b-49f6-8a1a-984f654e365e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:58.903863 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01803223-e05b-49f6-8a1a-984f654e365e None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:58.905310 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 05:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:47:58.910624 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd3d32-f957-4c64-b50d-17790318da91 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:58.911055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd3d32-f957-4c64-b50d-17790318da91 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:58.911185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd3d32-f957-4c64-b50d-17790318da91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:58.917285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=79 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:47:58.929978 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-90cd3d32-f957-4c64-b50d-17790318da91 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:47:58.931179 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-90cd3d32-f957-4c64-b50d-17790318da91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:47:58.939480 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 05:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:47:58.977406 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01803223-e05b-49f6-8a1a-984f654e365e None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:47:58.982785 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=73 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:47:58.989352 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01803223-e05b-49f6-8a1a-984f654e365e None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:47:58.992869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830a819-d4b6-4fe3-95ef-e13a8a30619b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:47:58.993504 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830a819-d4b6-4fe3-95ef-e13a8a30619b service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:47:58.993789 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830a819-d4b6-4fe3-95ef-e13a8a30619b service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:47:58.994161 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830a819-d4b6-4fe3-95ef-e13a8a30619b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:47:59.003567 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830a819-d4b6-4fe3-95ef-e13a8a30619b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:47:59.004991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830a819-d4b6-4fe3-95ef-e13a8a30619b service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:47:59.016736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 734/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:47:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:48:01.083593 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff39bab-6e33-4757-81c8-19a5099b2784 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:48:01.084160 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff39bab-6e33-4757-81c8-19a5099b2784 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:48:01.084160 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff39bab-6e33-4757-81c8-19a5099b2784 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:48:01.085505 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 05:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:48:01.091206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76ae40-0a23-4414-8cda-e1d536fd21a5 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:48:01.091612 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76ae40-0a23-4414-8cda-e1d536fd21a5 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:48:01.091766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76ae40-0a23-4414-8cda-e1d536fd21a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:48:01.110536 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-4e76ae40-0a23-4414-8cda-e1d536fd21a5 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:48:01.111742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-4e76ae40-0a23-4414-8cda-e1d536fd21a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:48:01.119582 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 05:48:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:48:01.158870 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff39bab-6e33-4757-81c8-19a5099b2784 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:48:01.170359 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff39bab-6e33-4757-81c8-19a5099b2784 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:48:01.173739 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059964bc-ffab-42d5-b2cc-af73fd485c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:48:01.174412 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059964bc-ffab-42d5-b2cc-af73fd485c4f service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:48:01.174694 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059964bc-ffab-42d5-b2cc-af73fd485c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:48:01.174968 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059964bc-ffab-42d5-b2cc-af73fd485c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:48:01.183590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059964bc-ffab-42d5-b2cc-af73fd485c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:48:01.184996 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059964bc-ffab-42d5-b2cc-af73fd485c4f service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:48:01.194151 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 732/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:48:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:48:03.236795 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a11b2-3412-4bb2-8968-9270c4ce0978 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:48:03.237359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a11b2-3412-4bb2-8968-9270c4ce0978 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:48:03.237359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a11b2-3412-4bb2-8968-9270c4ce0978 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:48:03.238824 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 05:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:48:03.244167 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae412d4-5e8a-4015-99c5-7f90f11de3b3 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:48:03.245183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae412d4-5e8a-4015-99c5-7f90f11de3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:48:03.245297 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae412d4-5e8a-4015-99c5-7f90f11de3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:48:03.263197 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-cae412d4-5e8a-4015-99c5-7f90f11de3b3 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:48:03.264373 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-cae412d4-5e8a-4015-99c5-7f90f11de3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:48:03.272057 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 05:48:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:48:03.308566 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a11b2-3412-4bb2-8968-9270c4ce0978 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:48:03.319215 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a11b2-3412-4bb2-8968-9270c4ce0978 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:48:03.322742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198830a3-3ea0-42a2-8245-baf949294232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:48:03.323372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198830a3-3ea0-42a2-8245-baf949294232 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:48:03.323652 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198830a3-3ea0-42a2-8245-baf949294232 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:48:03.323926 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198830a3-3ea0-42a2-8245-baf949294232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:48:03.332671 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198830a3-3ea0-42a2-8245-baf949294232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:48:03.334128 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198830a3-3ea0-42a2-8245-baf949294232 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:48:03.343836 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 737/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:48:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:48:13.257557 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=11 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:48:13.339813 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=14 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:48:23.308385 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57732e21-c093-4ced-a024-ffcb688c2f11 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:48:23.308983 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57732e21-c093-4ced-a024-ffcb688c2f11 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:48:23.308983 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57732e21-c093-4ced-a024-ffcb688c2f11 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:48:23.310329 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 734/1471] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:48:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:48:23.315781 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72785d24-2389-4dfb-a7ea-21fbc24d45c7 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:48:23.316228 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72785d24-2389-4dfb-a7ea-21fbc24d45c7 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:48:23.316347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72785d24-2389-4dfb-a7ea-21fbc24d45c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:48:23.336578 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-72785d24-2389-4dfb-a7ea-21fbc24d45c7 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:48:23.337806 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-72785d24-2389-4dfb-a7ea-21fbc24d45c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:48:23.345787 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 738/1472] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:48:23.394395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9205a-9301-4da7-ae39-927e8e25c121 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:48:23.394682 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9205a-9301-4da7-ae39-927e8e25c121 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:48:23.394960 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9205a-9301-4da7-ae39-927e8e25c121 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:48:23.396324 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 735/1473] 10.222.0.18 () {54 vars in 962 bytes} [Tue Jun 21 05:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:48:23.401182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a1841-026c-41bc-8027-dba6170041f9 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:48:23.401475 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a1841-026c-41bc-8027-dba6170041f9 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:48:23.401757 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a1841-026c-41bc-8027-dba6170041f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:48:23.420111 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-3a8a1841-026c-41bc-8027-dba6170041f9 None None] MFA Rules not processed for user `d44776834b134ae98fa28d4741cc4ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:48:23.421319 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3a8a1841-026c-41bc-8027-dba6170041f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:48:23.427792 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 739/1474] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Jun 21 05:48:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:48:23.435719 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9205a-9301-4da7-ae39-927e8e25c121 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:48:23.446143 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9205a-9301-4da7-ae39-927e8e25c121 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:48:23.449578 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01faca-a5e0-44ba-904e-01360424b876 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44776834b134ae98fa28d4741cc4ec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:48:23.450246 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01faca-a5e0-44ba-904e-01360424b876 service glance] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:48:23.450526 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01faca-a5e0-44ba-904e-01360424b876 service glance] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:48:23.450799 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01faca-a5e0-44ba-904e-01360424b876 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:48:23.459649 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01faca-a5e0-44ba-904e-01360424b876 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:48:23.461064 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01faca-a5e0-44ba-904e-01360424b876 service glance] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:48:23.470596 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 736/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:48:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:48:25.704597 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6edf6f-1c70-4722-8cb9-ef2eb9629cb8 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:48:25.705375 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6edf6f-1c70-4722-8cb9-ef2eb9629cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:48:25.705375 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6edf6f-1c70-4722-8cb9-ef2eb9629cb8 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:48:25.706840 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 740/1476] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:48:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 05:48:25.713057 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679108ef-b89f-4c15-94e0-ed0acd684a44 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:48:25.714323 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679108ef-b89f-4c15-94e0-ed0acd684a44 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:48:25.714323 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679108ef-b89f-4c15-94e0-ed0acd684a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:48:25.733560 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-679108ef-b89f-4c15-94e0-ed0acd684a44 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:48:25.734817 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-679108ef-b89f-4c15-94e0-ed0acd684a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:48:25.743047 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 737/1477] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:48:25.768637 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6edf6f-1c70-4722-8cb9-ef2eb9629cb8 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:48:25.782003 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6edf6f-1c70-4722-8cb9-ef2eb9629cb8 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:48:25.786802 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a315a-3ef5-43fe-a04e-91fbe3a78b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:48:25.787472 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a315a-3ef5-43fe-a04e-91fbe3a78b96 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:48:25.787758 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a315a-3ef5-43fe-a04e-91fbe3a78b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:48:25.788043 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a315a-3ef5-43fe-a04e-91fbe3a78b96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:48:25.788800 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a315a-3ef5-43fe-a04e-91fbe3a78b96 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:48:25.790642 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: WARNING py.warnings [None req-611a315a-3ef5-43fe-a04e-91fbe3a78b96 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 05:48:25.790642 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: warnings.warn(msg) Jun 21 05:48:25.790642 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: Jun 21 05:48:25.791847 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a315a-3ef5-43fe-a04e-91fbe3a78b96 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:48:25.813447 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 741/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jun 21 05:48:25 2022] GET /identity/v3/projects => generated 2553 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:48:27.993693 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6985bc-f32d-4f98-acea-25ded2a53848 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:48:27.994323 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6985bc-f32d-4f98-acea-25ded2a53848 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:48:27.994323 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6985bc-f32d-4f98-acea-25ded2a53848 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:48:27.996222 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 738/1479] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:48:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:48:28.001709 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6959944-aed5-496f-80b9-4e5ee1956881 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:48:28.002188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6959944-aed5-496f-80b9-4e5ee1956881 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:48:28.002293 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6959944-aed5-496f-80b9-4e5ee1956881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:48:28.026650 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-b6959944-aed5-496f-80b9-4e5ee1956881 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:48:28.028187 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b6959944-aed5-496f-80b9-4e5ee1956881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:48:28.039583 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 742/1480] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:48:28.085812 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6985bc-f32d-4f98-acea-25ded2a53848 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:48:28.103047 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6985bc-f32d-4f98-acea-25ded2a53848 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:48:28.112837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02226c-5efe-442c-b316-3ec73e3faaa1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:48:28.113961 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02226c-5efe-442c-b316-3ec73e3faaa1 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:48:28.114992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02226c-5efe-442c-b316-3ec73e3faaa1 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:48:28.114992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02226c-5efe-442c-b316-3ec73e3faaa1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:48:28.130421 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b02226c-5efe-442c-b316-3ec73e3faaa1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:48:28.133308 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b02226c-5efe-442c-b316-3ec73e3faaa1 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:48:28.151447 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 739/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:48:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:48:30.463376 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938b879-c8b0-4a81-884c-d46b3f0cfa53 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:48:30.464079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938b879-c8b0-4a81-884c-d46b3f0cfa53 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:48:30.464079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938b879-c8b0-4a81-884c-d46b3f0cfa53 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:48:30.465454 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 743/1482] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:48:30.474186 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da3b99-a416-4bfe-bea9-74eac506293b None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:48:30.474763 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da3b99-a416-4bfe-bea9-74eac506293b None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:48:30.474914 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da3b99-a416-4bfe-bea9-74eac506293b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:48:30.496537 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-16da3b99-a416-4bfe-bea9-74eac506293b None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:48:30.498030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-16da3b99-a416-4bfe-bea9-74eac506293b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:48:30.506637 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 740/1483] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:48:30.544175 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938b879-c8b0-4a81-884c-d46b3f0cfa53 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:48:30.555366 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938b879-c8b0-4a81-884c-d46b3f0cfa53 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:48:30.559695 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5909d9-7e8d-4356-94c4-56fc3c72c0b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:48:30.560344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5909d9-7e8d-4356-94c4-56fc3c72c0b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:48:30.560630 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5909d9-7e8d-4356-94c4-56fc3c72c0b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:48:30.560910 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5909d9-7e8d-4356-94c4-56fc3c72c0b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:48:30.570643 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5909d9-7e8d-4356-94c4-56fc3c72c0b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:48:30.572089 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5909d9-7e8d-4356-94c4-56fc3c72c0b9 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:48:30.582946 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 744/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:48:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:48:33.655759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2ed9f-d7e2-4022-9cf5-4374fbaf285b None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:48:33.656328 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2ed9f-d7e2-4022-9cf5-4374fbaf285b None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:48:33.656328 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2ed9f-d7e2-4022-9cf5-4374fbaf285b None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:48:33.657708 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 741/1485] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:48:33.662998 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c15b1-fecc-4284-8692-d9df0a972220 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:48:33.663486 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c15b1-fecc-4284-8692-d9df0a972220 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:48:33.663633 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c15b1-fecc-4284-8692-d9df0a972220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:48:33.682669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-529c15b1-fecc-4284-8692-d9df0a972220 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:48:33.683915 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-529c15b1-fecc-4284-8692-d9df0a972220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:48:33.696357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 745/1486] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:48:33.736336 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2ed9f-d7e2-4022-9cf5-4374fbaf285b None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:48:33.748039 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2ed9f-d7e2-4022-9cf5-4374fbaf285b None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:48:33.751694 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e3eae-16d9-452f-a6c0-8d43a3838f5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:48:33.752299 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e3eae-16d9-452f-a6c0-8d43a3838f5c service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:48:33.752584 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e3eae-16d9-452f-a6c0-8d43a3838f5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:48:33.752863 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e3eae-16d9-452f-a6c0-8d43a3838f5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:48:33.763428 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e3eae-16d9-452f-a6c0-8d43a3838f5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:48:33.764066 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e3eae-16d9-452f-a6c0-8d43a3838f5c service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:48:33.776198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 742/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:48:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:48:35.954601 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a18b5d-a512-4155-a92d-32d33d19808d None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:48:35.955269 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a18b5d-a512-4155-a92d-32d33d19808d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:48:35.955269 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a18b5d-a512-4155-a92d-32d33d19808d None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:48:35.956649 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 746/1488] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:48:35.962081 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccc540-1c48-43b9-9a31-a0335ab9d9d7 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:48:35.962531 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccc540-1c48-43b9-9a31-a0335ab9d9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:48:35.962664 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccc540-1c48-43b9-9a31-a0335ab9d9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:48:35.981254 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-5fccc540-1c48-43b9-9a31-a0335ab9d9d7 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:48:35.982510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-5fccc540-1c48-43b9-9a31-a0335ab9d9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:48:35.991035 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 743/1489] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:48:36.032220 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a18b5d-a512-4155-a92d-32d33d19808d None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:48:36.043364 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a18b5d-a512-4155-a92d-32d33d19808d None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:48:36.046920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392fe7b-f00f-45c9-877f-b4ecda94f35e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:48:36.047564 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392fe7b-f00f-45c9-877f-b4ecda94f35e service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:48:36.047850 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392fe7b-f00f-45c9-877f-b4ecda94f35e service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:48:36.048128 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392fe7b-f00f-45c9-877f-b4ecda94f35e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:48:36.059553 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392fe7b-f00f-45c9-877f-b4ecda94f35e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:48:36.060985 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392fe7b-f00f-45c9-877f-b4ecda94f35e service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:48:36.071222 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 747/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:48:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 05:48:38.342790 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87447f10-3984-4280-978f-08aea1e8c607 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:48:38.343398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87447f10-3984-4280-978f-08aea1e8c607 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:48:38.343398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87447f10-3984-4280-978f-08aea1e8c607 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:48:38.344708 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 744/1491] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jun 21 05:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:48:38.350694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe393aa-3e04-4a6f-bf5a-8b03b73b895d None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:48:38.351457 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe393aa-3e04-4a6f-bf5a-8b03b73b895d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:48:38.351616 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe393aa-3e04-4a6f-bf5a-8b03b73b895d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:48:38.370403 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-6fe393aa-3e04-4a6f-bf5a-8b03b73b895d None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:48:38.371576 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-6fe393aa-3e04-4a6f-bf5a-8b03b73b895d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:48:38.379575 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 748/1492] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jun 21 05:48:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:48:38.419522 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87447f10-3984-4280-978f-08aea1e8c607 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:48:38.430190 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87447f10-3984-4280-978f-08aea1e8c607 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:48:38.433671 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29154e3-d850-42af-b2dc-97097f205357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:48:38.434347 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29154e3-d850-42af-b2dc-97097f205357 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:48:38.434629 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29154e3-d850-42af-b2dc-97097f205357 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:48:38.434907 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29154e3-d850-42af-b2dc-97097f205357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:48:38.444478 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29154e3-d850-42af-b2dc-97097f205357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:48:38.445899 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29154e3-d850-42af-b2dc-97097f205357 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:48:38.456127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 745/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:48:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:48:48.364869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=33 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:48:48.451795 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=33 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:50:12.110966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cd820-2e38-4b6c-96c8-e8cdd75b6914 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:50:12.111893 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cd820-2e38-4b6c-96c8-e8cdd75b6914 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:50:12.111893 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cd820-2e38-4b6c-96c8-e8cdd75b6914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:50:12.138715 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-7a7cd820-2e38-4b6c-96c8-e8cdd75b6914 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:50:12.140469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-7a7cd820-2e38-4b6c-96c8-e8cdd75b6914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:50:12.154154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 749/1494] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:50:12.164091 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f04ab-d080-44c5-b9c6-33cb0161ff35 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:50:12.164679 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f04ab-d080-44c5-b9c6-33cb0161ff35 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:50:12.164809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f04ab-d080-44c5-b9c6-33cb0161ff35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:50:12.184160 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-b94f04ab-d080-44c5-b9c6-33cb0161ff35 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:50:12.185394 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b94f04ab-d080-44c5-b9c6-33cb0161ff35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:50:12.193649 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 746/1495] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:50:12.201611 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7cd820-2e38-4b6c-96c8-e8cdd75b6914 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:50:12.219405 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7cd820-2e38-4b6c-96c8-e8cdd75b6914 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:50:12.226261 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a5db4-1904-4601-b34c-45686564c094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:50:12.226947 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a5db4-1904-4601-b34c-45686564c094 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:50:12.227235 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a5db4-1904-4601-b34c-45686564c094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:50:12.227514 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a5db4-1904-4601-b34c-45686564c094 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:50:12.228261 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a5db4-1904-4601-b34c-45686564c094 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:50:12.228574 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a5db4-1904-4601-b34c-45686564c094 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:50:12.229611 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: WARNING py.warnings [None req-d18a5db4-1904-4601-b34c-45686564c094 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 05:50:12.229611 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: warnings.warn(msg) Jun 21 05:50:12.229611 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: Jun 21 05:50:12.230574 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a5db4-1904-4601-b34c-45686564c094 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:50:12.246058 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 750/1496] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:50:12.254904 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f04ab-d080-44c5-b9c6-33cb0161ff35 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:50:12.279047 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f04ab-d080-44c5-b9c6-33cb0161ff35 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:50:12.284937 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091efd4-a79e-4e36-81ee-ced2c65898b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:50:12.285636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091efd4-a79e-4e36-81ee-ced2c65898b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:50:12.286047 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091efd4-a79e-4e36-81ee-ced2c65898b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:50:12.286351 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091efd4-a79e-4e36-81ee-ced2c65898b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:50:12.287108 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a091efd4-a79e-4e36-81ee-ced2c65898b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:50:12.289089 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: WARNING py.warnings [None req-a091efd4-a79e-4e36-81ee-ced2c65898b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 05:50:12.289089 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: warnings.warn(msg) Jun 21 05:50:12.289089 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: Jun 21 05:50:12.290395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a091efd4-a79e-4e36-81ee-ced2c65898b5 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:50:12.335562 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 747/1497] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:50:12 2022] POST /identity/v3/projects => generated 379 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:50:12.340296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a5db4-1904-4601-b34c-45686564c094 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:50:12.351537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a5db4-1904-4601-b34c-45686564c094 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:50:12.413713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5566b-2689-47ca-9f6e-c43127c80710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:50:12.414540 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5566b-2689-47ca-9f6e-c43127c80710 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:50:12.414874 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5566b-2689-47ca-9f6e-c43127c80710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:50:12.415291 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5566b-2689-47ca-9f6e-c43127c80710 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:50:12.416063 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5566b-2689-47ca-9f6e-c43127c80710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:50:12.417306 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: WARNING py.warnings [None req-f4f5566b-2689-47ca-9f6e-c43127c80710 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 05:50:12.417306 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: warnings.warn(msg) Jun 21 05:50:12.417306 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: Jun 21 05:50:12.418845 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5566b-2689-47ca-9f6e-c43127c80710 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:50:12.442251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 751/1498] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:50:12 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 05:50:12.445883 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091efd4-a79e-4e36-81ee-ced2c65898b5 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:50:12.457524 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091efd4-a79e-4e36-81ee-ced2c65898b5 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:50:12.462643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b282106-4ca7-42bc-8de7-2e0254e4656f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:50:12.463415 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b282106-4ca7-42bc-8de7-2e0254e4656f admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:50:12.463742 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b282106-4ca7-42bc-8de7-2e0254e4656f admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:50:12.464062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b282106-4ca7-42bc-8de7-2e0254e4656f admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:50:12.464850 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b282106-4ca7-42bc-8de7-2e0254e4656f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:50:12.466143 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: WARNING py.warnings [None req-5b282106-4ca7-42bc-8de7-2e0254e4656f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 05:50:12.466143 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: warnings.warn(msg) Jun 21 05:50:12.466143 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: Jun 21 05:50:12.467168 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b282106-4ca7-42bc-8de7-2e0254e4656f admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:50:12.483236 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 748/1499] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:50:12.487728 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5566b-2689-47ca-9f6e-c43127c80710 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:50:12.499498 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5566b-2689-47ca-9f6e-c43127c80710 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:50:12.504463 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0c1fe-7c2a-4a07-a91d-9fddec9d6944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:50:12.505158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0c1fe-7c2a-4a07-a91d-9fddec9d6944 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:50:12.505444 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0c1fe-7c2a-4a07-a91d-9fddec9d6944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:50:12.505726 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0c1fe-7c2a-4a07-a91d-9fddec9d6944 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:50:12.506503 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c0c1fe-7c2a-4a07-a91d-9fddec9d6944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:50:12.507553 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: WARNING py.warnings [None req-95c0c1fe-7c2a-4a07-a91d-9fddec9d6944 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 05:50:12.507553 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: warnings.warn(msg) Jun 21 05:50:12.507553 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: Jun 21 05:50:12.508470 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c0c1fe-7c2a-4a07-a91d-9fddec9d6944 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:50:12.524297 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 752/1500] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:50:12.528920 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b282106-4ca7-42bc-8de7-2e0254e4656f admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:50:12.540040 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b282106-4ca7-42bc-8de7-2e0254e4656f admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:50:12.546458 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30b99c-50a1-41be-be82-ba2bb68cff34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:50:12.547383 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30b99c-50a1-41be-be82-ba2bb68cff34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:50:12.547674 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30b99c-50a1-41be-be82-ba2bb68cff34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:50:12.547958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30b99c-50a1-41be-be82-ba2bb68cff34 admin admin] PATH_INFO: `/v3/projects/e57b7c570e894377a3b2140f7de1f882/users/c704ccd943d2470897ca291fe6f6818c/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:50:12.564863 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30b99c-50a1-41be-be82-ba2bb68cff34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e57b7c570e894377a3b2140f7de1f882, user_id=c704ccd943d2470897ca291fe6f6818c, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:50:12.566057 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: WARNING py.warnings [None req-6d30b99c-50a1-41be-be82-ba2bb68cff34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 05:50:12.566057 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: warnings.warn(msg) Jun 21 05:50:12.566057 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: Jun 21 05:50:12.568194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30b99c-50a1-41be-be82-ba2bb68cff34 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:50:12.589769 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 749/1501] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:50:12 2022] PUT /identity/v3/projects/e57b7c570e894377a3b2140f7de1f882/users/c704ccd943d2470897ca291fe6f6818c/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 05:50:12.603771 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89fc25-0eb0-4643-96a1-b13b8f5fc537 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:50:12.604308 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89fc25-0eb0-4643-96a1-b13b8f5fc537 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:50:12.604803 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89fc25-0eb0-4643-96a1-b13b8f5fc537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:50:12.646871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-db89fc25-0eb0-4643-96a1-b13b8f5fc537 None None] MFA Rules not processed for user `c704ccd943d2470897ca291fe6f6818c`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:50:12.648976 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-db89fc25-0eb0-4643-96a1-b13b8f5fc537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:50:12.754436 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 753/1502] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:50:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:50:12.772005 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae996faa-a98b-45e2-b538-8ef6fa13fbca None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:50:12.772370 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae996faa-a98b-45e2-b538-8ef6fa13fbca None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:50:12.772697 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae996faa-a98b-45e2-b538-8ef6fa13fbca None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:50:12.774516 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 750/1503] 10.222.0.18 () {54 vars in 963 bytes} [Tue Jun 21 05:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 05:50:12.779588 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf109f0b-03e5-4e24-906c-489ac5ae4ab4 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:50:12.779875 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf109f0b-03e5-4e24-906c-489ac5ae4ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:50:12.780155 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf109f0b-03e5-4e24-906c-489ac5ae4ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:50:12.799424 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-cf109f0b-03e5-4e24-906c-489ac5ae4ab4 None None] MFA Rules not processed for user `5c13a614e6b04b3a93247e3790f96240`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:50:12.800680 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-cf109f0b-03e5-4e24-906c-489ac5ae4ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:50:12.867826 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:50:12.878506 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 754/1504] 10.222.0.18 () {58 vars in 1060 bytes} [Tue Jun 21 05:50:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:50:12.886809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae996faa-a98b-45e2-b538-8ef6fa13fbca None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:50:12.898246 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae996faa-a98b-45e2-b538-8ef6fa13fbca None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:50:12.901908 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb65bf-ff13-42ef-b431-f08fc6e36069 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:50:12.902930 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb65bf-ff13-42ef-b431-f08fc6e36069 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:50:12.903266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb65bf-ff13-42ef-b431-f08fc6e36069 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:50:12.903583 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb65bf-ff13-42ef-b431-f08fc6e36069 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:50:12.912815 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb65bf-ff13-42ef-b431-f08fc6e36069 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:50:12.914304 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb65bf-ff13-42ef-b431-f08fc6e36069 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:50:12.924760 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 751/1505] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:50:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 05:50:12.979975 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42699a47-b1d8-4743-a885-d1db31642da7 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:50:12.980272 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42699a47-b1d8-4743-a885-d1db31642da7 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:50:12.980560 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42699a47-b1d8-4743-a885-d1db31642da7 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:50:12.981879 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 755/1506] 10.222.0.18 () {52 vars in 829 bytes} [Tue Jun 21 05:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 05:50:12.985925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb65bf-ff13-42ef-b431-f08fc6e36069 service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:50:13.054001 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb65bf-ff13-42ef-b431-f08fc6e36069 service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:50:13.058823 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ad409-ab8f-48cb-95da-f30534be5287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:50:13.059719 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ad409-ab8f-48cb-95da-f30534be5287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:50:13.060015 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ad409-ab8f-48cb-95da-f30534be5287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:50:13.060296 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ad409-ab8f-48cb-95da-f30534be5287 admin admin] PATH_INFO: `/v3/users/c704ccd943d2470897ca291fe6f6818c` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:50:13.061525 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ad409-ab8f-48cb-95da-f30534be5287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c704ccd943d2470897ca291fe6f6818c)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:50:13.062677 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: WARNING py.warnings [None req-951ad409-ab8f-48cb-95da-f30534be5287 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 05:50:13.062677 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: warnings.warn(msg) Jun 21 05:50:13.062677 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: Jun 21 05:50:13.063898 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ad409-ab8f-48cb-95da-f30534be5287 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:50:13.140156 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-951ad409-ab8f-48cb-95da-f30534be5287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c704ccd943d2470897ca291fe6f6818c'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:50:13.154558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-951ad409-ab8f-48cb-95da-f30534be5287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c704ccd943d2470897ca291fe6f6818c'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:50:13.155610 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-951ad409-ab8f-48cb-95da-f30534be5287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c704ccd943d2470897ca291fe6f6818c'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:50:13.167287 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-951ad409-ab8f-48cb-95da-f30534be5287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c704ccd943d2470897ca291fe6f6818c'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:50:13.188253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:50:13.192104 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-951ad409-ab8f-48cb-95da-f30534be5287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c704ccd943d2470897ca291fe6f6818c'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:50:13.201162 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 752/1507] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:50:12 2022] DELETE /identity/v3/users/c704ccd943d2470897ca291fe6f6818c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:50:13.206107 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebaa54-2e51-4d20-9e85-724dd8e84b11 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:50:13.206913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebaa54-2e51-4d20-9e85-724dd8e84b11 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:50:13.207105 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebaa54-2e51-4d20-9e85-724dd8e84b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:50:13.226276 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-a8ebaa54-2e51-4d20-9e85-724dd8e84b11 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:50:13.228156 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a8ebaa54-2e51-4d20-9e85-724dd8e84b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:50:13.293994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 756/1508] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:50:13.306294 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ad409-ab8f-48cb-95da-f30534be5287 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:50:13.307846 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-951ad409-ab8f-48cb-95da-f30534be5287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:50:13.373530 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ad409-ab8f-48cb-95da-f30534be5287 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:50:13.377831 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9d27b-0b5c-46b9-a2cc-f80f1dd96d48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:50:13.378563 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9d27b-0b5c-46b9-a2cc-f80f1dd96d48 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:50:13.378846 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9d27b-0b5c-46b9-a2cc-f80f1dd96d48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:50:13.379158 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9d27b-0b5c-46b9-a2cc-f80f1dd96d48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:50:13.389139 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9d27b-0b5c-46b9-a2cc-f80f1dd96d48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:50:13.390628 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9d27b-0b5c-46b9-a2cc-f80f1dd96d48 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:50:13.400956 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 753/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:50:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:50:13.811989 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebaa54-2e51-4d20-9e85-724dd8e84b11 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:50:13.813557 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a8ebaa54-2e51-4d20-9e85-724dd8e84b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:50:13.836732 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebaa54-2e51-4d20-9e85-724dd8e84b11 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:50:13.842980 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0dd861-753a-4984-b741-e2e0423c7962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:50:13.843778 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0dd861-753a-4984-b741-e2e0423c7962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:50:13.844230 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0dd861-753a-4984-b741-e2e0423c7962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:50:13.844512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0dd861-753a-4984-b741-e2e0423c7962 admin admin] PATH_INFO: `/v3/projects/e57b7c570e894377a3b2140f7de1f882` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:50:13.847260 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0dd861-753a-4984-b741-e2e0423c7962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e57b7c570e894377a3b2140f7de1f882)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:50:13.848299 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: WARNING py.warnings [None req-4f0dd861-753a-4984-b741-e2e0423c7962 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 05:50:13.848299 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: warnings.warn(msg) Jun 21 05:50:13.848299 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: Jun 21 05:50:13.849560 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0dd861-753a-4984-b741-e2e0423c7962 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:50:13.917019 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4f0dd861-753a-4984-b741-e2e0423c7962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e57b7c570e894377a3b2140f7de1f882', 'request_id': 'req-4f0dd861-753a-4984-b741-e2e0423c7962'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:50:13.928208 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4f0dd861-753a-4984-b741-e2e0423c7962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e57b7c570e894377a3b2140f7de1f882', 'request_id': 'req-4f0dd861-753a-4984-b741-e2e0423c7962'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:50:13.946684 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4f0dd861-753a-4984-b741-e2e0423c7962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e57b7c570e894377a3b2140f7de1f882', 'request_id': 'req-4f0dd861-753a-4984-b741-e2e0423c7962'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:50:13.958436 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4f0dd861-753a-4984-b741-e2e0423c7962 admin admin] The token cache is being invalidate because project e57b7c570e894377a3b2140f7de1f882 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:50:13.958725 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4f0dd861-753a-4984-b741-e2e0423c7962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:50:13.959492 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4f0dd861-753a-4984-b741-e2e0423c7962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:50:13.961058 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 757/1510] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:50:13 2022] DELETE /identity/v3/projects/e57b7c570e894377a3b2140f7de1f882 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:50:23.396378 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:50:23.955161 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:51:50.367201 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59954fcf-d48b-4620-aea3-13dbb50cc9bf None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:51:50.368063 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59954fcf-d48b-4620-aea3-13dbb50cc9bf None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:51:50.368063 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59954fcf-d48b-4620-aea3-13dbb50cc9bf None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:51:50.369535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 05:51:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:51:50.375395 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57401776-ab1f-42cd-a6e3-45b9ba46b41f None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:51:50.376021 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57401776-ab1f-42cd-a6e3-45b9ba46b41f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:51:50.376021 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57401776-ab1f-42cd-a6e3-45b9ba46b41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:51:50.396819 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-57401776-ab1f-42cd-a6e3-45b9ba46b41f None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:51:50.398137 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-57401776-ab1f-42cd-a6e3-45b9ba46b41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:51:50.462373 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 05:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:51:50.635896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59954fcf-d48b-4620-aea3-13dbb50cc9bf None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:51:50.637731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-59954fcf-d48b-4620-aea3-13dbb50cc9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:51:50.715827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59954fcf-d48b-4620-aea3-13dbb50cc9bf None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:51:50.721276 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf2b8a-5dbd-445e-af20-5e0a50803334 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:51:50.721955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf2b8a-5dbd-445e-af20-5e0a50803334 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:51:50.722244 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf2b8a-5dbd-445e-af20-5e0a50803334 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:51:50.722533 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf2b8a-5dbd-445e-af20-5e0a50803334 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:51:50.732151 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf2b8a-5dbd-445e-af20-5e0a50803334 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:51:50.733785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf2b8a-5dbd-445e-af20-5e0a50803334 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:51:50.745130 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 755/1513] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:51:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:51:51.598745 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482c5c0-3336-462c-bb39-22db315497f0 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:51:51.599601 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482c5c0-3336-462c-bb39-22db315497f0 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:51:51.599774 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482c5c0-3336-462c-bb39-22db315497f0 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:51:51.601513 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 05:51:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:51:51.606845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c7d64-7536-403a-826e-fc4a59c300ea None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:51:51.607299 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c7d64-7536-403a-826e-fc4a59c300ea None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:51:51.607409 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c7d64-7536-403a-826e-fc4a59c300ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:51:51.626317 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-1b3c7d64-7536-403a-826e-fc4a59c300ea None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:51:51.627538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1b3c7d64-7536-403a-826e-fc4a59c300ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:51:51.636165 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 05:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:51:51.789471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482c5c0-3336-462c-bb39-22db315497f0 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:51:51.804654 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482c5c0-3336-462c-bb39-22db315497f0 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:51:51.810448 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d3171-54f3-471a-913c-542b58062184 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:51:51.811102 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d3171-54f3-471a-913c-542b58062184 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:51:51.811388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d3171-54f3-471a-913c-542b58062184 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:51:51.811673 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d3171-54f3-471a-913c-542b58062184 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:51:51.821075 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d3171-54f3-471a-913c-542b58062184 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:51:51.822735 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d3171-54f3-471a-913c-542b58062184 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:51:51.833295 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 760/1516] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:51:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 05:51:52.471639 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b42dda-75e6-4f53-90be-8598a5aa918e None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:51:52.471840 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b42dda-75e6-4f53-90be-8598a5aa918e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:51:52.472109 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b42dda-75e6-4f53-90be-8598a5aa918e None None] PATH_INFO: `/v3` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:51:52.473513 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 757/1517] 10.222.0.23 () {54 vars in 925 bytes} [Tue Jun 21 05:51:52 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:51:52.480236 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b44cb-e43f-49c2-9688-964a76872553 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:51:52.480533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b44cb-e43f-49c2-9688-964a76872553 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:51:52.480822 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b44cb-e43f-49c2-9688-964a76872553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:51:52.499315 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-997b44cb-e43f-49c2-9688-964a76872553 None None] MFA Rules not processed for user `d17a40bea6ba41f19c88e16f9b15cf27`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:51:52.500582 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-997b44cb-e43f-49c2-9688-964a76872553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:51:52.568814 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 761/1518] 10.222.0.23 () {58 vars in 1015 bytes} [Tue Jun 21 05:51:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:51:56.388857 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf347a4-ac25-4942-a3a3-69664098f8d5 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:51:56.389394 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf347a4-ac25-4942-a3a3-69664098f8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:51:56.389394 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf347a4-ac25-4942-a3a3-69664098f8d5 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:51:56.390849 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 758/1519] 10.222.0.18 () {54 vars in 960 bytes} [Tue Jun 21 05:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:51:56.396343 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae7984-d010-4ee3-8d72-b0f1d8c20f87 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:51:56.396907 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae7984-d010-4ee3-8d72-b0f1d8c20f87 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:51:56.396907 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae7984-d010-4ee3-8d72-b0f1d8c20f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:51:56.415141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-36ae7984-d010-4ee3-8d72-b0f1d8c20f87 None None] MFA Rules not processed for user `d17a40bea6ba41f19c88e16f9b15cf27`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:51:56.416381 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-36ae7984-d010-4ee3-8d72-b0f1d8c20f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:51:56.425730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 762/1520] 10.222.0.18 () {58 vars in 1057 bytes} [Tue Jun 21 05:51:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:51:56.434263 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf347a4-ac25-4942-a3a3-69664098f8d5 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:51:56.448716 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf347a4-ac25-4942-a3a3-69664098f8d5 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:51:56.453628 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b03db-f1ac-4afb-8881-ff0c83e76bc1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17a40bea6ba41f19c88e16f9b15cf27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:51:56.454314 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b03db-f1ac-4afb-8881-ff0c83e76bc1 service placement] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:51:56.454598 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b03db-f1ac-4afb-8881-ff0c83e76bc1 service placement] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:51:56.454876 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b03db-f1ac-4afb-8881-ff0c83e76bc1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:51:56.464136 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b03db-f1ac-4afb-8881-ff0c83e76bc1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:51:56.465770 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b03db-f1ac-4afb-8881-ff0c83e76bc1 service placement] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:51:56.476406 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 759/1521] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:51:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:52:03.102781 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0146cd-dd4a-40cb-a0d5-5eb6bf3cf5c6 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:52:03.103415 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0146cd-dd4a-40cb-a0d5-5eb6bf3cf5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:52:03.103415 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0146cd-dd4a-40cb-a0d5-5eb6bf3cf5c6 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:52:03.104718 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 05:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 05:52:03.110161 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cc2a5-99b8-4350-96b5-92b7bc2a83d1 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:52:03.110939 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cc2a5-99b8-4350-96b5-92b7bc2a83d1 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:52:03.111115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cc2a5-99b8-4350-96b5-92b7bc2a83d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:52:03.129636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-b21cc2a5-99b8-4350-96b5-92b7bc2a83d1 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:52:03.130926 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b21cc2a5-99b8-4350-96b5-92b7bc2a83d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:52:03.138977 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 05:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:52:03.296785 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0146cd-dd4a-40cb-a0d5-5eb6bf3cf5c6 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:52:03.311800 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0146cd-dd4a-40cb-a0d5-5eb6bf3cf5c6 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:52:03.317545 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcbbb3-a481-44cf-a217-2fd249a3a02c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:52:03.318759 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcbbb3-a481-44cf-a217-2fd249a3a02c service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:52:03.319034 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcbbb3-a481-44cf-a217-2fd249a3a02c service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:52:03.319308 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcbbb3-a481-44cf-a217-2fd249a3a02c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:52:03.328457 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bcbbb3-a481-44cf-a217-2fd249a3a02c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:52:03.330090 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bcbbb3-a481-44cf-a217-2fd249a3a02c service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:52:03.340467 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 764/1524] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:52:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:52:04.183897 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409442c0-60d6-4d03-8d2e-7f1898a174ec None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:52:04.184606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409442c0-60d6-4d03-8d2e-7f1898a174ec None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:52:04.184606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409442c0-60d6-4d03-8d2e-7f1898a174ec None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:52:04.185818 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 05:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:52:04.191287 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67735b-b90f-4091-9dcb-2e316fa139dc None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:52:04.191776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67735b-b90f-4091-9dcb-2e316fa139dc None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:52:04.191883 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67735b-b90f-4091-9dcb-2e316fa139dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:52:04.219197 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-be67735b-b90f-4091-9dcb-2e316fa139dc None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:52:04.220412 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-be67735b-b90f-4091-9dcb-2e316fa139dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:52:04.229482 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 05:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:52:04.390997 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409442c0-60d6-4d03-8d2e-7f1898a174ec None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:52:04.406196 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409442c0-60d6-4d03-8d2e-7f1898a174ec None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:52:04.411758 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d477f-7fce-4897-8de1-5f741f36f3c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:52:04.412948 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d477f-7fce-4897-8de1-5f741f36f3c6 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:52:04.413232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d477f-7fce-4897-8de1-5f741f36f3c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:52:04.413509 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d477f-7fce-4897-8de1-5f741f36f3c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:52:04.422614 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d477f-7fce-4897-8de1-5f741f36f3c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:52:04.424231 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d477f-7fce-4897-8de1-5f741f36f3c6 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:52:04.434803 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 762/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:52:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:52:08.392029 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef645d56-9e3f-4e89-8a9d-166c2045a180 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:52:08.392675 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef645d56-9e3f-4e89-8a9d-166c2045a180 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:52:08.392675 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef645d56-9e3f-4e89-8a9d-166c2045a180 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:52:08.394050 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 05:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:52:08.399896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f8e3a-14b6-4ad9-a572-76c8535f70c0 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:52:08.400378 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f8e3a-14b6-4ad9-a572-76c8535f70c0 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:52:08.400487 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f8e3a-14b6-4ad9-a572-76c8535f70c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:52:08.425431 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-097f8e3a-14b6-4ad9-a572-76c8535f70c0 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:52:08.426725 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-097f8e3a-14b6-4ad9-a572-76c8535f70c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:52:08.436053 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 05:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:52:08.479106 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef645d56-9e3f-4e89-8a9d-166c2045a180 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:52:08.480902 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ef645d56-9e3f-4e89-8a9d-166c2045a180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:52:08.547810 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef645d56-9e3f-4e89-8a9d-166c2045a180 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:52:08.551491 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad61f0-f1da-4f23-a9fd-68c1045364f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:52:08.552197 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad61f0-f1da-4f23-a9fd-68c1045364f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:52:08.553012 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad61f0-f1da-4f23-a9fd-68c1045364f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:52:08.553291 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad61f0-f1da-4f23-a9fd-68c1045364f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:52:08.563216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad61f0-f1da-4f23-a9fd-68c1045364f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:52:08.564675 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad61f0-f1da-4f23-a9fd-68c1045364f1 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:52:08.570077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:52:08.575379 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 767/1530] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:52:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 05:52:10.619458 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5f0f8-d3ae-4cb7-b012-45eee9a8b426 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:52:10.620069 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5f0f8-d3ae-4cb7-b012-45eee9a8b426 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:52:10.620433 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5f0f8-d3ae-4cb7-b012-45eee9a8b426 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:52:10.622963 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 05:52:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:52:10.628187 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a47b19-ee48-4dc9-a5de-87926c29f635 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:52:10.628638 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a47b19-ee48-4dc9-a5de-87926c29f635 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:52:10.628754 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a47b19-ee48-4dc9-a5de-87926c29f635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:52:10.648070 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-05a47b19-ee48-4dc9-a5de-87926c29f635 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:52:10.649309 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-05a47b19-ee48-4dc9-a5de-87926c29f635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:52:10.657337 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 05:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:52:10.694269 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5f0f8-d3ae-4cb7-b012-45eee9a8b426 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:52:10.704900 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5f0f8-d3ae-4cb7-b012-45eee9a8b426 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:52:10.708447 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39519991-36b9-4136-8da8-ac39f6457e11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:52:10.709084 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39519991-36b9-4136-8da8-ac39f6457e11 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:52:10.709368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39519991-36b9-4136-8da8-ac39f6457e11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:52:10.709643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39519991-36b9-4136-8da8-ac39f6457e11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:52:10.718663 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39519991-36b9-4136-8da8-ac39f6457e11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:52:10.720106 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39519991-36b9-4136-8da8-ac39f6457e11 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:52:10.730099 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 765/1533] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:52:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:52:14.293289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5ab22-f087-4142-8ca4-3455d96b5010 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:52:14.293863 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5ab22-f087-4142-8ca4-3455d96b5010 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:52:14.293863 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5ab22-f087-4142-8ca4-3455d96b5010 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:52:14.295237 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 05:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:52:14.300404 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31e875-b912-4975-b976-8c875fb56b72 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:52:14.300848 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31e875-b912-4975-b976-8c875fb56b72 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:52:14.300982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31e875-b912-4975-b976-8c875fb56b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:52:14.308745 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=62 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:52:14.322213 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-ed31e875-b912-4975-b976-8c875fb56b72 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:52:14.323447 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ed31e875-b912-4975-b976-8c875fb56b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:52:14.331232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 05:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:52:14.637664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5ab22-f087-4142-8ca4-3455d96b5010 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:52:14.639422 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d1f5ab22-f087-4142-8ca4-3455d96b5010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:52:14.696150 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5ab22-f087-4142-8ca4-3455d96b5010 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:52:14.699710 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ea591-7d29-4b69-bab6-057ae9751ab0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:52:14.700350 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ea591-7d29-4b69-bab6-057ae9751ab0 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:52:14.700638 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ea591-7d29-4b69-bab6-057ae9751ab0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:52:14.700920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ea591-7d29-4b69-bab6-057ae9751ab0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:52:14.710086 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ea591-7d29-4b69-bab6-057ae9751ab0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:52:14.711567 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ea591-7d29-4b69-bab6-057ae9751ab0 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:52:14.721253 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 770/1536] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:52:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:52:16.795313 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985a334-8d76-4870-a3c9-868f7302c952 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:52:16.795979 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985a334-8d76-4870-a3c9-868f7302c952 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:52:16.795979 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985a334-8d76-4870-a3c9-868f7302c952 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:52:16.797282 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 05:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:52:16.803397 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a950a13-4e27-4f60-8267-9dfd6ae194bb None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:52:16.803986 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a950a13-4e27-4f60-8267-9dfd6ae194bb None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:52:16.803986 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a950a13-4e27-4f60-8267-9dfd6ae194bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:52:16.825283 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-2a950a13-4e27-4f60-8267-9dfd6ae194bb None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:52:16.826584 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-2a950a13-4e27-4f60-8267-9dfd6ae194bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:52:16.836150 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 05:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:52:17.148637 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985a334-8d76-4870-a3c9-868f7302c952 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:52:17.150324 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9985a334-8d76-4870-a3c9-868f7302c952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:52:17.163843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985a334-8d76-4870-a3c9-868f7302c952 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:52:17.167407 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade227d-d165-4b99-897e-44c991551af9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:52:17.168053 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade227d-d165-4b99-897e-44c991551af9 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:52:17.168339 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade227d-d165-4b99-897e-44c991551af9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:52:17.168618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade227d-d165-4b99-897e-44c991551af9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:52:17.178325 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade227d-d165-4b99-897e-44c991551af9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:52:17.179754 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade227d-d165-4b99-897e-44c991551af9 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:52:17.189248 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 768/1539] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:52:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:52:26.817751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=32 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:52:27.185002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=8 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:53:45.229282 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169808ce-db83-494f-9f0d-3e4f527a4797 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:45.230694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169808ce-db83-494f-9f0d-3e4f527a4797 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:45.231542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169808ce-db83-494f-9f0d-3e4f527a4797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:45.263957 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-169808ce-db83-494f-9f0d-3e4f527a4797 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:45.265234 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-169808ce-db83-494f-9f0d-3e4f527a4797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:45.278831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 772/1540] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:53:45.291091 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e7548-32a7-4be8-9af3-f69b8a12d156 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:45.292021 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e7548-32a7-4be8-9af3-f69b8a12d156 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:45.292021 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e7548-32a7-4be8-9af3-f69b8a12d156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:45.319167 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-538e7548-32a7-4be8-9af3-f69b8a12d156 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:45.320447 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-538e7548-32a7-4be8-9af3-f69b8a12d156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:45.336146 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 769/1541] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:45.341473 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169808ce-db83-494f-9f0d-3e4f527a4797 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:45.353840 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169808ce-db83-494f-9f0d-3e4f527a4797 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:45.363706 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00ee06-e2a3-4b43-bb56-a094083fd099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:45.364397 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00ee06-e2a3-4b43-bb56-a094083fd099 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:45.364679 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00ee06-e2a3-4b43-bb56-a094083fd099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:45.365092 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00ee06-e2a3-4b43-bb56-a094083fd099 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:45.366235 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00ee06-e2a3-4b43-bb56-a094083fd099 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:53:45.366564 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00ee06-e2a3-4b43-bb56-a094083fd099 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:45.368218 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00ee06-e2a3-4b43-bb56-a094083fd099 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:45.388840 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 773/1542] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:53:45.398413 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e7548-32a7-4be8-9af3-f69b8a12d156 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:45.411134 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e7548-32a7-4be8-9af3-f69b8a12d156 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:45.418748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be052f06-e05d-4b06-9755-713400a22114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:45.419442 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be052f06-e05d-4b06-9755-713400a22114 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:45.419729 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be052f06-e05d-4b06-9755-713400a22114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:45.420042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be052f06-e05d-4b06-9755-713400a22114 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:45.420731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be052f06-e05d-4b06-9755-713400a22114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:45.422885 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be052f06-e05d-4b06-9755-713400a22114 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:45.468435 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 770/1543] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:53:45 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:53:45.473209 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00ee06-e2a3-4b43-bb56-a094083fd099 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:45.485425 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00ee06-e2a3-4b43-bb56-a094083fd099 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:45.488562 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f4cdb-88f7-4e30-b00a-6371a9b7a857 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:45.488945 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f4cdb-88f7-4e30-b00a-6371a9b7a857 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:45.489131 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f4cdb-88f7-4e30-b00a-6371a9b7a857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:45.527800 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-831f4cdb-88f7-4e30-b00a-6371a9b7a857 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:45.529071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-831f4cdb-88f7-4e30-b00a-6371a9b7a857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:45.582771 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebecb3-e55d-475b-83c0-b5def848fb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:45.583479 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebecb3-e55d-475b-83c0-b5def848fb3b admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:45.583766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebecb3-e55d-475b-83c0-b5def848fb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:45.584042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebecb3-e55d-475b-83c0-b5def848fb3b admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:45.584775 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebecb3-e55d-475b-83c0-b5def848fb3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:45.589977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebecb3-e55d-475b-83c0-b5def848fb3b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:45.623013 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 774/1544] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:53:45 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:53:45.625711 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d91ed-4328-46fb-9238-47772d71faa0 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:45.626161 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d91ed-4328-46fb-9238-47772d71faa0 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:45.626745 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d91ed-4328-46fb-9238-47772d71faa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:45.659320 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-549d91ed-4328-46fb-9238-47772d71faa0 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:45.660477 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-549d91ed-4328-46fb-9238-47772d71faa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:45.681874 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 775/1545] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:45.684961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb88e5-304f-4d21-9148-1755f3837b31 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:45.685284 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb88e5-304f-4d21-9148-1755f3837b31 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:45.686973 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 771/1546] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:45.687792 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb88e5-304f-4d21-9148-1755f3837b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:45.690116 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff84bf-5715-4103-9598-f0c13f10fe0c None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:45.690452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff84bf-5715-4103-9598-f0c13f10fe0c None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:45.690744 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff84bf-5715-4103-9598-f0c13f10fe0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:45.713108 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-e4cb88e5-304f-4d21-9148-1755f3837b31 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:45.714800 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e4cb88e5-304f-4d21-9148-1755f3837b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:45.722849 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-3eff84bf-5715-4103-9598-f0c13f10fe0c None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:45.724085 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3eff84bf-5715-4103-9598-f0c13f10fe0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:45.725825 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 776/1547] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:45.727781 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb88e5-304f-4d21-9148-1755f3837b31 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:45.743778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 772/1548] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:45.744271 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb88e5-304f-4d21-9148-1755f3837b31 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:45.745091 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2e964-697f-446c-817e-4046df698f22 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:45.745376 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2e964-697f-446c-817e-4046df698f22 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:45.754810 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2e964-697f-446c-817e-4046df698f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:45.759609 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3878a-3267-44cb-baa2-16cf147beb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:45.760307 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3878a-3267-44cb-baa2-16cf147beb14 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:45.760595 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3878a-3267-44cb-baa2-16cf147beb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:45.761525 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3878a-3267-44cb-baa2-16cf147beb14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:45.762347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3878a-3267-44cb-baa2-16cf147beb14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:45.765247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3878a-3267-44cb-baa2-16cf147beb14 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:45.776852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-b8e2e964-697f-446c-817e-4046df698f22 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:45.778127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b8e2e964-697f-446c-817e-4046df698f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:45.779825 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 777/1549] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:53:45.782050 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc40a9-dc50-4e47-a9d4-838c20da8c7b None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:45.782606 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc40a9-dc50-4e47-a9d4-838c20da8c7b None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:45.783175 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc40a9-dc50-4e47-a9d4-838c20da8c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:45.787225 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 773/1550] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:45.788600 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075cdf5-a769-456e-9bac-8302a29bc508 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:45.788895 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075cdf5-a769-456e-9bac-8302a29bc508 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:45.789175 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075cdf5-a769-456e-9bac-8302a29bc508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:45.808621 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-6075cdf5-a769-456e-9bac-8302a29bc508 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:45.809879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6075cdf5-a769-456e-9bac-8302a29bc508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:45.812001 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-1dbc40a9-dc50-4e47-a9d4-838c20da8c7b None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:45.814567 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1dbc40a9-dc50-4e47-a9d4-838c20da8c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:45.819268 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 774/1551] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:45.820569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b191ce1-7c63-4473-bfe9-ebdf693f459b None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:45.820859 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b191ce1-7c63-4473-bfe9-ebdf693f459b None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:45.821137 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b191ce1-7c63-4473-bfe9-ebdf693f459b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:45.831900 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 778/1552] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:45.831900 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b69209-e89d-465c-ad48-4e6035874c26 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:45.831900 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b69209-e89d-465c-ad48-4e6035874c26 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:45.832298 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b69209-e89d-465c-ad48-4e6035874c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:45.841338 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-3b191ce1-7c63-4473-bfe9-ebdf693f459b None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:45.842629 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3b191ce1-7c63-4473-bfe9-ebdf693f459b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:45.851940 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 775/1553] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:45.855724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a949327-653f-417c-9caa-a3315fa661b8 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:45.856087 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a949327-653f-417c-9caa-a3315fa661b8 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:45.856473 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a949327-653f-417c-9caa-a3315fa661b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:45.862473 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-70b69209-e89d-465c-ad48-4e6035874c26 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:45.864461 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-70b69209-e89d-465c-ad48-4e6035874c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:45.875786 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-3a949327-653f-417c-9caa-a3315fa661b8 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:45.876111 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 779/1554] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:45.877536 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3a949327-653f-417c-9caa-a3315fa661b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:45.877779 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b69209-e89d-465c-ad48-4e6035874c26 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:45.888552 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b69209-e89d-465c-ad48-4e6035874c26 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:45.893826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 776/1555] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:45.893826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd9234-98cd-4f22-a964-e9a25b1fc8de None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:45.893826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd9234-98cd-4f22-a964-e9a25b1fc8de None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:45.894349 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd9234-98cd-4f22-a964-e9a25b1fc8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:45.899157 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7497d35-e822-493f-9157-3e12adea4c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:45.900295 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7497d35-e822-493f-9157-3e12adea4c09 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:45.900965 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7497d35-e822-493f-9157-3e12adea4c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:45.901470 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7497d35-e822-493f-9157-3e12adea4c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:45.903821 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7497d35-e822-493f-9157-3e12adea4c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:45.906058 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7497d35-e822-493f-9157-3e12adea4c09 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:45.915073 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-fbcd9234-98cd-4f22-a964-e9a25b1fc8de None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:45.916360 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-fbcd9234-98cd-4f22-a964-e9a25b1fc8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:45.924410 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 777/1556] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:45.925224 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd9234-98cd-4f22-a964-e9a25b1fc8de None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:45.928210 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 780/1557] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:53:45.928210 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7497d35-e822-493f-9157-3e12adea4c09 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:45.935439 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd9234-98cd-4f22-a964-e9a25b1fc8de None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:45.941494 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718aa8b-2de0-4b58-974d-98815769a5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:45.942206 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718aa8b-2de0-4b58-974d-98815769a5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:45.942486 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718aa8b-2de0-4b58-974d-98815769a5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:45.942763 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718aa8b-2de0-4b58-974d-98815769a5e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:45.943498 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718aa8b-2de0-4b58-974d-98815769a5e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:53:45.943802 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718aa8b-2de0-4b58-974d-98815769a5e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:45.944779 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7497d35-e822-493f-9157-3e12adea4c09 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:45.944978 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: WARNING py.warnings [None req-1718aa8b-2de0-4b58-974d-98815769a5e6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 05:53:45.944978 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: warnings.warn(msg) Jun 21 05:53:45.944978 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: Jun 21 05:53:45.945717 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718aa8b-2de0-4b58-974d-98815769a5e6 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:45.950946 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ca7e8-288f-4659-bb30-b9066e0db813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:45.951837 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ca7e8-288f-4659-bb30-b9066e0db813 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:45.952235 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ca7e8-288f-4659-bb30-b9066e0db813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:45.952633 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ca7e8-288f-4659-bb30-b9066e0db813 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:45.953537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ca7e8-288f-4659-bb30-b9066e0db813 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:53:45.954004 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ca7e8-288f-4659-bb30-b9066e0db813 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:45.956661 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ca7e8-288f-4659-bb30-b9066e0db813 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:45.959313 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 778/1558] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:53:45.960627 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b4858-ba84-4981-a860-9e991af07c63 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:45.960918 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b4858-ba84-4981-a860-9e991af07c63 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:45.961193 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b4858-ba84-4981-a860-9e991af07c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:45.991434 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 781/1559] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:53:45.991731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-2d9b4858-ba84-4981-a860-9e991af07c63 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:45.991943 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ca7e8-288f-4659-bb30-b9066e0db813 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:45.992109 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-2d9b4858-ba84-4981-a860-9e991af07c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:45.999218 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ca7e8-288f-4659-bb30-b9066e0db813 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:46.000810 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 779/1560] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:46.003937 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90737f1-dfd8-4c7f-b7bd-02802e0d1548 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:46.004449 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90737f1-dfd8-4c7f-b7bd-02802e0d1548 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:46.005262 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90737f1-dfd8-4c7f-b7bd-02802e0d1548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:46.006525 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf31342-1cbf-458e-84a7-2c94c3708336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:46.007582 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf31342-1cbf-458e-84a7-2c94c3708336 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:46.007967 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf31342-1cbf-458e-84a7-2c94c3708336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:46.008376 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf31342-1cbf-458e-84a7-2c94c3708336 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:46.009292 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf31342-1cbf-458e-84a7-2c94c3708336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:53:46.009754 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf31342-1cbf-458e-84a7-2c94c3708336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:46.011823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf31342-1cbf-458e-84a7-2c94c3708336 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:46.026992 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 782/1561] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:53:46.028213 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf31342-1cbf-458e-84a7-2c94c3708336 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:46.037291 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-b90737f1-dfd8-4c7f-b7bd-02802e0d1548 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:46.039453 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b90737f1-dfd8-4c7f-b7bd-02802e0d1548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:46.041113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf31342-1cbf-458e-84a7-2c94c3708336 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:46.045709 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be4509-acc8-491b-860e-c32db35647fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:46.046410 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be4509-acc8-491b-860e-c32db35647fc admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:46.046705 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be4509-acc8-491b-860e-c32db35647fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:46.046974 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be4509-acc8-491b-860e-c32db35647fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:46.047703 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be4509-acc8-491b-860e-c32db35647fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:53:46.048009 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be4509-acc8-491b-860e-c32db35647fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:46.049646 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be4509-acc8-491b-860e-c32db35647fc admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:46.053087 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 780/1562] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:46.054646 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90737f1-dfd8-4c7f-b7bd-02802e0d1548 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:46.075425 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 783/1563] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:53:46.075425 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113b705-85a6-4bbc-8673-dcffab48747e None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:46.075425 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113b705-85a6-4bbc-8673-dcffab48747e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:46.075425 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113b705-85a6-4bbc-8673-dcffab48747e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:46.076051 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90737f1-dfd8-4c7f-b7bd-02802e0d1548 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:46.082101 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ad057-3f1f-497a-8ead-efa03dfc9a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:46.083260 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ad057-3f1f-497a-8ead-efa03dfc9a51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:46.083553 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ad057-3f1f-497a-8ead-efa03dfc9a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:46.083834 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ad057-3f1f-497a-8ead-efa03dfc9a51 admin admin] PATH_INFO: `/v3/projects/687fb9e9d7b64ce8b18b417ab2089bd4/users/d1df1aba890145ff8f974715e37781e9/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:46.091722 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-1113b705-85a6-4bbc-8673-dcffab48747e None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:46.093712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1113b705-85a6-4bbc-8673-dcffab48747e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:46.103589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ad057-3f1f-497a-8ead-efa03dfc9a51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=687fb9e9d7b64ce8b18b417ab2089bd4, user_id=d1df1aba890145ff8f974715e37781e9, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:46.106869 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ad057-3f1f-497a-8ead-efa03dfc9a51 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:46.108639 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 784/1564] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:46.110304 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113b705-85a6-4bbc-8673-dcffab48747e None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:46.127731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 781/1565] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:53:46 2022] PUT /identity/v3/projects/687fb9e9d7b64ce8b18b417ab2089bd4/users/d1df1aba890145ff8f974715e37781e9/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:53:46.128753 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113b705-85a6-4bbc-8673-dcffab48747e None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:46.129119 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ad057-3f1f-497a-8ead-efa03dfc9a51 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:46.172371 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:53:46.197367 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:53:46.207740 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7996fc-2f39-4b13-9bed-1b130875c1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:46.208818 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7996fc-2f39-4b13-9bed-1b130875c1b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:46.209344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7996fc-2f39-4b13-9bed-1b130875c1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:46.209683 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7996fc-2f39-4b13-9bed-1b130875c1b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:46.210859 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7996fc-2f39-4b13-9bed-1b130875c1b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:46.212008 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: WARNING py.warnings [None req-fb7996fc-2f39-4b13-9bed-1b130875c1b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 05:53:46.212008 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: warnings.warn(msg) Jun 21 05:53:46.212008 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: Jun 21 05:53:46.213382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7996fc-2f39-4b13-9bed-1b130875c1b2 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:46.221962 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ad057-3f1f-497a-8ead-efa03dfc9a51 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:46.227140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d97347-a9e5-45e5-890c-b779c95eb58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:46.227818 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d97347-a9e5-45e5-890c-b779c95eb58a admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:46.228101 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d97347-a9e5-45e5-890c-b779c95eb58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:46.228411 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d97347-a9e5-45e5-890c-b779c95eb58a admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:46.229115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d97347-a9e5-45e5-890c-b779c95eb58a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:46.231079 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d97347-a9e5-45e5-890c-b779c95eb58a admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:46.252248 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 785/1566] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:53:46 2022] POST /identity/v3/projects => generated 389 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:53:46.252248 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7996fc-2f39-4b13-9bed-1b130875c1b2 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:46.263405 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 782/1567] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:53:46 2022] POST /identity/v3/projects => generated 363 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:53:46.264052 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d97347-a9e5-45e5-890c-b779c95eb58a admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:46.337816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7996fc-2f39-4b13-9bed-1b130875c1b2 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:46.362816 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d97347-a9e5-45e5-890c-b779c95eb58a admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:46.367571 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b3e41-83ff-4bfa-a8ce-cabdfb02d09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:46.368250 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b3e41-83ff-4bfa-a8ce-cabdfb02d09b admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:46.368536 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b3e41-83ff-4bfa-a8ce-cabdfb02d09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:46.368817 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b3e41-83ff-4bfa-a8ce-cabdfb02d09b admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:46.369523 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b3e41-83ff-4bfa-a8ce-cabdfb02d09b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:46.371481 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b3e41-83ff-4bfa-a8ce-cabdfb02d09b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:46.405347 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 783/1568] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:53:46 2022] POST /identity/v3/projects => generated 393 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:53:46.406756 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b3e41-83ff-4bfa-a8ce-cabdfb02d09b admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:46.424487 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71fb71a-5817-4fd8-83af-e613d96deafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:46.425077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fb71a-5817-4fd8-83af-e613d96deafa admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:46.425364 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fb71a-5817-4fd8-83af-e613d96deafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:46.425645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fb71a-5817-4fd8-83af-e613d96deafa admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:46.426417 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71fb71a-5817-4fd8-83af-e613d96deafa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:53:46.426738 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71fb71a-5817-4fd8-83af-e613d96deafa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:46.428404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71fb71a-5817-4fd8-83af-e613d96deafa admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:46.441627 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 786/1569] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:53:46.442494 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71fb71a-5817-4fd8-83af-e613d96deafa admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:46.452775 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71fb71a-5817-4fd8-83af-e613d96deafa admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:46.514060 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b3e41-83ff-4bfa-a8ce-cabdfb02d09b admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:46.520113 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f357c-7223-43ed-a1bb-edb589336f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:46.520982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f357c-7223-43ed-a1bb-edb589336f89 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:46.521395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f357c-7223-43ed-a1bb-edb589336f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:46.521847 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f357c-7223-43ed-a1bb-edb589336f89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:46.522801 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f357c-7223-43ed-a1bb-edb589336f89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:53:46.523313 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f357c-7223-43ed-a1bb-edb589336f89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:46.525240 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f357c-7223-43ed-a1bb-edb589336f89 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:46.529594 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235af5b-2a64-4c53-a0ba-9eb7a971dedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:46.530460 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235af5b-2a64-4c53-a0ba-9eb7a971dedb admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:46.530846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235af5b-2a64-4c53-a0ba-9eb7a971dedb admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:46.531214 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235af5b-2a64-4c53-a0ba-9eb7a971dedb admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:46.532089 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235af5b-2a64-4c53-a0ba-9eb7a971dedb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:46.535440 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235af5b-2a64-4c53-a0ba-9eb7a971dedb admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:46.542000 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 784/1570] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:53:46.542302 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:53:46.542570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f357c-7223-43ed-a1bb-edb589336f89 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:46.557977 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f357c-7223-43ed-a1bb-edb589336f89 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:46.564157 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f962f44-1a5d-45a6-9edf-09f6dfc279f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:46.565097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f962f44-1a5d-45a6-9edf-09f6dfc279f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:46.565519 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f962f44-1a5d-45a6-9edf-09f6dfc279f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:46.566138 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f962f44-1a5d-45a6-9edf-09f6dfc279f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:46.567108 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f962f44-1a5d-45a6-9edf-09f6dfc279f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:53:46.567610 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f962f44-1a5d-45a6-9edf-09f6dfc279f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:46.569670 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f962f44-1a5d-45a6-9edf-09f6dfc279f9 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:46.581190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 787/1571] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:53:46 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:53:46.581190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f79f96-6399-4def-9664-86f0c84fc22d None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:46.581190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f79f96-6399-4def-9664-86f0c84fc22d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:46.581190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f79f96-6399-4def-9664-86f0c84fc22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:46.588267 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 785/1572] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:53:46.589281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f962f44-1a5d-45a6-9edf-09f6dfc279f9 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:46.602115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f962f44-1a5d-45a6-9edf-09f6dfc279f9 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:46.625329 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-63f79f96-6399-4def-9664-86f0c84fc22d None None] MFA Rules not processed for user `d1df1aba890145ff8f974715e37781e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:46.627375 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-63f79f96-6399-4def-9664-86f0c84fc22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:46.649613 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:53:46.688116 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd6d41-e84b-4ed0-b15e-d14519ef2c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:46.689417 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd6d41-e84b-4ed0-b15e-d14519ef2c0a admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:46.689597 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd6d41-e84b-4ed0-b15e-d14519ef2c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:46.690052 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd6d41-e84b-4ed0-b15e-d14519ef2c0a admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:46.691216 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd6d41-e84b-4ed0-b15e-d14519ef2c0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:46.692989 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: WARNING py.warnings [None req-2ecd6d41-e84b-4ed0-b15e-d14519ef2c0a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 05:53:46.692989 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: warnings.warn(msg) Jun 21 05:53:46.692989 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: Jun 21 05:53:46.695356 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd6d41-e84b-4ed0-b15e-d14519ef2c0a admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:46.723063 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 788/1573] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:53:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:46.724074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f79f96-6399-4def-9664-86f0c84fc22d None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:46.733110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 786/1574] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:53:46 2022] POST /identity/v3/users => generated 295 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:53:46.734314 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd6d41-e84b-4ed0-b15e-d14519ef2c0a admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:46.737094 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f79f96-6399-4def-9664-86f0c84fc22d None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:46.741741 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb543e31-c0ca-4295-a00e-7fb1a45a44f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:46.742446 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb543e31-c0ca-4295-a00e-7fb1a45a44f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:46.742733 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb543e31-c0ca-4295-a00e-7fb1a45a44f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:46.743011 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb543e31-c0ca-4295-a00e-7fb1a45a44f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:46.743707 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb543e31-c0ca-4295-a00e-7fb1a45a44f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:46.745646 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb543e31-c0ca-4295-a00e-7fb1a45a44f0 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:46.757667 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd6d41-e84b-4ed0-b15e-d14519ef2c0a admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:46.766696 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de543886-d4a6-496a-89f1-a5520f2c1e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:46.768218 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 789/1575] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:53:46 2022] POST /identity/v3/users => generated 282 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:53:46.768521 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de543886-d4a6-496a-89f1-a5520f2c1e39 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:46.768977 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de543886-d4a6-496a-89f1-a5520f2c1e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:46.769442 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de543886-d4a6-496a-89f1-a5520f2c1e39 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:46.770700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de543886-d4a6-496a-89f1-a5520f2c1e39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:46.771360 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb543e31-c0ca-4295-a00e-7fb1a45a44f0 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:46.774227 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de543886-d4a6-496a-89f1-a5520f2c1e39 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:46.782918 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb543e31-c0ca-4295-a00e-7fb1a45a44f0 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:46.790597 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a31e9-222b-4e9b-834b-34376b63213c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:46.791802 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a31e9-222b-4e9b-834b-34376b63213c admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:46.792191 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a31e9-222b-4e9b-834b-34376b63213c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:46.792621 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a31e9-222b-4e9b-834b-34376b63213c admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:46.793601 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a31e9-222b-4e9b-834b-34376b63213c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:46.797273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a31e9-222b-4e9b-834b-34376b63213c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:46.807871 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 787/1576] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:53:46 2022] POST /identity/v3/users => generated 297 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:53:46.809138 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de543886-d4a6-496a-89f1-a5520f2c1e39 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:46.825037 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de543886-d4a6-496a-89f1-a5520f2c1e39 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:46.832606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a2fdb-cb78-4ba4-be9f-70a2169c93d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:46.833654 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a2fdb-cb78-4ba4-be9f-70a2169c93d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:46.834157 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a2fdb-cb78-4ba4-be9f-70a2169c93d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:46.834608 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a2fdb-cb78-4ba4-be9f-70a2169c93d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:46.835757 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a2fdb-cb78-4ba4-be9f-70a2169c93d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:46.839306 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a2fdb-cb78-4ba4-be9f-70a2169c93d1 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:46.845574 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 790/1577] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:53:46 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:53:46.845574 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a31e9-222b-4e9b-834b-34376b63213c admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:46.879498 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 788/1578] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:53:46 2022] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:53:46.880999 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a2fdb-cb78-4ba4-be9f-70a2169c93d1 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:46.932373 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a31e9-222b-4e9b-834b-34376b63213c admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:46.960826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a2fdb-cb78-4ba4-be9f-70a2169c93d1 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:46.968196 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875e6dd-f131-4876-b01e-5d8b31b278d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:46.969046 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875e6dd-f131-4876-b01e-5d8b31b278d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:46.969388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875e6dd-f131-4876-b01e-5d8b31b278d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:46.969815 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875e6dd-f131-4876-b01e-5d8b31b278d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:46.970845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875e6dd-f131-4876-b01e-5d8b31b278d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:46.973094 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875e6dd-f131-4876-b01e-5d8b31b278d8 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:46.983317 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:53:47.005496 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028706b-1a05-494c-b182-a4ec84f1e307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:47.006334 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028706b-1a05-494c-b182-a4ec84f1e307 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:47.006735 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028706b-1a05-494c-b182-a4ec84f1e307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:47.007114 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028706b-1a05-494c-b182-a4ec84f1e307 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:47.007949 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028706b-1a05-494c-b182-a4ec84f1e307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:47.008147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 789/1579] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:53:46 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:53:47.009162 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875e6dd-f131-4876-b01e-5d8b31b278d8 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:47.012007 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028706b-1a05-494c-b182-a4ec84f1e307 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:47.041439 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 791/1580] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:53:46 2022] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:53:47.041439 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028706b-1a05-494c-b182-a4ec84f1e307 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:47.056437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028706b-1a05-494c-b182-a4ec84f1e307 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:47.091159 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875e6dd-f131-4876-b01e-5d8b31b278d8 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:47.096604 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e09c3-0730-4045-9e96-d9d6a0b41e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:47.097588 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e09c3-0730-4045-9e96-d9d6a0b41e94 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:47.098078 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e09c3-0730-4045-9e96-d9d6a0b41e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:47.098523 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e09c3-0730-4045-9e96-d9d6a0b41e94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:47.099611 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e09c3-0730-4045-9e96-d9d6a0b41e94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:47.102791 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e09c3-0730-4045-9e96-d9d6a0b41e94 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:47.122756 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:53:47.140717 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 790/1581] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:53:47 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:53:47.141824 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e09c3-0730-4045-9e96-d9d6a0b41e94 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:47.146247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9727e05-4114-49b4-a6a1-a85c3747c832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:47.147449 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9727e05-4114-49b4-a6a1-a85c3747c832 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:47.147899 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9727e05-4114-49b4-a6a1-a85c3747c832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:47.148341 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9727e05-4114-49b4-a6a1-a85c3747c832 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:47.149429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9727e05-4114-49b4-a6a1-a85c3747c832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:47.152243 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9727e05-4114-49b4-a6a1-a85c3747c832 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:47.169752 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 792/1582] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:53:47.171406 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9727e05-4114-49b4-a6a1-a85c3747c832 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:47.188108 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9727e05-4114-49b4-a6a1-a85c3747c832 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:47.217248 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e09c3-0730-4045-9e96-d9d6a0b41e94 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:47.225603 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361db8ff-cf31-45a2-9394-6a3dd17e055d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:47.226797 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361db8ff-cf31-45a2-9394-6a3dd17e055d admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:47.227307 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361db8ff-cf31-45a2-9394-6a3dd17e055d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:47.227769 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361db8ff-cf31-45a2-9394-6a3dd17e055d admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:47.229125 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361db8ff-cf31-45a2-9394-6a3dd17e055d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:47.232319 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361db8ff-cf31-45a2-9394-6a3dd17e055d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:47.256825 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 791/1583] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:53:47.256825 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361db8ff-cf31-45a2-9394-6a3dd17e055d admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:47.266816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208510fb-15e2-464f-97fe-46ad8a68b712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:47.267815 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208510fb-15e2-464f-97fe-46ad8a68b712 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:47.268995 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208510fb-15e2-464f-97fe-46ad8a68b712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:47.268995 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208510fb-15e2-464f-97fe-46ad8a68b712 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:47.269434 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208510fb-15e2-464f-97fe-46ad8a68b712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:47.271667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208510fb-15e2-464f-97fe-46ad8a68b712 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:47.275933 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361db8ff-cf31-45a2-9394-6a3dd17e055d admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:47.285514 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edda62d-78e6-420b-b832-3fd0b1dadb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:47.286737 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edda62d-78e6-420b-b832-3fd0b1dadb7d admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:47.287464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edda62d-78e6-420b-b832-3fd0b1dadb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:47.288848 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edda62d-78e6-420b-b832-3fd0b1dadb7d admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:47.289011 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 793/1584] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:53:47.289645 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edda62d-78e6-420b-b832-3fd0b1dadb7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:47.290473 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208510fb-15e2-464f-97fe-46ad8a68b712 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:47.293434 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edda62d-78e6-420b-b832-3fd0b1dadb7d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:47.307828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208510fb-15e2-464f-97fe-46ad8a68b712 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:47.313876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc3170-ba69-4dc6-8921-c31453a7ee93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:47.315068 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc3170-ba69-4dc6-8921-c31453a7ee93 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:47.315514 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc3170-ba69-4dc6-8921-c31453a7ee93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:47.315940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc3170-ba69-4dc6-8921-c31453a7ee93 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:47.317069 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc3170-ba69-4dc6-8921-c31453a7ee93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:47.320555 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc3170-ba69-4dc6-8921-c31453a7ee93 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:47.322560 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 792/1585] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:53:47 2022] POST /identity/v3/users => generated 293 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:53:47.323406 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edda62d-78e6-420b-b832-3fd0b1dadb7d admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:47.336487 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edda62d-78e6-420b-b832-3fd0b1dadb7d admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:47.343552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad191988-96e7-4f7d-990c-8bed4bb7e545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:47.344653 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad191988-96e7-4f7d-990c-8bed4bb7e545 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:47.345523 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad191988-96e7-4f7d-990c-8bed4bb7e545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:47.345958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad191988-96e7-4f7d-990c-8bed4bb7e545 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:47.346412 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 794/1586] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:53:47 2022] POST /identity/v3/users => generated 289 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:53:47.347008 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad191988-96e7-4f7d-990c-8bed4bb7e545 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:47.347329 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc3170-ba69-4dc6-8921-c31453a7ee93 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:47.350155 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad191988-96e7-4f7d-990c-8bed4bb7e545 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:47.359680 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc3170-ba69-4dc6-8921-c31453a7ee93 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:47.366553 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0103a-a98a-495d-8589-1bdbdf2401b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:47.367406 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0103a-a98a-495d-8589-1bdbdf2401b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:47.367698 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0103a-a98a-495d-8589-1bdbdf2401b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:47.368135 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0103a-a98a-495d-8589-1bdbdf2401b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:47.369075 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a0103a-a98a-495d-8589-1bdbdf2401b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:47.370949 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a0103a-a98a-495d-8589-1bdbdf2401b5 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:47.382609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 793/1587] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:53:47 2022] POST /identity/v3/users => generated 289 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:53:47.382609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad191988-96e7-4f7d-990c-8bed4bb7e545 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:47.384145 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 795/1588] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:53:47.388458 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0103a-a98a-495d-8589-1bdbdf2401b5 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:47.396272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad191988-96e7-4f7d-990c-8bed4bb7e545 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:47.397118 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0103a-a98a-495d-8589-1bdbdf2401b5 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:47.402140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdd815-4dad-418d-a596-111e50186276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:47.402837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdd815-4dad-418d-a596-111e50186276 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:47.403124 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdd815-4dad-418d-a596-111e50186276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:47.403320 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6c87f-cbb3-4a46-8b5f-f2a0943afdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:47.403461 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdd815-4dad-418d-a596-111e50186276 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:47.404114 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cdd815-4dad-418d-a596-111e50186276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:47.404299 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6c87f-cbb3-4a46-8b5f-f2a0943afdef admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:47.404485 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6c87f-cbb3-4a46-8b5f-f2a0943afdef admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:47.404855 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6c87f-cbb3-4a46-8b5f-f2a0943afdef admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:47.405725 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6c87f-cbb3-4a46-8b5f-f2a0943afdef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:47.406119 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cdd815-4dad-418d-a596-111e50186276 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:47.408452 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6c87f-cbb3-4a46-8b5f-f2a0943afdef admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:47.424984 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 796/1589] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:53:47.426262 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6c87f-cbb3-4a46-8b5f-f2a0943afdef admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:47.438161 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 794/1590] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:53:47 2022] POST /identity/v3/users => generated 293 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:53:47.438161 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdd815-4dad-418d-a596-111e50186276 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:47.439095 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6c87f-cbb3-4a46-8b5f-f2a0943afdef admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:47.445449 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc14cb-bb0e-4913-b856-9ca88226a0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:47.446378 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdd815-4dad-418d-a596-111e50186276 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:47.446681 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc14cb-bb0e-4913-b856-9ca88226a0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:47.447195 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc14cb-bb0e-4913-b856-9ca88226a0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:47.447703 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc14cb-bb0e-4913-b856-9ca88226a0f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:47.449113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc14cb-bb0e-4913-b856-9ca88226a0f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:47.451258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776db48c-54b3-4e8d-9d0e-20e0c5806808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:47.451967 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776db48c-54b3-4e8d-9d0e-20e0c5806808 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:47.452287 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776db48c-54b3-4e8d-9d0e-20e0c5806808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:47.452536 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776db48c-54b3-4e8d-9d0e-20e0c5806808 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:47.453278 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776db48c-54b3-4e8d-9d0e-20e0c5806808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:47.453446 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc14cb-bb0e-4913-b856-9ca88226a0f0 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:47.455118 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776db48c-54b3-4e8d-9d0e-20e0c5806808 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:47.466736 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 795/1591] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:53:47.467701 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776db48c-54b3-4e8d-9d0e-20e0c5806808 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:47.476341 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 797/1592] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:53:47.477825 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc14cb-bb0e-4913-b856-9ca88226a0f0 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:47.482195 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776db48c-54b3-4e8d-9d0e-20e0c5806808 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:47.488002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce825aa2-a827-4078-904a-536601aefc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:47.488695 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce825aa2-a827-4078-904a-536601aefc43 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:47.488979 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce825aa2-a827-4078-904a-536601aefc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:47.489257 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce825aa2-a827-4078-904a-536601aefc43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:47.490027 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce825aa2-a827-4078-904a-536601aefc43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:47.491664 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce825aa2-a827-4078-904a-536601aefc43 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:47.496918 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc14cb-bb0e-4913-b856-9ca88226a0f0 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:47.502594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 796/1593] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:53:47.506442 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce825aa2-a827-4078-904a-536601aefc43 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:47.506963 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914ee13-5067-4745-8f0d-b71d4e4578d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:47.508137 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914ee13-5067-4745-8f0d-b71d4e4578d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:47.508656 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914ee13-5067-4745-8f0d-b71d4e4578d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:47.509166 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914ee13-5067-4745-8f0d-b71d4e4578d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:47.510794 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914ee13-5067-4745-8f0d-b71d4e4578d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:47.514448 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914ee13-5067-4745-8f0d-b71d4e4578d3 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:47.516930 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce825aa2-a827-4078-904a-536601aefc43 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:47.521804 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a71b7b-2e96-43a3-a3bb-f5e38eb16e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:47.522510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a71b7b-2e96-43a3-a3bb-f5e38eb16e61 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:47.522802 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a71b7b-2e96-43a3-a3bb-f5e38eb16e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:47.523083 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a71b7b-2e96-43a3-a3bb-f5e38eb16e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:47.523824 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a71b7b-2e96-43a3-a3bb-f5e38eb16e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:47.525560 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a71b7b-2e96-43a3-a3bb-f5e38eb16e61 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:47.536355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 798/1594] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:53:47.538348 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 797/1595] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:53:47.539192 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914ee13-5067-4745-8f0d-b71d4e4578d3 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:47.539421 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a71b7b-2e96-43a3-a3bb-f5e38eb16e61 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:47.550957 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:53:47.556679 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914ee13-5067-4745-8f0d-b71d4e4578d3 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:47.557147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a71b7b-2e96-43a3-a3bb-f5e38eb16e61 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:47.564139 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482e7cd-c0b4-4c8e-814d-3750a2ff8f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:47.564959 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482e7cd-c0b4-4c8e-814d-3750a2ff8f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:47.565152 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec72533-43e0-4461-8732-eb5d7d7ca836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:47.565702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482e7cd-c0b4-4c8e-814d-3750a2ff8f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:47.566187 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482e7cd-c0b4-4c8e-814d-3750a2ff8f8b admin admin] PATH_INFO: `/v3/projects/d71c895fde074698b9717d2a770ef5bf/users/7e3e3935d57a48f195a568f90ed25a8a/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:47.566339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec72533-43e0-4461-8732-eb5d7d7ca836 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:47.566784 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec72533-43e0-4461-8732-eb5d7d7ca836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:47.567274 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec72533-43e0-4461-8732-eb5d7d7ca836 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:47.568604 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec72533-43e0-4461-8732-eb5d7d7ca836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:47.573596 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec72533-43e0-4461-8732-eb5d7d7ca836 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:47.585162 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482e7cd-c0b4-4c8e-814d-3750a2ff8f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d71c895fde074698b9717d2a770ef5bf, user_id=7e3e3935d57a48f195a568f90ed25a8a, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:47.587920 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482e7cd-c0b4-4c8e-814d-3750a2ff8f8b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:47.596092 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 799/1596] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:53:47.597347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec72533-43e0-4461-8732-eb5d7d7ca836 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:47.605330 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 798/1597] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:53:47 2022] PUT /identity/v3/projects/d71c895fde074698b9717d2a770ef5bf/users/7e3e3935d57a48f195a568f90ed25a8a/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:53:47.607308 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482e7cd-c0b4-4c8e-814d-3750a2ff8f8b admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:47.613098 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec72533-43e0-4461-8732-eb5d7d7ca836 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:47.673801 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:INSERT=11,keystone:SELECT=89 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:53:47.689904 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd6711-9492-429e-904d-de6b478eaabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:47.690651 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd6711-9492-429e-904d-de6b478eaabb admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:47.690937 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd6711-9492-429e-904d-de6b478eaabb admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:47.691213 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd6711-9492-429e-904d-de6b478eaabb admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:47.691959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd6711-9492-429e-904d-de6b478eaabb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:47.693614 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd6711-9492-429e-904d-de6b478eaabb admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:47.697034 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482e7cd-c0b4-4c8e-814d-3750a2ff8f8b admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:47.703031 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6980e-a792-44ad-99ad-2d31b4e8a761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:47.703952 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6980e-a792-44ad-99ad-2d31b4e8a761 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:47.704761 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6980e-a792-44ad-99ad-2d31b4e8a761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:47.705055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6980e-a792-44ad-99ad-2d31b4e8a761 admin admin] PATH_INFO: `/v3/projects/7050c81c7efe4c0199573adc5687e9c0/users/f2d23615fd6349e1b70fdbad64b89b78/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:47.705754 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 800/1598] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:53:47.706776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd6711-9492-429e-904d-de6b478eaabb admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:47.720066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd6711-9492-429e-904d-de6b478eaabb admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:47.722866 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6980e-a792-44ad-99ad-2d31b4e8a761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7050c81c7efe4c0199573adc5687e9c0, user_id=f2d23615fd6349e1b70fdbad64b89b78, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:47.726138 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905a507-7f68-4e58-99fd-453d1a12147c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:47.726394 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6980e-a792-44ad-99ad-2d31b4e8a761 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:47.727075 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905a507-7f68-4e58-99fd-453d1a12147c admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:47.727475 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905a507-7f68-4e58-99fd-453d1a12147c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:47.727757 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905a507-7f68-4e58-99fd-453d1a12147c admin admin] PATH_INFO: `/v3/projects/fd54f08f109b48518c0dbfa18c9d3fc0/users/dfadd3dfe9de47538f180e54fdac58ab/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:47.742351 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 799/1599] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:53:47 2022] PUT /identity/v3/projects/7050c81c7efe4c0199573adc5687e9c0/users/f2d23615fd6349e1b70fdbad64b89b78/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:53:47.747154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6980e-a792-44ad-99ad-2d31b4e8a761 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:47.751184 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905a507-7f68-4e58-99fd-453d1a12147c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd54f08f109b48518c0dbfa18c9d3fc0, user_id=dfadd3dfe9de47538f180e54fdac58ab, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:47.752904 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: WARNING py.warnings [None req-9905a507-7f68-4e58-99fd-453d1a12147c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 05:53:47.752904 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: warnings.warn(msg) Jun 21 05:53:47.752904 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: Jun 21 05:53:47.755926 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905a507-7f68-4e58-99fd-453d1a12147c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:47.773872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 801/1600] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:53:47 2022] PUT /identity/v3/projects/fd54f08f109b48518c0dbfa18c9d3fc0/users/dfadd3dfe9de47538f180e54fdac58ab/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:53:47.774968 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905a507-7f68-4e58-99fd-453d1a12147c admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:47.826928 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6980e-a792-44ad-99ad-2d31b4e8a761 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:47.856122 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905a507-7f68-4e58-99fd-453d1a12147c admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:47.861856 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fc480-227a-454e-9c69-b769b1b318b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:47.863022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fc480-227a-454e-9c69-b769b1b318b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:47.863494 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fc480-227a-454e-9c69-b769b1b318b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:47.863976 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fc480-227a-454e-9c69-b769b1b318b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:47.865184 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059fc480-227a-454e-9c69-b769b1b318b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:47.868108 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059fc480-227a-454e-9c69-b769b1b318b1 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:47.885574 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 802/1601] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:53:47.886959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fc480-227a-454e-9c69-b769b1b318b1 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:47.900763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fc480-227a-454e-9c69-b769b1b318b1 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:47.906024 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb191f-62c8-420f-8dda-6bf9df9ba9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:47.906814 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb191f-62c8-420f-8dda-6bf9df9ba9af admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:47.907204 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb191f-62c8-420f-8dda-6bf9df9ba9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:47.908146 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb191f-62c8-420f-8dda-6bf9df9ba9af admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:47.909052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb191f-62c8-420f-8dda-6bf9df9ba9af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:47.909257 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba4cfd-fa13-4608-b9ef-2de074c679ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:47.909838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba4cfd-fa13-4608-b9ef-2de074c679ff admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:47.910148 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba4cfd-fa13-4608-b9ef-2de074c679ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:47.910427 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba4cfd-fa13-4608-b9ef-2de074c679ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:47.911173 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba4cfd-fa13-4608-b9ef-2de074c679ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:47.911464 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb191f-62c8-420f-8dda-6bf9df9ba9af admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:47.912803 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba4cfd-fa13-4608-b9ef-2de074c679ff admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:47.923613 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 803/1602] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:53:47.923841 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 800/1603] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:53:47.924834 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb191f-62c8-420f-8dda-6bf9df9ba9af admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:47.926246 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb60cb9-c021-4cd2-bd7f-ac3e66ba38e7 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:47.926780 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb60cb9-c021-4cd2-bd7f-ac3e66ba38e7 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:47.927257 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb60cb9-c021-4cd2-bd7f-ac3e66ba38e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:47.943379 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb191f-62c8-420f-8dda-6bf9df9ba9af admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:47.948940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b5821-bdd8-4082-ba31-8d9a9d780e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:47.949855 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b5821-bdd8-4082-ba31-8d9a9d780e09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:47.950176 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b5821-bdd8-4082-ba31-8d9a9d780e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:47.950471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b5821-bdd8-4082-ba31-8d9a9d780e09 admin admin] PATH_INFO: `/v3/projects/1fa5e44a25e546279833a63424913423/users/b284d5f52ab54e28ad6558803c09e07f/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:47.955989 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-9bb60cb9-c021-4cd2-bd7f-ac3e66ba38e7 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:47.957471 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9bb60cb9-c021-4cd2-bd7f-ac3e66ba38e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:47.967066 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 801/1604] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:47.969103 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b5821-bdd8-4082-ba31-8d9a9d780e09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa5e44a25e546279833a63424913423, user_id=b284d5f52ab54e28ad6558803c09e07f, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:47.972562 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb60cb9-c021-4cd2-bd7f-ac3e66ba38e7 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:47.973348 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b5821-bdd8-4082-ba31-8d9a9d780e09 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:47.990505 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 804/1605] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:53:47 2022] PUT /identity/v3/projects/1fa5e44a25e546279833a63424913423/users/b284d5f52ab54e28ad6558803c09e07f/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:53:47.991629 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb60cb9-c021-4cd2-bd7f-ac3e66ba38e7 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:47.991941 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94cb28-8e64-452f-a419-b1c647da978a None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:47.992300 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94cb28-8e64-452f-a419-b1c647da978a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:47.992616 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94cb28-8e64-452f-a419-b1c647da978a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:48.018415 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-6d94cb28-8e64-452f-a419-b1c647da978a None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:48.019708 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-6d94cb28-8e64-452f-a419-b1c647da978a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:48.065044 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:53:48.072059 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81766d6-e803-44b6-b471-1ae66e9e25a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:48.072956 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81766d6-e803-44b6-b471-1ae66e9e25a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:48.073245 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81766d6-e803-44b6-b471-1ae66e9e25a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:48.073528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81766d6-e803-44b6-b471-1ae66e9e25a7 admin admin] PATH_INFO: `/v3/projects/a6c9249bb4cf4dedbfc2ea66eea140c2/users/7d758ba84a95423e86d0b2cdcaeaeb86/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:48.076440 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:53:48.105750 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81766d6-e803-44b6-b471-1ae66e9e25a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c9249bb4cf4dedbfc2ea66eea140c2, user_id=7d758ba84a95423e86d0b2cdcaeaeb86, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:48.108640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81766d6-e803-44b6-b471-1ae66e9e25a7 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:48.127739 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 802/1606] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:53:47 2022] PUT /identity/v3/projects/a6c9249bb4cf4dedbfc2ea66eea140c2/users/7d758ba84a95423e86d0b2cdcaeaeb86/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:53:48.129220 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950463b-3bd3-4c91-8226-599b82475f83 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:48.129577 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950463b-3bd3-4c91-8226-599b82475f83 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:48.129878 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950463b-3bd3-4c91-8226-599b82475f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:48.134064 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 805/1607] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:48.134997 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94cb28-8e64-452f-a419-b1c647da978a None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:48.156815 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94cb28-8e64-452f-a419-b1c647da978a None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:48.162637 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-a950463b-3bd3-4c91-8226-599b82475f83 None None] MFA Rules not processed for user `dfadd3dfe9de47538f180e54fdac58ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:48.164019 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a950463b-3bd3-4c91-8226-599b82475f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:48.232986 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073539a-a64e-45cf-8f77-c3e363b77baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:48.233869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073539a-a64e-45cf-8f77-c3e363b77baa admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:48.234515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073539a-a64e-45cf-8f77-c3e363b77baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:48.234515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073539a-a64e-45cf-8f77-c3e363b77baa admin admin] PATH_INFO: `/v3/projects/9c9925a32b094db69c8637996e9cafa1/users/a6924b4015a7495885d168495a5bfbfc/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:48.238239 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 803/1608] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:53:48 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:48.239133 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950463b-3bd3-4c91-8226-599b82475f83 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:48.250548 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950463b-3bd3-4c91-8226-599b82475f83 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:48.256464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548444d9-7bb9-4651-b6aa-f21236668fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:48.256775 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073539a-a64e-45cf-8f77-c3e363b77baa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c9925a32b094db69c8637996e9cafa1, user_id=a6924b4015a7495885d168495a5bfbfc, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:48.257373 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548444d9-7bb9-4651-b6aa-f21236668fc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:48.257654 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548444d9-7bb9-4651-b6aa-f21236668fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:48.257984 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548444d9-7bb9-4651-b6aa-f21236668fc0 admin admin] PATH_INFO: `/v3/projects/219135be95384a599a7c8e7df72175c2/users/abd380b05ae94a29bdf56c529f1d411e/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:48.261111 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073539a-a64e-45cf-8f77-c3e363b77baa admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:48.280064 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 806/1609] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:53:48 2022] PUT /identity/v3/projects/9c9925a32b094db69c8637996e9cafa1/users/a6924b4015a7495885d168495a5bfbfc/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:53:48.281407 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073539a-a64e-45cf-8f77-c3e363b77baa admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:48.287436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548444d9-7bb9-4651-b6aa-f21236668fc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=219135be95384a599a7c8e7df72175c2, user_id=abd380b05ae94a29bdf56c529f1d411e, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:48.290579 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548444d9-7bb9-4651-b6aa-f21236668fc0 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:48.306694 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 804/1610] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:53:48 2022] PUT /identity/v3/projects/219135be95384a599a7c8e7df72175c2/users/abd380b05ae94a29bdf56c529f1d411e/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:53:48.314478 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548444d9-7bb9-4651-b6aa-f21236668fc0 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:48.358887 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073539a-a64e-45cf-8f77-c3e363b77baa admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:48.379576 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548444d9-7bb9-4651-b6aa-f21236668fc0 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:48.383749 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b1585-fefc-48e1-befd-15dd60fdbe6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:48.391427 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b1585-fefc-48e1-befd-15dd60fdbe6e service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:48.391427 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b1585-fefc-48e1-befd-15dd60fdbe6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:48.391427 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b1585-fefc-48e1-befd-15dd60fdbe6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:48.416495 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:53:48.427493 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea80d9-c901-44a9-9285-9c4e13af0b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:48.428973 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea80d9-c901-44a9-9285-9c4e13af0b14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:48.429464 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea80d9-c901-44a9-9285-9c4e13af0b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:48.430017 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea80d9-c901-44a9-9285-9c4e13af0b14 admin admin] PATH_INFO: `/v3/projects/ed1571657afc4ffd9fa9125c251de2c8/users/f4cd1d7c5a4a4b658f7abf8e434cf716/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:48.452023 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b1585-fefc-48e1-befd-15dd60fdbe6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:48.453392 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea80d9-c901-44a9-9285-9c4e13af0b14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed1571657afc4ffd9fa9125c251de2c8, user_id=f4cd1d7c5a4a4b658f7abf8e434cf716, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:48.453584 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b1585-fefc-48e1-befd-15dd60fdbe6e service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:48.456587 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea80d9-c901-44a9-9285-9c4e13af0b14 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:48.459815 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:53:48.465819 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 805/1611] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:53:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:53:48.467393 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec06ef9-2dac-449f-84f1-4ebf06e7522b None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:48.468432 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec06ef9-2dac-449f-84f1-4ebf06e7522b None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:48.468950 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec06ef9-2dac-449f-84f1-4ebf06e7522b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:48.476101 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 807/1612] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:53:48 2022] PUT /identity/v3/projects/ed1571657afc4ffd9fa9125c251de2c8/users/f4cd1d7c5a4a4b658f7abf8e434cf716/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:53:48.477436 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea80d9-c901-44a9-9285-9c4e13af0b14 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:48.507120 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-bec06ef9-2dac-449f-84f1-4ebf06e7522b None None] MFA Rules not processed for user `b284d5f52ab54e28ad6558803c09e07f`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:48.509343 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-bec06ef9-2dac-449f-84f1-4ebf06e7522b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:48.563529 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea80d9-c901-44a9-9285-9c4e13af0b14 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:48.572248 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90106926-0666-4caf-8e9b-d742368857cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:48.573076 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90106926-0666-4caf-8e9b-d742368857cf admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:48.574016 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90106926-0666-4caf-8e9b-d742368857cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:48.574322 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90106926-0666-4caf-8e9b-d742368857cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:48.575471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90106926-0666-4caf-8e9b-d742368857cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:48.578083 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90106926-0666-4caf-8e9b-d742368857cf admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:48.591805 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 808/1613] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:53:48.592739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90106926-0666-4caf-8e9b-d742368857cf admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:48.612938 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 806/1614] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:53:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:48.613802 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec06ef9-2dac-449f-84f1-4ebf06e7522b None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:48.636730 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec06ef9-2dac-449f-84f1-4ebf06e7522b None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:48.651655 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3cd797-7c7c-4b25-8256-5146d0b5e7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:48.652369 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cd797-7c7c-4b25-8256-5146d0b5e7ab admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:48.652688 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cd797-7c7c-4b25-8256-5146d0b5e7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:48.652917 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cd797-7c7c-4b25-8256-5146d0b5e7ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:48.653664 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3cd797-7c7c-4b25-8256-5146d0b5e7ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:48.655728 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3cd797-7c7c-4b25-8256-5146d0b5e7ab admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:48.690681 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90106926-0666-4caf-8e9b-d742368857cf admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:48.695406 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 807/1615] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:53:48 2022] POST /identity/v3/projects => generated 365 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:53:48.696508 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d235a77-2507-423b-aa6d-7cd15971a95c None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:48.696896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d235a77-2507-423b-aa6d-7cd15971a95c None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:48.697193 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d235a77-2507-423b-aa6d-7cd15971a95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:48.699065 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257d2e7-4659-47d5-91c9-801ab55c8808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:48.700472 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257d2e7-4659-47d5-91c9-801ab55c8808 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:48.700714 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257d2e7-4659-47d5-91c9-801ab55c8808 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:48.701094 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257d2e7-4659-47d5-91c9-801ab55c8808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:48.717015 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257d2e7-4659-47d5-91c9-801ab55c8808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:48.719126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-9d235a77-2507-423b-aa6d-7cd15971a95c None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:48.719376 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257d2e7-4659-47d5-91c9-801ab55c8808 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:48.721228 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9d235a77-2507-423b-aa6d-7cd15971a95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:48.744533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 809/1616] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:53:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:53:48.746276 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63d84a-daac-485d-9548-d4d1665864c3 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:48.746572 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63d84a-daac-485d-9548-d4d1665864c3 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:48.746857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63d84a-daac-485d-9548-d4d1665864c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:48.777311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-1d63d84a-daac-485d-9548-d4d1665864c3 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:48.779088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1d63d84a-daac-485d-9548-d4d1665864c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:48.835161 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 808/1617] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:53:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:48.837156 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f057c5-6e5a-4bf1-b07c-437515d2feae None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:48.837538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f057c5-6e5a-4bf1-b07c-437515d2feae None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:48.837905 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f057c5-6e5a-4bf1-b07c-437515d2feae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:48.863306 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-b3f057c5-6e5a-4bf1-b07c-437515d2feae None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:48.864694 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b3f057c5-6e5a-4bf1-b07c-437515d2feae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:48.874838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 809/1618] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:53:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:48.879320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f057c5-6e5a-4bf1-b07c-437515d2feae None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:48.890626 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f057c5-6e5a-4bf1-b07c-437515d2feae None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:48.898167 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94891f6-6e43-4a07-a5fa-fb0133223383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:48.898484 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94891f6-6e43-4a07-a5fa-fb0133223383 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:48.898891 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94891f6-6e43-4a07-a5fa-fb0133223383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:48.899591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94891f6-6e43-4a07-a5fa-fb0133223383 admin admin] PATH_INFO: `/v3/projects/a6c9249bb4cf4dedbfc2ea66eea140c2/users/7d758ba84a95423e86d0b2cdcaeaeb86/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:48.902307 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94891f6-6e43-4a07-a5fa-fb0133223383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c9249bb4cf4dedbfc2ea66eea140c2, user_id=7d758ba84a95423e86d0b2cdcaeaeb86, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:48.905014 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94891f6-6e43-4a07-a5fa-fb0133223383 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:48.923978 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 810/1619] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:53:48 2022] PUT /identity/v3/projects/a6c9249bb4cf4dedbfc2ea66eea140c2/users/7d758ba84a95423e86d0b2cdcaeaeb86/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:53:48.927265 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee1bcc-ea34-4ede-ab02-00c1b08a09ae None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:48.928784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee1bcc-ea34-4ede-ab02-00c1b08a09ae None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:48.929450 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee1bcc-ea34-4ede-ab02-00c1b08a09ae None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:48.932517 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 811/1620] 10.222.0.18 () {54 vars in 961 bytes} [Tue Jun 21 05:53:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:53:48.935266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee1bcc-ea34-4ede-ab02-00c1b08a09ae None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:48.970792 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 810/1621] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:53:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:48.975064 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63d84a-daac-485d-9548-d4d1665864c3 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:48.980152 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1d63d84a-daac-485d-9548-d4d1665864c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:49.015947 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:53:49.092256 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63d84a-daac-485d-9548-d4d1665864c3 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:49.125739 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:53:49.174826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee1bcc-ea34-4ede-ab02-00c1b08a09ae None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:49.183665 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbc145-20d4-4217-a71d-d1a3b5148efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:49.189074 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbc145-20d4-4217-a71d-d1a3b5148efc admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:49.190844 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbc145-20d4-4217-a71d-d1a3b5148efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:49.191031 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbc145-20d4-4217-a71d-d1a3b5148efc admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:49.192387 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dbc145-20d4-4217-a71d-d1a3b5148efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:49.196377 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dbc145-20d4-4217-a71d-d1a3b5148efc admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:49.210646 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d407bf0-894a-4380-985b-48e99c78d928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:49.211602 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d407bf0-894a-4380-985b-48e99c78d928 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:49.212042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d407bf0-894a-4380-985b-48e99c78d928 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:49.212889 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d407bf0-894a-4380-985b-48e99c78d928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:49.225919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d407bf0-894a-4380-985b-48e99c78d928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:49.227882 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d407bf0-894a-4380-985b-48e99c78d928 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:49.238343 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 812/1622] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:53:48 2022] POST /identity/v3/users => generated 289 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:53:49.239494 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbc145-20d4-4217-a71d-d1a3b5148efc admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:49.258057 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 811/1623] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:53:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:53:49.259795 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae21f28-7d8e-4f12-a571-4cbce5aa7a4c None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:49.260169 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae21f28-7d8e-4f12-a571-4cbce5aa7a4c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:49.260699 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae21f28-7d8e-4f12-a571-4cbce5aa7a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:49.280054 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbc145-20d4-4217-a71d-d1a3b5148efc admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:49.286303 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffe6ba-c2c5-4c12-bf00-36b7a9c1eb4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:49.288732 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffe6ba-c2c5-4c12-bf00-36b7a9c1eb4a service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:49.289260 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffe6ba-c2c5-4c12-bf00-36b7a9c1eb4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:49.289720 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffe6ba-c2c5-4c12-bf00-36b7a9c1eb4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:49.296166 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-eae21f28-7d8e-4f12-a571-4cbce5aa7a4c None None] MFA Rules not processed for user `7d758ba84a95423e86d0b2cdcaeaeb86`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:49.297518 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-eae21f28-7d8e-4f12-a571-4cbce5aa7a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:49.305193 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffe6ba-c2c5-4c12-bf00-36b7a9c1eb4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:49.307191 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffe6ba-c2c5-4c12-bf00-36b7a9c1eb4a service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:49.325448 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 813/1624] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:53:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:53:49.327659 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5c235-6288-4bf2-972a-d3e5a815aeb8 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:49.328215 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5c235-6288-4bf2-972a-d3e5a815aeb8 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:49.329736 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5c235-6288-4bf2-972a-d3e5a815aeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:49.356103 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-a8a5c235-6288-4bf2-972a-d3e5a815aeb8 None None] MFA Rules not processed for user `f702830987ba4548a4c2ee3d0e302d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:49.357627 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a8a5c235-6288-4bf2-972a-d3e5a815aeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:49.405160 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 812/1625] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:53:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:49.406918 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae21f28-7d8e-4f12-a571-4cbce5aa7a4c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:49.428620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae21f28-7d8e-4f12-a571-4cbce5aa7a4c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:49.436548 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409a052-7759-4a9b-b328-d2a03cf34611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:49.437684 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409a052-7759-4a9b-b328-d2a03cf34611 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:49.438152 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409a052-7759-4a9b-b328-d2a03cf34611 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:49.438594 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409a052-7759-4a9b-b328-d2a03cf34611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:49.452284 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 814/1626] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Jun 21 05:53:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:49.453164 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5c235-6288-4bf2-972a-d3e5a815aeb8 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:49.457759 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409a052-7759-4a9b-b328-d2a03cf34611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:49.463744 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409a052-7759-4a9b-b328-d2a03cf34611 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:49.466745 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5c235-6288-4bf2-972a-d3e5a815aeb8 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:49.473480 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212adbb-cb66-48cf-ae66-b325e6d12548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:49.474372 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212adbb-cb66-48cf-ae66-b325e6d12548 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:49.475320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212adbb-cb66-48cf-ae66-b325e6d12548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:49.475320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212adbb-cb66-48cf-ae66-b325e6d12548 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:49.476184 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212adbb-cb66-48cf-ae66-b325e6d12548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:49.477923 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212adbb-cb66-48cf-ae66-b325e6d12548 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:49.481349 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 813/1627] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:53:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:53:49.482740 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409a052-7759-4a9b-b328-d2a03cf34611 service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:49.493235 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 815/1628] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:53:49.497553 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212adbb-cb66-48cf-ae66-b325e6d12548 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:49.512928 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212adbb-cb66-48cf-ae66-b325e6d12548 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:49.520561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30869ae-7294-4ed2-98b8-07be8b503ff3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:49.521238 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30869ae-7294-4ed2-98b8-07be8b503ff3 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:49.521529 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30869ae-7294-4ed2-98b8-07be8b503ff3 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:49.521811 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30869ae-7294-4ed2-98b8-07be8b503ff3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:49.565876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409a052-7759-4a9b-b328-d2a03cf34611 service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:49.570270 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9d9eb-4057-40a4-96c2-14cb0e13acec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:49.570938 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9d9eb-4057-40a4-96c2-14cb0e13acec service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:49.571230 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9d9eb-4057-40a4-96c2-14cb0e13acec service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:49.571509 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9d9eb-4057-40a4-96c2-14cb0e13acec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:49.578004 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:53:49.583078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9d9eb-4057-40a4-96c2-14cb0e13acec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:49.584870 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9d9eb-4057-40a4-96c2-14cb0e13acec service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:49.597447 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 814/1629] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:53:49 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:53:49.598546 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9d9eb-4057-40a4-96c2-14cb0e13acec service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:49.612174 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9d9eb-4057-40a4-96c2-14cb0e13acec service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:49.620698 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30869ae-7294-4ed2-98b8-07be8b503ff3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:49.622090 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0a3ec-2cb1-4f54-bc6c-a5b3907db2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:49.623234 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30869ae-7294-4ed2-98b8-07be8b503ff3 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:49.623919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0a3ec-2cb1-4f54-bc6c-a5b3907db2df admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:49.624541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0a3ec-2cb1-4f54-bc6c-a5b3907db2df admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:49.625027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0a3ec-2cb1-4f54-bc6c-a5b3907db2df admin admin] PATH_INFO: `/v3/projects/c999c29c3f0d45af892c294f6fe679bb/users/3626deed6ef44e63b7f3346ca05c0e7f/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:49.639948 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 816/1630] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:53:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:53:49.652505 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0a3ec-2cb1-4f54-bc6c-a5b3907db2df admin admin] RBAC: Authorizing `identity:create_grant(project_id=c999c29c3f0d45af892c294f6fe679bb, user_id=3626deed6ef44e63b7f3346ca05c0e7f, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:49.656222 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0a3ec-2cb1-4f54-bc6c-a5b3907db2df admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:49.680360 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 815/1631] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:53:49 2022] PUT /identity/v3/projects/c999c29c3f0d45af892c294f6fe679bb/users/3626deed6ef44e63b7f3346ca05c0e7f/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:53:49.685348 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30869ae-7294-4ed2-98b8-07be8b503ff3 service nova] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:49.703631 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30869ae-7294-4ed2-98b8-07be8b503ff3 service nova] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:49.714329 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0a3ec-2cb1-4f54-bc6c-a5b3907db2df admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:49.778814 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:53:49.813442 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192cc5c-3442-4742-9c43-d62a5052ad82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:49.815353 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192cc5c-3442-4742-9c43-d62a5052ad82 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:49.815770 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192cc5c-3442-4742-9c43-d62a5052ad82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:49.816155 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192cc5c-3442-4742-9c43-d62a5052ad82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:49.817760 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192cc5c-3442-4742-9c43-d62a5052ad82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:49.820548 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192cc5c-3442-4742-9c43-d62a5052ad82 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:49.841074 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 817/1632] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:53:49.842459 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192cc5c-3442-4742-9c43-d62a5052ad82 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:49.851867 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0a3ec-2cb1-4f54-bc6c-a5b3907db2df admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:49.857153 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192cc5c-3442-4742-9c43-d62a5052ad82 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:49.859983 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b07d5b-e375-421e-8ddf-5d6b76591f0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:49.861879 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b07d5b-e375-421e-8ddf-5d6b76591f0e service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:49.862622 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b07d5b-e375-421e-8ddf-5d6b76591f0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:49.863308 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b07d5b-e375-421e-8ddf-5d6b76591f0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:49.864751 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcdd7e6-fc64-410a-b15a-8ba6afa85e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:49.866149 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdd7e6-fc64-410a-b15a-8ba6afa85e34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:49.866655 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdd7e6-fc64-410a-b15a-8ba6afa85e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:49.867253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdd7e6-fc64-410a-b15a-8ba6afa85e34 admin admin] PATH_INFO: `/v3/projects/c999c29c3f0d45af892c294f6fe679bb/users/3626deed6ef44e63b7f3346ca05c0e7f/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:49.871693 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcdd7e6-fc64-410a-b15a-8ba6afa85e34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c999c29c3f0d45af892c294f6fe679bb, user_id=3626deed6ef44e63b7f3346ca05c0e7f, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:49.878090 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcdd7e6-fc64-410a-b15a-8ba6afa85e34 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:49.897504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 818/1633] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:53:49 2022] PUT /identity/v3/projects/c999c29c3f0d45af892c294f6fe679bb/users/3626deed6ef44e63b7f3346ca05c0e7f/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:53:49.924378 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2807394-2681-40ed-9a3c-06b49615edf5 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:49.924803 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2807394-2681-40ed-9a3c-06b49615edf5 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:49.925778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2807394-2681-40ed-9a3c-06b49615edf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:50.006450 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-e2807394-2681-40ed-9a3c-06b49615edf5 None None] MFA Rules not processed for user `3626deed6ef44e63b7f3346ca05c0e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:50.009990 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e2807394-2681-40ed-9a3c-06b49615edf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:50.017520 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b07d5b-e375-421e-8ddf-5d6b76591f0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:50.019863 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b07d5b-e375-421e-8ddf-5d6b76591f0e service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:50.033472 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 816/1634] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:53:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 05:53:50.067706 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd13b74-6295-4839-aaff-dc6599f65a81 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:50.068047 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd13b74-6295-4839-aaff-dc6599f65a81 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:50.068469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd13b74-6295-4839-aaff-dc6599f65a81 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:50.070072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 817/1635] 10.222.0.18 () {54 vars in 912 bytes} [Tue Jun 21 05:53:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:53:50.079519 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b97cd-f112-4e11-bae7-12f17c438e93 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:50.080141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b97cd-f112-4e11-bae7-12f17c438e93 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:50.080585 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b97cd-f112-4e11-bae7-12f17c438e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:50.127981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-b38b97cd-f112-4e11-bae7-12f17c438e93 None None] MFA Rules not processed for user `f702830987ba4548a4c2ee3d0e302d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:50.129907 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b38b97cd-f112-4e11-bae7-12f17c438e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:50.180701 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 819/1636] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:53:49 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:50.202561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2807394-2681-40ed-9a3c-06b49615edf5 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:50.273440 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 818/1637] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jun 21 05:53:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:53:50.333344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2807394-2681-40ed-9a3c-06b49615edf5 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:50.341439 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf3059-8911-48eb-b22c-79502cb5a618 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:50.342872 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf3059-8911-48eb-b22c-79502cb5a618 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:50.343376 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf3059-8911-48eb-b22c-79502cb5a618 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:50.343826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf3059-8911-48eb-b22c-79502cb5a618 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:50.360230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf3059-8911-48eb-b22c-79502cb5a618 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:50.362186 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf3059-8911-48eb-b22c-79502cb5a618 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:50.378120 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 820/1638] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:53:50 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:53:50.438342 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b97cd-f112-4e11-bae7-12f17c438e93 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:50.473502 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b97cd-f112-4e11-bae7-12f17c438e93 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:50.486256 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187add8-2896-45f4-8578-be1ffb29168b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:50.486940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187add8-2896-45f4-8578-be1ffb29168b service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:50.487230 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187add8-2896-45f4-8578-be1ffb29168b service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:50.487515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187add8-2896-45f4-8578-be1ffb29168b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:50.523119 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187add8-2896-45f4-8578-be1ffb29168b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:50.525742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187add8-2896-45f4-8578-be1ffb29168b service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:50.550675 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 819/1639] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:53:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:53:50.665735 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf3059-8911-48eb-b22c-79502cb5a618 service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:50.689379 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf3059-8911-48eb-b22c-79502cb5a618 service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:50.706855 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7322e29-e57a-4076-9ccf-f0869ccd4894 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:50.708674 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7322e29-e57a-4076-9ccf-f0869ccd4894 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:50.708674 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7322e29-e57a-4076-9ccf-f0869ccd4894 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:50.708674 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7322e29-e57a-4076-9ccf-f0869ccd4894 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:50.898645 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:53:50.925267 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7322e29-e57a-4076-9ccf-f0869ccd4894 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:50.926774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7322e29-e57a-4076-9ccf-f0869ccd4894 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:50.950182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 821/1640] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:53:50 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:53:52.213881 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2be6d7-63d3-4e26-bc42-46c014584be5 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:52.214781 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2be6d7-63d3-4e26-bc42-46c014584be5 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:52.214781 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2be6d7-63d3-4e26-bc42-46c014584be5 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:52.216600 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 820/1641] 10.222.0.18 () {54 vars in 961 bytes} [Tue Jun 21 05:53:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:53:52.244348 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a57cfd-fb01-4d0f-b5ff-38fe76ca87e2 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:52.244885 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a57cfd-fb01-4d0f-b5ff-38fe76ca87e2 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:52.245170 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a57cfd-fb01-4d0f-b5ff-38fe76ca87e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:52.314163 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-a2a57cfd-fb01-4d0f-b5ff-38fe76ca87e2 None None] MFA Rules not processed for user `f702830987ba4548a4c2ee3d0e302d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:52.322347 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a2a57cfd-fb01-4d0f-b5ff-38fe76ca87e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:52.358304 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 822/1642] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Jun 21 05:53:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:52.366940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33eddb-606f-4243-8ade-9328870ee34b None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:52.367479 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33eddb-606f-4243-8ade-9328870ee34b None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:52.367963 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33eddb-606f-4243-8ade-9328870ee34b None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:52.369373 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 821/1643] 10.222.0.18 () {54 vars in 912 bytes} [Tue Jun 21 05:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 05:53:52.378243 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc21c01-b579-4338-b9bd-1c80b5920636 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:52.379011 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc21c01-b579-4338-b9bd-1c80b5920636 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:52.379011 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc21c01-b579-4338-b9bd-1c80b5920636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:52.414494 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-6dc21c01-b579-4338-b9bd-1c80b5920636 None None] MFA Rules not processed for user `f702830987ba4548a4c2ee3d0e302d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:52.415776 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6dc21c01-b579-4338-b9bd-1c80b5920636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:52.441496 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 823/1644] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jun 21 05:53:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:53:52.456446 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33eddb-606f-4243-8ade-9328870ee34b None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:52.462270 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:53:52.475192 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33eddb-606f-4243-8ade-9328870ee34b None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:52.482746 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c73d4-895b-40ef-9f43-40fe5cbc88fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:52.483441 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c73d4-895b-40ef-9f43-40fe5cbc88fa service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:52.483884 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c73d4-895b-40ef-9f43-40fe5cbc88fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:52.484046 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c73d4-895b-40ef-9f43-40fe5cbc88fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:52.509642 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c73d4-895b-40ef-9f43-40fe5cbc88fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:52.511178 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c73d4-895b-40ef-9f43-40fe5cbc88fa service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:52.539235 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 822/1645] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:53:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:53:54.469115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc21c01-b579-4338-b9bd-1c80b5920636 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:54.664943 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc21c01-b579-4338-b9bd-1c80b5920636 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:54.671762 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e7116-e4c7-4dd3-9779-6fb4bd6119a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:54.674365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e7116-e4c7-4dd3-9779-6fb4bd6119a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:54.674808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e7116-e4c7-4dd3-9779-6fb4bd6119a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:54.676045 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e7116-e4c7-4dd3-9779-6fb4bd6119a3 admin admin] PATH_INFO: `/v3/users/b284d5f52ab54e28ad6558803c09e07f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:54.704599 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e7116-e4c7-4dd3-9779-6fb4bd6119a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b284d5f52ab54e28ad6558803c09e07f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:54.717199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e7116-e4c7-4dd3-9779-6fb4bd6119a3 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:54.853185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-297e7116-e4c7-4dd3-9779-6fb4bd6119a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b284d5f52ab54e28ad6558803c09e07f'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:53:54.881698 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-297e7116-e4c7-4dd3-9779-6fb4bd6119a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b284d5f52ab54e28ad6558803c09e07f'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:53:54.882640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-297e7116-e4c7-4dd3-9779-6fb4bd6119a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b284d5f52ab54e28ad6558803c09e07f'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:53:54.896345 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-297e7116-e4c7-4dd3-9779-6fb4bd6119a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b284d5f52ab54e28ad6558803c09e07f'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:53:54.925647 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-297e7116-e4c7-4dd3-9779-6fb4bd6119a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b284d5f52ab54e28ad6558803c09e07f'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:53:54.945584 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 824/1646] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:53:54 2022] DELETE /identity/v3/users/b284d5f52ab54e28ad6558803c09e07f => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:53:54.946998 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a675c-3ce3-44b2-b217-954d60c7bbd7 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:54.947519 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a675c-3ce3-44b2-b217-954d60c7bbd7 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:54.947680 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a675c-3ce3-44b2-b217-954d60c7bbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:54.986994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-213a675c-3ce3-44b2-b217-954d60c7bbd7 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:54.988590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-213a675c-3ce3-44b2-b217-954d60c7bbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:55.197568 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 823/1647] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:55.278554 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e7116-e4c7-4dd3-9779-6fb4bd6119a3 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:55.283256 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-297e7116-e4c7-4dd3-9779-6fb4bd6119a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:55.623248 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e7116-e4c7-4dd3-9779-6fb4bd6119a3 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:55.674602 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a006b-28c6-4aad-80b2-12028aca4543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:55.674602 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a006b-28c6-4aad-80b2-12028aca4543 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:55.674602 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a006b-28c6-4aad-80b2-12028aca4543 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:55.674602 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a006b-28c6-4aad-80b2-12028aca4543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:55.700377 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a006b-28c6-4aad-80b2-12028aca4543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:55.703436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a006b-28c6-4aad-80b2-12028aca4543 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:55.720660 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:53:55.740226 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 825/1648] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:53:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:53:57.191918 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a675c-3ce3-44b2-b217-954d60c7bbd7 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:57.194205 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-213a675c-3ce3-44b2-b217-954d60c7bbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:57.214296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a675c-3ce3-44b2-b217-954d60c7bbd7 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:57.243535 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd11e7-5740-4cd7-83cc-5c63363ed1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:57.245023 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd11e7-5740-4cd7-83cc-5c63363ed1e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:57.245483 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd11e7-5740-4cd7-83cc-5c63363ed1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:57.246027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd11e7-5740-4cd7-83cc-5c63363ed1e0 admin admin] PATH_INFO: `/v3/projects/1fa5e44a25e546279833a63424913423` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:57.250641 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd11e7-5740-4cd7-83cc-5c63363ed1e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fa5e44a25e546279833a63424913423)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:57.258914 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd11e7-5740-4cd7-83cc-5c63363ed1e0 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:57.435933 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-38bd11e7-5740-4cd7-83cc-5c63363ed1e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fa5e44a25e546279833a63424913423', 'request_id': 'req-38bd11e7-5740-4cd7-83cc-5c63363ed1e0'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:53:57.460702 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-38bd11e7-5740-4cd7-83cc-5c63363ed1e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fa5e44a25e546279833a63424913423', 'request_id': 'req-38bd11e7-5740-4cd7-83cc-5c63363ed1e0'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:53:57.477642 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-38bd11e7-5740-4cd7-83cc-5c63363ed1e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fa5e44a25e546279833a63424913423', 'request_id': 'req-38bd11e7-5740-4cd7-83cc-5c63363ed1e0'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:53:57.508686 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-38bd11e7-5740-4cd7-83cc-5c63363ed1e0 admin admin] The token cache is being invalidate because project 1fa5e44a25e546279833a63424913423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:53:57.508993 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-38bd11e7-5740-4cd7-83cc-5c63363ed1e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:53:57.509740 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-38bd11e7-5740-4cd7-83cc-5c63363ed1e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:53:57.511708 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 824/1649] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:53:57 2022] DELETE /identity/v3/projects/1fa5e44a25e546279833a63424913423 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:53:57.518761 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33ebae-a08b-4824-9af6-eede326ebbd1 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:57.519881 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33ebae-a08b-4824-9af6-eede326ebbd1 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:57.520590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33ebae-a08b-4824-9af6-eede326ebbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:57.578686 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-4e33ebae-a08b-4824-9af6-eede326ebbd1 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:57.581015 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4e33ebae-a08b-4824-9af6-eede326ebbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:57.728906 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 826/1650] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:57.740580 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985e380-5c35-4dd6-94a1-a3c591249697 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:57.740902 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985e380-5c35-4dd6-94a1-a3c591249697 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:57.741192 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985e380-5c35-4dd6-94a1-a3c591249697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:57.830910 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-c985e380-5c35-4dd6-94a1-a3c591249697 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:57.844218 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c985e380-5c35-4dd6-94a1-a3c591249697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:57.901593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 825/1651] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:57.902023 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33ebae-a08b-4824-9af6-eede326ebbd1 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:57.921067 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33ebae-a08b-4824-9af6-eede326ebbd1 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:57.939766 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52866a-7b19-423e-8a79-d7a2106ac802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:57.940478 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52866a-7b19-423e-8a79-d7a2106ac802 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:57.940774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52866a-7b19-423e-8a79-d7a2106ac802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:57.941060 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52866a-7b19-423e-8a79-d7a2106ac802 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:57.941824 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52866a-7b19-423e-8a79-d7a2106ac802 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:53:57.942171 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52866a-7b19-423e-8a79-d7a2106ac802 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:57.943844 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52866a-7b19-423e-8a79-d7a2106ac802 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:57.972190 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 827/1652] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:53:57.978913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985e380-5c35-4dd6-94a1-a3c591249697 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:58.022515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985e380-5c35-4dd6-94a1-a3c591249697 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:58.064245 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac8b65-3e9d-4bc7-8440-6c09db8d4dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:58.065540 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac8b65-3e9d-4bc7-8440-6c09db8d4dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:58.066057 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac8b65-3e9d-4bc7-8440-6c09db8d4dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:58.066627 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac8b65-3e9d-4bc7-8440-6c09db8d4dc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:58.068223 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac8b65-3e9d-4bc7-8440-6c09db8d4dc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:58.074563 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac8b65-3e9d-4bc7-8440-6c09db8d4dc6 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:58.154265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 826/1653] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:53:57 2022] POST /identity/v3/projects => generated 365 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:53:58.159737 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52866a-7b19-423e-8a79-d7a2106ac802 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:58.173200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52866a-7b19-423e-8a79-d7a2106ac802 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:58.312037 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db63904-117a-4e00-8624-6f580a7aa988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:58.312637 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db63904-117a-4e00-8624-6f580a7aa988 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:58.312929 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db63904-117a-4e00-8624-6f580a7aa988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:58.313886 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db63904-117a-4e00-8624-6f580a7aa988 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:58.314659 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db63904-117a-4e00-8624-6f580a7aa988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:58.316657 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db63904-117a-4e00-8624-6f580a7aa988 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:58.362345 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 828/1654] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:53:58 2022] POST /identity/v3/users => generated 283 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:53:58.368353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac8b65-3e9d-4bc7-8440-6c09db8d4dc6 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:58.392700 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac8b65-3e9d-4bc7-8440-6c09db8d4dc6 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:58.404194 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d58536-38cf-4da7-a3bf-1f20eb350ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:58.404845 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d58536-38cf-4da7-a3bf-1f20eb350ead admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:58.405145 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d58536-38cf-4da7-a3bf-1f20eb350ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:58.405430 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d58536-38cf-4da7-a3bf-1f20eb350ead admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:58.406217 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d58536-38cf-4da7-a3bf-1f20eb350ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:58.408245 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d58536-38cf-4da7-a3bf-1f20eb350ead admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:58.463693 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 827/1655] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 05:53:58.469102 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db63904-117a-4e00-8624-6f580a7aa988 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:58.496280 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db63904-117a-4e00-8624-6f580a7aa988 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:58.546054 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18270e-d174-49a3-94a3-3e0f63e0b851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:58.547282 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18270e-d174-49a3-94a3-3e0f63e0b851 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:58.549171 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18270e-d174-49a3-94a3-3e0f63e0b851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:58.550636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18270e-d174-49a3-94a3-3e0f63e0b851 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:58.553709 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed18270e-d174-49a3-94a3-3e0f63e0b851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:58.564036 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed18270e-d174-49a3-94a3-3e0f63e0b851 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:58.620145 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 829/1656] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:53:58.623397 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d58536-38cf-4da7-a3bf-1f20eb350ead admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:58.653609 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d58536-38cf-4da7-a3bf-1f20eb350ead admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:58.666690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79136a16-3c63-40a8-999e-3e6373356510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:58.667829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79136a16-3c63-40a8-999e-3e6373356510 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:58.668211 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79136a16-3c63-40a8-999e-3e6373356510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:58.668585 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79136a16-3c63-40a8-999e-3e6373356510 admin admin] PATH_INFO: `/v3/projects/4e2e85629bc545aaaaf4c03ec3acdeb9/users/3e0707d00df04016b1269f003f6fefbe/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:58.745252 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79136a16-3c63-40a8-999e-3e6373356510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e2e85629bc545aaaaf4c03ec3acdeb9, user_id=3e0707d00df04016b1269f003f6fefbe, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:58.752580 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79136a16-3c63-40a8-999e-3e6373356510 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:58.790534 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 828/1657] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:53:58 2022] PUT /identity/v3/projects/4e2e85629bc545aaaaf4c03ec3acdeb9/users/3e0707d00df04016b1269f003f6fefbe/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:53:58.804189 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f7d54-03c0-4cea-9062-9162a4851ba9 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:58.804700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f7d54-03c0-4cea-9062-9162a4851ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:58.805205 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f7d54-03c0-4cea-9062-9162a4851ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:58.871751 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-2d9f7d54-03c0-4cea-9062-9162a4851ba9 None None] MFA Rules not processed for user `3e0707d00df04016b1269f003f6fefbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:53:58.876078 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-2d9f7d54-03c0-4cea-9062-9162a4851ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:53:59.127575 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:53:59.171076 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 830/1658] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:53:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:53:59.172771 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79136a16-3c63-40a8-999e-3e6373356510 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:59.222930 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:53:59.456614 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79136a16-3c63-40a8-999e-3e6373356510 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:59.479718 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa730da-8d95-4803-83b0-6744d0e7335b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:59.480656 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa730da-8d95-4803-83b0-6744d0e7335b admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:59.481089 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa730da-8d95-4803-83b0-6744d0e7335b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:59.481510 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa730da-8d95-4803-83b0-6744d0e7335b admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:59.484340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa730da-8d95-4803-83b0-6744d0e7335b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:59.488945 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa730da-8d95-4803-83b0-6744d0e7335b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:59.570858 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 829/1659] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:53:59 2022] POST /identity/v3/projects => generated 365 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:53:59.575333 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f7d54-03c0-4cea-9062-9162a4851ba9 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:59.597123 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f7d54-03c0-4cea-9062-9162a4851ba9 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:59.812808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7643d93-7c4e-4f54-aaf0-1b06a2382266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:59.821149 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7643d93-7c4e-4f54-aaf0-1b06a2382266 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:59.822372 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7643d93-7c4e-4f54-aaf0-1b06a2382266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:59.825062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7643d93-7c4e-4f54-aaf0-1b06a2382266 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:59.825918 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7643d93-7c4e-4f54-aaf0-1b06a2382266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:59.828765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7643d93-7c4e-4f54-aaf0-1b06a2382266 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:53:59.924274 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 831/1660] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:53:59 2022] POST /identity/v3/users => generated 289 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:53:59.928886 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa730da-8d95-4803-83b0-6744d0e7335b admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:53:59.956318 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa730da-8d95-4803-83b0-6744d0e7335b admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:53:59.978022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2651131-72ca-4de0-8420-3ff1b9a00f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:53:59.978739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2651131-72ca-4de0-8420-3ff1b9a00f28 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:53:59.979028 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2651131-72ca-4de0-8420-3ff1b9a00f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:53:59.979317 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2651131-72ca-4de0-8420-3ff1b9a00f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:53:59.980083 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2651131-72ca-4de0-8420-3ff1b9a00f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:53:59.988661 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2651131-72ca-4de0-8420-3ff1b9a00f28 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:00.025312 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 830/1661] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:54:00.033657 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7643d93-7c4e-4f54-aaf0-1b06a2382266 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:00.048305 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7643d93-7c4e-4f54-aaf0-1b06a2382266 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:00.076278 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cda4d1-7fc6-4c0f-bb0b-cb1dc26bb70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:00.076278 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cda4d1-7fc6-4c0f-bb0b-cb1dc26bb70c admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:00.076429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cda4d1-7fc6-4c0f-bb0b-cb1dc26bb70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:00.076624 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cda4d1-7fc6-4c0f-bb0b-cb1dc26bb70c admin admin] PATH_INFO: `/v3/projects/15e5741e48224cf6bdabf39899960473/users/b7b13559be384056b51dcbce9cd0a67f/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:00.157777 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cda4d1-7fc6-4c0f-bb0b-cb1dc26bb70c admin admin] RBAC: Authorizing `identity:create_grant(project_id=15e5741e48224cf6bdabf39899960473, user_id=b7b13559be384056b51dcbce9cd0a67f, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:00.169356 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cda4d1-7fc6-4c0f-bb0b-cb1dc26bb70c admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:00.224859 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 832/1662] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:54:00 2022] PUT /identity/v3/projects/15e5741e48224cf6bdabf39899960473/users/b7b13559be384056b51dcbce9cd0a67f/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:00.229150 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2651131-72ca-4de0-8420-3ff1b9a00f28 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:00.245520 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2651131-72ca-4de0-8420-3ff1b9a00f28 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:00.549897 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13301984-4e38-499c-9663-b501d9663758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:00.571266 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13301984-4e38-499c-9663-b501d9663758 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:00.572261 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13301984-4e38-499c-9663-b501d9663758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:00.572770 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13301984-4e38-499c-9663-b501d9663758 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:00.575310 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13301984-4e38-499c-9663-b501d9663758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:00.578565 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13301984-4e38-499c-9663-b501d9663758 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:00.626494 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cda4d1-7fc6-4c0f-bb0b-cb1dc26bb70c admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:00.630602 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 831/1663] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:54:00.655016 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cda4d1-7fc6-4c0f-bb0b-cb1dc26bb70c admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:00.687941 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8defd-6655-42d2-88d7-67b3e4428fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:00.690342 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8defd-6655-42d2-88d7-67b3e4428fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:00.690666 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8defd-6655-42d2-88d7-67b3e4428fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:00.698727 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8defd-6655-42d2-88d7-67b3e4428fc5 admin admin] PATH_INFO: `/v3/projects/15e5741e48224cf6bdabf39899960473/users/b7b13559be384056b51dcbce9cd0a67f/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:00.708173 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8defd-6655-42d2-88d7-67b3e4428fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15e5741e48224cf6bdabf39899960473, user_id=b7b13559be384056b51dcbce9cd0a67f, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:00.723291 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8defd-6655-42d2-88d7-67b3e4428fc5 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:00.767801 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 833/1664] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:54:00 2022] PUT /identity/v3/projects/15e5741e48224cf6bdabf39899960473/users/b7b13559be384056b51dcbce9cd0a67f/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 05:54:00.779208 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7a79a-62fd-4997-b1fd-051c6e44422b None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:00.780019 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7a79a-62fd-4997-b1fd-051c6e44422b None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:00.780314 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7a79a-62fd-4997-b1fd-051c6e44422b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:00.857140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-33f7a79a-62fd-4997-b1fd-051c6e44422b None None] MFA Rules not processed for user `b7b13559be384056b51dcbce9cd0a67f`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:00.860770 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-33f7a79a-62fd-4997-b1fd-051c6e44422b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:01.057072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 832/1665] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:00 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:01.076999 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8defd-6655-42d2-88d7-67b3e4428fc5 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:01.079663 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c0f8defd-6655-42d2-88d7-67b3e4428fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:01.401809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8defd-6655-42d2-88d7-67b3e4428fc5 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:01.418073 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499b801-4224-4f9c-969e-42bbe526ac67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:01.418967 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499b801-4224-4f9c-969e-42bbe526ac67 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:01.419630 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499b801-4224-4f9c-969e-42bbe526ac67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:01.423173 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499b801-4224-4f9c-969e-42bbe526ac67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:01.466484 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499b801-4224-4f9c-969e-42bbe526ac67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:01.469147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499b801-4224-4f9c-969e-42bbe526ac67 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:01.519761 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 834/1666] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:01 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:54:01.738958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7a79a-62fd-4997-b1fd-051c6e44422b None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:01.747892 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:01.767949 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7a79a-62fd-4997-b1fd-051c6e44422b None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:01.807582 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a784ab-61bc-4820-a0d9-8062fa43a117 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:01.813212 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a784ab-61bc-4820-a0d9-8062fa43a117 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:01.813730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a784ab-61bc-4820-a0d9-8062fa43a117 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:01.821475 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a784ab-61bc-4820-a0d9-8062fa43a117 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:02.042991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a784ab-61bc-4820-a0d9-8062fa43a117 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:02.044476 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a784ab-61bc-4820-a0d9-8062fa43a117 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:02.076140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 833/1667] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:54:03.771194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7286143-dc84-4dff-9d11-b3d975c2f834 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:03.771194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7286143-dc84-4dff-9d11-b3d975c2f834 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:03.771194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7286143-dc84-4dff-9d11-b3d975c2f834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:03.867454 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-a7286143-dc84-4dff-9d11-b3d975c2f834 None None] MFA Rules not processed for user `7e3e3935d57a48f195a568f90ed25a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:03.869173 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a7286143-dc84-4dff-9d11-b3d975c2f834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:03.999996 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:04.140156 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 835/1668] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:04.153595 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a784ab-61bc-4820-a0d9-8062fa43a117 service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:04.155482 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-64a784ab-61bc-4820-a0d9-8062fa43a117 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:04.424126 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a784ab-61bc-4820-a0d9-8062fa43a117 service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:04.430911 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8d7f6-df6a-4f2a-8c30-b3dcb1da3892 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:04.431600 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8d7f6-df6a-4f2a-8c30-b3dcb1da3892 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:04.431935 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8d7f6-df6a-4f2a-8c30-b3dcb1da3892 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:04.432221 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8d7f6-df6a-4f2a-8c30-b3dcb1da3892 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:04.459266 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8d7f6-df6a-4f2a-8c30-b3dcb1da3892 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:04.461150 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8d7f6-df6a-4f2a-8c30-b3dcb1da3892 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:04.486023 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 834/1669] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:54:06.094809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7286143-dc84-4dff-9d11-b3d975c2f834 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:06.278592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7286143-dc84-4dff-9d11-b3d975c2f834 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:06.299660 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89475adc-5440-49fd-8d93-a476e89b342c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:06.300677 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89475adc-5440-49fd-8d93-a476e89b342c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:06.300992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89475adc-5440-49fd-8d93-a476e89b342c admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:06.301314 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89475adc-5440-49fd-8d93-a476e89b342c admin admin] PATH_INFO: `/v3/users/3e0707d00df04016b1269f003f6fefbe` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:06.305249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89475adc-5440-49fd-8d93-a476e89b342c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e0707d00df04016b1269f003f6fefbe)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:06.313660 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89475adc-5440-49fd-8d93-a476e89b342c admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:06.429470 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-89475adc-5440-49fd-8d93-a476e89b342c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e0707d00df04016b1269f003f6fefbe'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:06.446933 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-89475adc-5440-49fd-8d93-a476e89b342c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e0707d00df04016b1269f003f6fefbe'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:06.448117 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-89475adc-5440-49fd-8d93-a476e89b342c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e0707d00df04016b1269f003f6fefbe'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:06.466615 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-89475adc-5440-49fd-8d93-a476e89b342c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e0707d00df04016b1269f003f6fefbe'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:06.504006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-89475adc-5440-49fd-8d93-a476e89b342c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e0707d00df04016b1269f003f6fefbe'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:06.512135 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 836/1670] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:54:06 2022] DELETE /identity/v3/users/3e0707d00df04016b1269f003f6fefbe => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:06.519530 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22d586-6d0a-4f62-925f-b16a5c7428d8 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:06.520078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22d586-6d0a-4f62-925f-b16a5c7428d8 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:06.520438 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22d586-6d0a-4f62-925f-b16a5c7428d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:06.612103 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-0a22d586-6d0a-4f62-925f-b16a5c7428d8 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:06.613402 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-0a22d586-6d0a-4f62-925f-b16a5c7428d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:06.824453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 835/1671] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:06.967236 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89475adc-5440-49fd-8d93-a476e89b342c admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:06.971038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-89475adc-5440-49fd-8d93-a476e89b342c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:07.013654 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89475adc-5440-49fd-8d93-a476e89b342c admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:07.024336 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05188613-99c6-417d-8078-a8e4c8f87a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:07.025778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05188613-99c6-417d-8078-a8e4c8f87a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:07.026126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05188613-99c6-417d-8078-a8e4c8f87a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:07.026415 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05188613-99c6-417d-8078-a8e4c8f87a5e admin admin] PATH_INFO: `/v3/users/dfadd3dfe9de47538f180e54fdac58ab` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:07.027693 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05188613-99c6-417d-8078-a8e4c8f87a5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfadd3dfe9de47538f180e54fdac58ab)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:07.037179 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05188613-99c6-417d-8078-a8e4c8f87a5e admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:07.114592 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22d586-6d0a-4f62-925f-b16a5c7428d8 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:07.117364 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-0a22d586-6d0a-4f62-925f-b16a5c7428d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:07.183805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-05188613-99c6-417d-8078-a8e4c8f87a5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfadd3dfe9de47538f180e54fdac58ab'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:07.205219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:07.214919 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-05188613-99c6-417d-8078-a8e4c8f87a5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfadd3dfe9de47538f180e54fdac58ab'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:07.221383 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-05188613-99c6-417d-8078-a8e4c8f87a5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfadd3dfe9de47538f180e54fdac58ab'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:07.242156 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:07.254925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-05188613-99c6-417d-8078-a8e4c8f87a5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfadd3dfe9de47538f180e54fdac58ab'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:07.307351 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-05188613-99c6-417d-8078-a8e4c8f87a5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfadd3dfe9de47538f180e54fdac58ab'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:07.318480 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22d586-6d0a-4f62-925f-b16a5c7428d8 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:07.329649 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9abb5eb-ce2f-4656-b790-dd395c25f85f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:07.330521 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abb5eb-ce2f-4656-b790-dd395c25f85f service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:07.331400 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abb5eb-ce2f-4656-b790-dd395c25f85f service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:07.332103 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abb5eb-ce2f-4656-b790-dd395c25f85f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:07.337705 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c9abb5eb-ce2f-4656-b790-dd395c25f85f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:07.342505 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 837/1672] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:54:06 2022] DELETE /identity/v3/users/dfadd3dfe9de47538f180e54fdac58ab => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:07.347647 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad968821-d17a-4519-97d5-cb0b141bcbb2 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:07.347942 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad968821-d17a-4519-97d5-cb0b141bcbb2 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:07.348229 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad968821-d17a-4519-97d5-cb0b141bcbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:07.376455 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9abb5eb-ce2f-4656-b790-dd395c25f85f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:07.378593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9abb5eb-ce2f-4656-b790-dd395c25f85f service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:07.396169 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 836/1673] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:54:07.411390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-ad968821-d17a-4519-97d5-cb0b141bcbb2 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:07.412843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ad968821-d17a-4519-97d5-cb0b141bcbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:07.466478 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad4005-7d82-4ccd-8974-4ae2ea915ab2 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:07.467134 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad4005-7d82-4ccd-8974-4ae2ea915ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:07.467670 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad4005-7d82-4ccd-8974-4ae2ea915ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:07.572861 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-8dad4005-7d82-4ccd-8974-4ae2ea915ab2 None None] MFA Rules not processed for user `f2d23615fd6349e1b70fdbad64b89b78`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:07.575394 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8dad4005-7d82-4ccd-8974-4ae2ea915ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:07.584888 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 838/1674] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:07.767652 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 837/1675] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:07.773901 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09a11d-4263-4168-aabc-5ff27f3e7c7c None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:07.774262 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09a11d-4263-4168-aabc-5ff27f3e7c7c None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:07.774548 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09a11d-4263-4168-aabc-5ff27f3e7c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:07.802734 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad4005-7d82-4ccd-8974-4ae2ea915ab2 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:07.804377 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8dad4005-7d82-4ccd-8974-4ae2ea915ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:07.822121 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-3a09a11d-4263-4168-aabc-5ff27f3e7c7c None None] MFA Rules not processed for user `f2d23615fd6349e1b70fdbad64b89b78`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:07.824209 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3a09a11d-4263-4168-aabc-5ff27f3e7c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:07.855167 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 839/1676] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:07.865682 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09a11d-4263-4168-aabc-5ff27f3e7c7c None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:07.867244 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3a09a11d-4263-4168-aabc-5ff27f3e7c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:07.985991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad4005-7d82-4ccd-8974-4ae2ea915ab2 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:07.999374 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f849a-a644-4324-898d-85273ddd96d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:08.000876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f849a-a644-4324-898d-85273ddd96d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:08.001023 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f849a-a644-4324-898d-85273ddd96d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:08.001391 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f849a-a644-4324-898d-85273ddd96d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:08.022749 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f849a-a644-4324-898d-85273ddd96d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:08.024380 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f849a-a644-4324-898d-85273ddd96d9 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:08.043237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09a11d-4263-4168-aabc-5ff27f3e7c7c None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:08.052053 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 838/1677] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 05:54:08.056633 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60432ab2-f4fe-4a8f-ac94-20c2419f4b66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:08.057437 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60432ab2-f4fe-4a8f-ac94-20c2419f4b66 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:08.057831 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60432ab2-f4fe-4a8f-ac94-20c2419f4b66 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:08.058264 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60432ab2-f4fe-4a8f-ac94-20c2419f4b66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:08.091473 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60432ab2-f4fe-4a8f-ac94-20c2419f4b66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:08.095206 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60432ab2-f4fe-4a8f-ac94-20c2419f4b66 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:08.121700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 840/1678] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:54:08.465061 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ec487-a2da-43ab-863b-394d25f668c6 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:08.465574 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ec487-a2da-43ab-863b-394d25f668c6 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:08.465905 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ec487-a2da-43ab-863b-394d25f668c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:08.514032 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-b69ec487-a2da-43ab-863b-394d25f668c6 None None] MFA Rules not processed for user `a6924b4015a7495885d168495a5bfbfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:08.516490 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b69ec487-a2da-43ab-863b-394d25f668c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:08.689290 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:08.709462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 839/1679] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:08.723045 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cc331-74ee-4351-8ce8-e3d72207e3c0 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:08.724941 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cc331-74ee-4351-8ce8-e3d72207e3c0 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:08.725961 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cc331-74ee-4351-8ce8-e3d72207e3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:08.766358 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-ed3cc331-74ee-4351-8ce8-e3d72207e3c0 None None] MFA Rules not processed for user `a6924b4015a7495885d168495a5bfbfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:08.768445 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ed3cc331-74ee-4351-8ce8-e3d72207e3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:08.782989 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 841/1680] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:08.795994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ec487-a2da-43ab-863b-394d25f668c6 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:08.799703 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b69ec487-a2da-43ab-863b-394d25f668c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:08.871192 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ec487-a2da-43ab-863b-394d25f668c6 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:08.884575 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18dcb82-66ca-452f-9504-b1f6aff2eeb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:08.885324 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18dcb82-66ca-452f-9504-b1f6aff2eeb1 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:08.885618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18dcb82-66ca-452f-9504-b1f6aff2eeb1 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:08.885909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18dcb82-66ca-452f-9504-b1f6aff2eeb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:08.916237 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18dcb82-66ca-452f-9504-b1f6aff2eeb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:08.917988 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18dcb82-66ca-452f-9504-b1f6aff2eeb1 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:08.958415 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 840/1681] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:54:09.774747 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3cc331-74ee-4351-8ce8-e3d72207e3c0 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:09.777398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ed3cc331-74ee-4351-8ce8-e3d72207e3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:09.802558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3cc331-74ee-4351-8ce8-e3d72207e3c0 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:09.819061 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554417e-b1bc-47dc-aa2e-436bc2cd5507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:09.820208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554417e-b1bc-47dc-aa2e-436bc2cd5507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:09.820653 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554417e-b1bc-47dc-aa2e-436bc2cd5507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:09.821105 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554417e-b1bc-47dc-aa2e-436bc2cd5507 admin admin] PATH_INFO: `/v3/projects/fd54f08f109b48518c0dbfa18c9d3fc0` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:09.825192 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554417e-b1bc-47dc-aa2e-436bc2cd5507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd54f08f109b48518c0dbfa18c9d3fc0)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:09.826575 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: WARNING py.warnings [None req-e554417e-b1bc-47dc-aa2e-436bc2cd5507 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 05:54:09.826575 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: warnings.warn(msg) Jun 21 05:54:09.826575 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: Jun 21 05:54:09.828098 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554417e-b1bc-47dc-aa2e-436bc2cd5507 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:09.886869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717908f6-3905-4735-aece-4ebc3f5254eb None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:09.887265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717908f6-3905-4735-aece-4ebc3f5254eb None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:09.887594 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717908f6-3905-4735-aece-4ebc3f5254eb None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:09.889102 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 841/1682] 10.222.0.18 () {54 vars in 912 bytes} [Tue Jun 21 05:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:54:09.913531 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e218f-d886-4526-abc6-a876f41dd2c9 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:09.913905 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e218f-d886-4526-abc6-a876f41dd2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:09.914621 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e218f-d886-4526-abc6-a876f41dd2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:09.993260 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:10.032367 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e554417e-b1bc-47dc-aa2e-436bc2cd5507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd54f08f109b48518c0dbfa18c9d3fc0', 'request_id': 'req-e554417e-b1bc-47dc-aa2e-436bc2cd5507'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:10.062375 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e554417e-b1bc-47dc-aa2e-436bc2cd5507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd54f08f109b48518c0dbfa18c9d3fc0', 'request_id': 'req-e554417e-b1bc-47dc-aa2e-436bc2cd5507'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:10.102777 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e554417e-b1bc-47dc-aa2e-436bc2cd5507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd54f08f109b48518c0dbfa18c9d3fc0', 'request_id': 'req-e554417e-b1bc-47dc-aa2e-436bc2cd5507'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:10.116087 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-152e218f-d886-4526-abc6-a876f41dd2c9 None None] MFA Rules not processed for user `51e845d0dc2c4a1fa612556c1aa73ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:10.120742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-152e218f-d886-4526-abc6-a876f41dd2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:10.127037 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e554417e-b1bc-47dc-aa2e-436bc2cd5507 admin admin] The token cache is being invalidate because project fd54f08f109b48518c0dbfa18c9d3fc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:54:10.127339 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e554417e-b1bc-47dc-aa2e-436bc2cd5507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:10.128135 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e554417e-b1bc-47dc-aa2e-436bc2cd5507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:10.131717 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 842/1683] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:54:09 2022] DELETE /identity/v3/projects/fd54f08f109b48518c0dbfa18c9d3fc0 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:10.137691 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679154e-86ed-49b1-9cb2-52011ed4e52f None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:10.142871 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679154e-86ed-49b1-9cb2-52011ed4e52f None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:10.143311 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679154e-86ed-49b1-9cb2-52011ed4e52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:10.211900 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-9679154e-86ed-49b1-9cb2-52011ed4e52f None None] MFA Rules not processed for user `abd380b05ae94a29bdf56c529f1d411e`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:10.213217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9679154e-86ed-49b1-9cb2-52011ed4e52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:10.313764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 842/1684] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jun 21 05:54:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:54:10.315651 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff618ef0-eb64-48e6-aaeb-0ac1e2ca9f84 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:10.316154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff618ef0-eb64-48e6-aaeb-0ac1e2ca9f84 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:10.316657 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff618ef0-eb64-48e6-aaeb-0ac1e2ca9f84 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:10.318989 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 843/1685] 10.222.0.18 () {54 vars in 912 bytes} [Tue Jun 21 05:54:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:54:10.324287 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff618ef0-eb64-48e6-aaeb-0ac1e2ca9f84 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:10.327554 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ff618ef0-eb64-48e6-aaeb-0ac1e2ca9f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:10.374766 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 843/1686] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:10.377673 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762a865-2bae-4b8d-ab0a-dd874bdf1d38 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:10.379741 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762a865-2bae-4b8d-ab0a-dd874bdf1d38 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:10.380047 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762a865-2bae-4b8d-ab0a-dd874bdf1d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:10.432582 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-a762a865-2bae-4b8d-ab0a-dd874bdf1d38 None None] MFA Rules not processed for user `51e845d0dc2c4a1fa612556c1aa73ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:10.435366 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a762a865-2bae-4b8d-ab0a-dd874bdf1d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:10.505096 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 844/1687] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jun 21 05:54:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:10.511212 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762a865-2bae-4b8d-ab0a-dd874bdf1d38 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:10.514303 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a762a865-2bae-4b8d-ab0a-dd874bdf1d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:10.545646 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762a865-2bae-4b8d-ab0a-dd874bdf1d38 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:10.561102 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1421310-ef9a-4d87-a478-3948103b1d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:10.564818 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1421310-ef9a-4d87-a478-3948103b1d18 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:10.565828 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1421310-ef9a-4d87-a478-3948103b1d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:10.566670 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1421310-ef9a-4d87-a478-3948103b1d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:10.570506 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff618ef0-eb64-48e6-aaeb-0ac1e2ca9f84 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:10.584286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0baec-3e9a-41ab-b933-87995165f4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:10.585200 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0baec-3e9a-41ab-b933-87995165f4ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:10.585491 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0baec-3e9a-41ab-b933-87995165f4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:10.586908 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0baec-3e9a-41ab-b933-87995165f4ca admin admin] PATH_INFO: `/v3/users/3626deed6ef44e63b7f3346ca05c0e7f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:10.592741 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1421310-ef9a-4d87-a478-3948103b1d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:10.593691 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0baec-3e9a-41ab-b933-87995165f4ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=3626deed6ef44e63b7f3346ca05c0e7f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:10.595098 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: WARNING py.warnings [None req-e1f0baec-3e9a-41ab-b933-87995165f4ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 05:54:10.595098 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: warnings.warn(msg) Jun 21 05:54:10.595098 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: Jun 21 05:54:10.596192 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1421310-ef9a-4d87-a478-3948103b1d18 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:10.596377 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0baec-3e9a-41ab-b933-87995165f4ca admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:10.622550 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 845/1688] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:54:10.642710 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1421310-ef9a-4d87-a478-3948103b1d18 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:10.642710 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e1421310-ef9a-4d87-a478-3948103b1d18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:10.712083 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1421310-ef9a-4d87-a478-3948103b1d18 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:10.744221 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eab4b1-52d8-4632-ab6d-2464da8f321f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:10.749225 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eab4b1-52d8-4632-ab6d-2464da8f321f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:10.750013 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eab4b1-52d8-4632-ab6d-2464da8f321f admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:10.750013 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eab4b1-52d8-4632-ab6d-2464da8f321f admin admin] PATH_INFO: `/v3/projects/4e2e85629bc545aaaaf4c03ec3acdeb9` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:10.757539 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eab4b1-52d8-4632-ab6d-2464da8f321f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e2e85629bc545aaaaf4c03ec3acdeb9)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:10.764319 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eab4b1-52d8-4632-ab6d-2464da8f321f admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:10.839752 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e1f0baec-3e9a-41ab-b933-87995165f4ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3626deed6ef44e63b7f3346ca05c0e7f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:10.866725 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e1f0baec-3e9a-41ab-b933-87995165f4ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3626deed6ef44e63b7f3346ca05c0e7f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:10.870369 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e1f0baec-3e9a-41ab-b933-87995165f4ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3626deed6ef44e63b7f3346ca05c0e7f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:10.877052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e1f0baec-3e9a-41ab-b933-87995165f4ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3626deed6ef44e63b7f3346ca05c0e7f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:10.897807 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-92eab4b1-52d8-4632-ab6d-2464da8f321f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e2e85629bc545aaaaf4c03ec3acdeb9', 'request_id': 'req-92eab4b1-52d8-4632-ab6d-2464da8f321f'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:10.915542 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-92eab4b1-52d8-4632-ab6d-2464da8f321f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e2e85629bc545aaaaf4c03ec3acdeb9', 'request_id': 'req-92eab4b1-52d8-4632-ab6d-2464da8f321f'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:10.929470 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-92eab4b1-52d8-4632-ab6d-2464da8f321f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e2e85629bc545aaaaf4c03ec3acdeb9', 'request_id': 'req-92eab4b1-52d8-4632-ab6d-2464da8f321f'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:10.949599 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e1f0baec-3e9a-41ab-b933-87995165f4ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3626deed6ef44e63b7f3346ca05c0e7f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:10.961033 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-92eab4b1-52d8-4632-ab6d-2464da8f321f admin admin] The token cache is being invalidate because project 4e2e85629bc545aaaaf4c03ec3acdeb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:54:10.963262 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-92eab4b1-52d8-4632-ab6d-2464da8f321f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:10.966505 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-92eab4b1-52d8-4632-ab6d-2464da8f321f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:10.972600 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 846/1689] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:54:10 2022] DELETE /identity/v3/projects/4e2e85629bc545aaaaf4c03ec3acdeb9 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:10.973235 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eab4b1-52d8-4632-ab6d-2464da8f321f admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:10.976336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:10.979906 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-92eab4b1-52d8-4632-ab6d-2464da8f321f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:11.001016 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 844/1690] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:54:10 2022] DELETE /identity/v3/users/3626deed6ef44e63b7f3346ca05c0e7f => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:11.002987 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0baec-3e9a-41ab-b933-87995165f4ca admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:11.007110 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e1f0baec-3e9a-41ab-b933-87995165f4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:11.045146 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:11.183811 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eab4b1-52d8-4632-ab6d-2464da8f321f admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:11.233278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0baec-3e9a-41ab-b933-87995165f4ca admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:11.249964 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930502d1-a7f3-47bc-85f7-359a5b9cf555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:11.252121 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930502d1-a7f3-47bc-85f7-359a5b9cf555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:11.252455 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930502d1-a7f3-47bc-85f7-359a5b9cf555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:11.255268 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930502d1-a7f3-47bc-85f7-359a5b9cf555 admin admin] PATH_INFO: `/v3/users/b7b13559be384056b51dcbce9cd0a67f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:11.259695 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930502d1-a7f3-47bc-85f7-359a5b9cf555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7b13559be384056b51dcbce9cd0a67f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:11.266083 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930502d1-a7f3-47bc-85f7-359a5b9cf555 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:11.331669 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbc3ac-7cbd-46a9-abf6-b7bb69ae0771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:11.332470 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbc3ac-7cbd-46a9-abf6-b7bb69ae0771 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:11.332843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbc3ac-7cbd-46a9-abf6-b7bb69ae0771 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:11.333197 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbc3ac-7cbd-46a9-abf6-b7bb69ae0771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:11.336533 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d6bbc3ac-7cbd-46a9-abf6-b7bb69ae0771 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:11.388443 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-930502d1-a7f3-47bc-85f7-359a5b9cf555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7b13559be384056b51dcbce9cd0a67f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:11.404702 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-930502d1-a7f3-47bc-85f7-359a5b9cf555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7b13559be384056b51dcbce9cd0a67f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:11.405860 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-930502d1-a7f3-47bc-85f7-359a5b9cf555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7b13559be384056b51dcbce9cd0a67f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:11.407402 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-930502d1-a7f3-47bc-85f7-359a5b9cf555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7b13559be384056b51dcbce9cd0a67f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:11.408832 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bbc3ac-7cbd-46a9-abf6-b7bb69ae0771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:11.416308 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bbc3ac-7cbd-46a9-abf6-b7bb69ae0771 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:11.452131 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-930502d1-a7f3-47bc-85f7-359a5b9cf555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7b13559be384056b51dcbce9cd0a67f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:11.457728 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 847/1691] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:54:11.486621 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 845/1692] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:54:11 2022] DELETE /identity/v3/users/b7b13559be384056b51dcbce9cd0a67f => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:11.917818 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a45bf5-4bfb-47ee-8d92-995e81096496 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:11.918334 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a45bf5-4bfb-47ee-8d92-995e81096496 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:11.918707 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a45bf5-4bfb-47ee-8d92-995e81096496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:12.036236 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-41a45bf5-4bfb-47ee-8d92-995e81096496 None None] MFA Rules not processed for user `f4cd1d7c5a4a4b658f7abf8e434cf716`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:12.037755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-41a45bf5-4bfb-47ee-8d92-995e81096496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:12.231576 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 848/1693] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:12.239481 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930502d1-a7f3-47bc-85f7-359a5b9cf555 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:12.244253 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-930502d1-a7f3-47bc-85f7-359a5b9cf555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:12.483256 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930502d1-a7f3-47bc-85f7-359a5b9cf555 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:12.501843 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ce453-0f82-4da5-9434-693dd7c13278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:12.516136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ce453-0f82-4da5-9434-693dd7c13278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:12.516739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ce453-0f82-4da5-9434-693dd7c13278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:12.519077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ce453-0f82-4da5-9434-693dd7c13278 admin admin] PATH_INFO: `/v3/projects/c999c29c3f0d45af892c294f6fe679bb` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:12.530417 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ce453-0f82-4da5-9434-693dd7c13278 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c999c29c3f0d45af892c294f6fe679bb)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:12.536262 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ce453-0f82-4da5-9434-693dd7c13278 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:12.583011 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:12.586752 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a45bf5-4bfb-47ee-8d92-995e81096496 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:12.588555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-41a45bf5-4bfb-47ee-8d92-995e81096496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:12.729172 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-043ce453-0f82-4da5-9434-693dd7c13278 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c999c29c3f0d45af892c294f6fe679bb', 'request_id': 'req-043ce453-0f82-4da5-9434-693dd7c13278'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:12.776666 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-043ce453-0f82-4da5-9434-693dd7c13278 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c999c29c3f0d45af892c294f6fe679bb', 'request_id': 'req-043ce453-0f82-4da5-9434-693dd7c13278'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:12.815453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-043ce453-0f82-4da5-9434-693dd7c13278 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c999c29c3f0d45af892c294f6fe679bb', 'request_id': 'req-043ce453-0f82-4da5-9434-693dd7c13278'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:12.842913 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a45bf5-4bfb-47ee-8d92-995e81096496 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:12.850270 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:12.859263 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-043ce453-0f82-4da5-9434-693dd7c13278 admin admin] The token cache is being invalidate because project c999c29c3f0d45af892c294f6fe679bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:54:12.860569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-043ce453-0f82-4da5-9434-693dd7c13278 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:12.867445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-043ce453-0f82-4da5-9434-693dd7c13278 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:12.883734 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 846/1694] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:54:12 2022] DELETE /identity/v3/projects/c999c29c3f0d45af892c294f6fe679bb => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:12.883734 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92c7e4-d0c2-4a15-8063-81ef74f57602 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:12.883734 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92c7e4-d0c2-4a15-8063-81ef74f57602 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:12.883734 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92c7e4-d0c2-4a15-8063-81ef74f57602 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:12.885142 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 847/1695] 10.222.0.18 () {54 vars in 960 bytes} [Tue Jun 21 05:54:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:54:12.886130 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d364fc3-09a6-4d16-9b89-706e6249aebf None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:12.886421 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d364fc3-09a6-4d16-9b89-706e6249aebf None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:12.886700 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d364fc3-09a6-4d16-9b89-706e6249aebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:12.954056 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-1d364fc3-09a6-4d16-9b89-706e6249aebf None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:12.955380 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1d364fc3-09a6-4d16-9b89-706e6249aebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:13.042056 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad8b74-7136-4871-9ec3-3d7a72a6f9c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:13.044869 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad8b74-7136-4871-9ec3-3d7a72a6f9c3 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:13.047100 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad8b74-7136-4871-9ec3-3d7a72a6f9c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:13.050624 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad8b74-7136-4871-9ec3-3d7a72a6f9c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:13.065439 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ecad8b74-7136-4871-9ec3-3d7a72a6f9c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:13.129382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 848/1696] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:13.138051 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25a8c9-aef0-47af-b944-6379fc9dc587 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:13.138416 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25a8c9-aef0-47af-b944-6379fc9dc587 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:13.138679 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25a8c9-aef0-47af-b944-6379fc9dc587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:13.182389 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-5d25a8c9-aef0-47af-b944-6379fc9dc587 None None] MFA Rules not processed for user `d17a40bea6ba41f19c88e16f9b15cf27`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:13.183683 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5d25a8c9-aef0-47af-b944-6379fc9dc587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:13.278779 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad8b74-7136-4871-9ec3-3d7a72a6f9c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:13.283231 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad8b74-7136-4871-9ec3-3d7a72a6f9c3 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:13.316802 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 849/1697] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 730 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 05:54:13.318590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195f7ee-df61-4234-b14b-4e649ef53c6f None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:13.322423 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195f7ee-df61-4234-b14b-4e649ef53c6f None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:13.323125 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195f7ee-df61-4234-b14b-4e649ef53c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:13.368709 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-a195f7ee-df61-4234-b14b-4e649ef53c6f None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:13.377428 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 849/1698] 10.222.0.18 () {58 vars in 1057 bytes} [Tue Jun 21 05:54:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:13.378555 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25a8c9-aef0-47af-b944-6379fc9dc587 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:13.380781 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a195f7ee-df61-4234-b14b-4e649ef53c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:13.423439 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 850/1699] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:13.428303 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195f7ee-df61-4234-b14b-4e649ef53c6f None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:13.443606 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25a8c9-aef0-47af-b944-6379fc9dc587 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:13.444522 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195f7ee-df61-4234-b14b-4e649ef53c6f None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:13.450344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936b08d-70fc-44ca-a718-d43f7aab9601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:13.451041 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936b08d-70fc-44ca-a718-d43f7aab9601 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:13.451329 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936b08d-70fc-44ca-a718-d43f7aab9601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:13.451654 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936b08d-70fc-44ca-a718-d43f7aab9601 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:13.452697 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936b08d-70fc-44ca-a718-d43f7aab9601 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:54:13.453049 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936b08d-70fc-44ca-a718-d43f7aab9601 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:13.455411 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936b08d-70fc-44ca-a718-d43f7aab9601 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:13.480239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36bb12-97ea-4d69-afc2-14230e539404 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17a40bea6ba41f19c88e16f9b15cf27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:13.480446 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 851/1700] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:54:13.480936 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36bb12-97ea-4d69-afc2-14230e539404 service placement] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:13.481703 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36bb12-97ea-4d69-afc2-14230e539404 service placement] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:13.481812 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936b08d-70fc-44ca-a718-d43f7aab9601 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:13.481884 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36bb12-97ea-4d69-afc2-14230e539404 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:13.496227 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936b08d-70fc-44ca-a718-d43f7aab9601 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:13.497679 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ca36bb12-97ea-4d69-afc2-14230e539404 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:13.502903 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59881724-f261-484a-90b7-efd347ad4da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:13.503575 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59881724-f261-484a-90b7-efd347ad4da6 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:13.503878 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59881724-f261-484a-90b7-efd347ad4da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:13.504167 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59881724-f261-484a-90b7-efd347ad4da6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:13.505110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59881724-f261-484a-90b7-efd347ad4da6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:13.509979 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59881724-f261-484a-90b7-efd347ad4da6 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:13.549223 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36bb12-97ea-4d69-afc2-14230e539404 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:13.551932 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36bb12-97ea-4d69-afc2-14230e539404 service placement] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:13.628202 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 850/1701] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:54:13.662855 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36bb12-97ea-4d69-afc2-14230e539404 service placement] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:13.664810 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ca36bb12-97ea-4d69-afc2-14230e539404 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:13.666133 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 852/1702] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:54:13 2022] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:54:13.671285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59881724-f261-484a-90b7-efd347ad4da6 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:13.738890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36bb12-97ea-4d69-afc2-14230e539404 service placement] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:13.809233 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:13.868611 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59881724-f261-484a-90b7-efd347ad4da6 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:13.895780 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5b3b2-acc9-421d-9a38-086a65f0dbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:13.896484 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5b3b2-acc9-421d-9a38-086a65f0dbd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:13.896769 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5b3b2-acc9-421d-9a38-086a65f0dbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:13.897050 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5b3b2-acc9-421d-9a38-086a65f0dbd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:13.897758 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5b3b2-acc9-421d-9a38-086a65f0dbd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:13.902159 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5b3b2-acc9-421d-9a38-086a65f0dbd7 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:13.914733 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b5166-862c-4d7e-a1b9-a17c64b8325a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:13.915526 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b5166-862c-4d7e-a1b9-a17c64b8325a service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:13.915768 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b5166-862c-4d7e-a1b9-a17c64b8325a service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:13.916006 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b5166-862c-4d7e-a1b9-a17c64b8325a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:13.924562 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-fc4b5166-862c-4d7e-a1b9-a17c64b8325a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:13.933029 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:13.973463 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 853/1703] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:54:13 2022] POST /identity/v3/users => generated 293 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:54:13.975769 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5b3b2-acc9-421d-9a38-086a65f0dbd7 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:13.998332 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5b3b2-acc9-421d-9a38-086a65f0dbd7 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:14.013994 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a962e78-d3ca-4f1b-961b-15d919e4b446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:14.015556 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a962e78-d3ca-4f1b-961b-15d919e4b446 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:14.015785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a962e78-d3ca-4f1b-961b-15d919e4b446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:14.019317 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a962e78-d3ca-4f1b-961b-15d919e4b446 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:14.022977 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a962e78-d3ca-4f1b-961b-15d919e4b446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:14.028405 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a962e78-d3ca-4f1b-961b-15d919e4b446 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:14.096844 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 854/1704] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:54:14.098704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a962e78-d3ca-4f1b-961b-15d919e4b446 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:14.135459 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a962e78-d3ca-4f1b-961b-15d919e4b446 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:14.152609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fd58a-5017-4097-8483-a2a891f45396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:14.154485 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fd58a-5017-4097-8483-a2a891f45396 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:14.154964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fd58a-5017-4097-8483-a2a891f45396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:14.155422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fd58a-5017-4097-8483-a2a891f45396 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:14.157568 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fd58a-5017-4097-8483-a2a891f45396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:14.165640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fd58a-5017-4097-8483-a2a891f45396 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:14.197169 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 855/1705] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:54:14.200991 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fd58a-5017-4097-8483-a2a891f45396 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:14.223469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b5166-862c-4d7e-a1b9-a17c64b8325a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:14.227735 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b5166-862c-4d7e-a1b9-a17c64b8325a service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:14.229894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fd58a-5017-4097-8483-a2a891f45396 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:14.249098 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 851/1706] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:54:14.252415 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c255de-5af7-4191-a544-58f595751474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:14.253397 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c255de-5af7-4191-a544-58f595751474 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:14.253691 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c255de-5af7-4191-a544-58f595751474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:14.254059 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c255de-5af7-4191-a544-58f595751474 admin admin] PATH_INFO: `/v3/projects/7f9cd000cc014a1da028d8a0fb3186ab/users/58944a0134754d948cf91d9b079a8eb4/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:14.292716 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b5166-862c-4d7e-a1b9-a17c64b8325a service nova] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:14.296690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-fc4b5166-862c-4d7e-a1b9-a17c64b8325a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:14.301533 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c255de-5af7-4191-a544-58f595751474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9cd000cc014a1da028d8a0fb3186ab, user_id=58944a0134754d948cf91d9b079a8eb4, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:14.305024 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c255de-5af7-4191-a544-58f595751474 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:14.332643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 856/1707] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:54:14 2022] PUT /identity/v3/projects/7f9cd000cc014a1da028d8a0fb3186ab/users/58944a0134754d948cf91d9b079a8eb4/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:14.344509 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c8923-354c-4d3e-8cdc-74cdb0126b93 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:14.344811 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c8923-354c-4d3e-8cdc-74cdb0126b93 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:14.345134 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c8923-354c-4d3e-8cdc-74cdb0126b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:14.356668 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b5166-862c-4d7e-a1b9-a17c64b8325a service nova] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:14.490777 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312c629-85e3-4ecd-8d49-5dbf19e16c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:14.491773 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-a67c8923-354c-4d3e-8cdc-74cdb0126b93 None None] MFA Rules not processed for user `58944a0134754d948cf91d9b079a8eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:14.491923 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312c629-85e3-4ecd-8d49-5dbf19e16c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:14.492063 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312c629-85e3-4ecd-8d49-5dbf19e16c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:14.492454 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312c629-85e3-4ecd-8d49-5dbf19e16c50 admin admin] PATH_INFO: `/v3/projects/15e5741e48224cf6bdabf39899960473` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:14.497993 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a67c8923-354c-4d3e-8cdc-74cdb0126b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:14.498410 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312c629-85e3-4ecd-8d49-5dbf19e16c50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15e5741e48224cf6bdabf39899960473)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:14.498410 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312c629-85e3-4ecd-8d49-5dbf19e16c50 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:14.663364 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8312c629-85e3-4ecd-8d49-5dbf19e16c50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15e5741e48224cf6bdabf39899960473', 'request_id': 'req-8312c629-85e3-4ecd-8d49-5dbf19e16c50'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:14.679453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8312c629-85e3-4ecd-8d49-5dbf19e16c50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15e5741e48224cf6bdabf39899960473', 'request_id': 'req-8312c629-85e3-4ecd-8d49-5dbf19e16c50'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:14.697249 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8312c629-85e3-4ecd-8d49-5dbf19e16c50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15e5741e48224cf6bdabf39899960473', 'request_id': 'req-8312c629-85e3-4ecd-8d49-5dbf19e16c50'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:14.715092 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:14.738567 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8312c629-85e3-4ecd-8d49-5dbf19e16c50 admin admin] The token cache is being invalidate because project 15e5741e48224cf6bdabf39899960473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:54:14.740112 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8312c629-85e3-4ecd-8d49-5dbf19e16c50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:14.742251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8312c629-85e3-4ecd-8d49-5dbf19e16c50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:14.756666 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 852/1708] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:54:14 2022] DELETE /identity/v3/projects/15e5741e48224cf6bdabf39899960473 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 05:54:14.761584 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6639cb8-9633-48dc-a28f-b72e0a0b8bb2 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:14.763285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6639cb8-9633-48dc-a28f-b72e0a0b8bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:14.763797 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6639cb8-9633-48dc-a28f-b72e0a0b8bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:14.863550 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-d6639cb8-9633-48dc-a28f-b72e0a0b8bb2 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:14.866226 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d6639cb8-9633-48dc-a28f-b72e0a0b8bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:14.995184 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 857/1709] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 652 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:54:14.996718 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04073dc2-6aff-440e-b48f-15c8c1304839 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:14.997020 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04073dc2-6aff-440e-b48f-15c8c1304839 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:14.997308 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04073dc2-6aff-440e-b48f-15c8c1304839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:15.086467 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-04073dc2-6aff-440e-b48f-15c8c1304839 None None] MFA Rules not processed for user `f2d23615fd6349e1b70fdbad64b89b78`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:15.088038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-04073dc2-6aff-440e-b48f-15c8c1304839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:15.172901 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 853/1710] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:15.173849 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6639cb8-9633-48dc-a28f-b72e0a0b8bb2 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:15.179676 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d6639cb8-9633-48dc-a28f-b72e0a0b8bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:15.225503 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6639cb8-9633-48dc-a28f-b72e0a0b8bb2 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:15.236539 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744e637-9244-4aac-b441-360e376b0595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:15.239286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744e637-9244-4aac-b441-360e376b0595 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:15.239858 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744e637-9244-4aac-b441-360e376b0595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:15.241671 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744e637-9244-4aac-b441-360e376b0595 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:15.258656 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744e637-9244-4aac-b441-360e376b0595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:15.264088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744e637-9244-4aac-b441-360e376b0595 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:15.342230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 858/1711] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:15.346878 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20b256-c156-40b4-b5e8-b07d9698fdb7 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:15.347452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20b256-c156-40b4-b5e8-b07d9698fdb7 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:15.347887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20b256-c156-40b4-b5e8-b07d9698fdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:15.370953 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 854/1712] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:54:15 2022] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:54:15.376022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744e637-9244-4aac-b441-360e376b0595 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:15.403287 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-7f20b256-c156-40b4-b5e8-b07d9698fdb7 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:15.405011 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-7f20b256-c156-40b4-b5e8-b07d9698fdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:15.578665 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:15.597500 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744e637-9244-4aac-b441-360e376b0595 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:15.628812 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3354da-f5bf-4371-acd1-5b6e013ee7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:15.638321 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3354da-f5bf-4371-acd1-5b6e013ee7dd admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:15.638907 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3354da-f5bf-4371-acd1-5b6e013ee7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:15.640744 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3354da-f5bf-4371-acd1-5b6e013ee7dd admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:15.646037 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3354da-f5bf-4371-acd1-5b6e013ee7dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:15.653578 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3354da-f5bf-4371-acd1-5b6e013ee7dd admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:15.656144 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 859/1713] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:15.666140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20b256-c156-40b4-b5e8-b07d9698fdb7 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:15.706321 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20b256-c156-40b4-b5e8-b07d9698fdb7 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:15.723959 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64fc615-a974-4249-bba3-702d6f6a939a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:15.725000 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64fc615-a974-4249-bba3-702d6f6a939a admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:15.725383 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64fc615-a974-4249-bba3-702d6f6a939a admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:15.726580 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64fc615-a974-4249-bba3-702d6f6a939a admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:15.732408 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 855/1714] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:54:15 2022] POST /identity/v3/users => generated 299 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:54:15.736656 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64fc615-a974-4249-bba3-702d6f6a939a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:54:15.736973 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3354da-f5bf-4371-acd1-5b6e013ee7dd admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:15.737174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64fc615-a974-4249-bba3-702d6f6a939a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:15.739274 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64fc615-a974-4249-bba3-702d6f6a939a admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:15.767870 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3354da-f5bf-4371-acd1-5b6e013ee7dd admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:15.787550 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8aa942-864e-4691-8713-c4a8b85676af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:15.790683 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8aa942-864e-4691-8713-c4a8b85676af admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:15.791238 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8aa942-864e-4691-8713-c4a8b85676af admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:15.791741 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8aa942-864e-4691-8713-c4a8b85676af admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:15.800810 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 860/1715] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:54:15.801426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8aa942-864e-4691-8713-c4a8b85676af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:15.802062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64fc615-a974-4249-bba3-702d6f6a939a admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:15.805043 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8aa942-864e-4691-8713-c4a8b85676af admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:15.846611 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 856/1716] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:54:15.847187 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64fc615-a974-4249-bba3-702d6f6a939a admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:15.847656 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8aa942-864e-4691-8713-c4a8b85676af admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:15.880688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8aa942-864e-4691-8713-c4a8b85676af admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:15.883545 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b70d52-11a3-4f57-8ac0-0e802e476b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:15.884751 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b70d52-11a3-4f57-8ac0-0e802e476b94 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:15.885543 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b70d52-11a3-4f57-8ac0-0e802e476b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:15.886093 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b70d52-11a3-4f57-8ac0-0e802e476b94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:15.887037 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b70d52-11a3-4f57-8ac0-0e802e476b94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:15.895365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc4609-768b-4810-bf74-3460a4a42773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:15.896326 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc4609-768b-4810-bf74-3460a4a42773 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:15.897026 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b70d52-11a3-4f57-8ac0-0e802e476b94 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:15.900589 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc4609-768b-4810-bf74-3460a4a42773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:15.902512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc4609-768b-4810-bf74-3460a4a42773 admin admin] PATH_INFO: `/v3/projects/026481e0d68b452196fc4e10f4d2cce8/users/1aa7c3c5a4054fe6bddfa1cbc59d666b/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:15.968119 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc4609-768b-4810-bf74-3460a4a42773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=026481e0d68b452196fc4e10f4d2cce8, user_id=1aa7c3c5a4054fe6bddfa1cbc59d666b, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:15.978304 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc4609-768b-4810-bf74-3460a4a42773 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:15.996463 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 861/1717] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:54:15 2022] POST /identity/v3/projects => generated 375 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:54:16.004661 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b70d52-11a3-4f57-8ac0-0e802e476b94 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:16.020507 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 857/1718] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:54:15 2022] PUT /identity/v3/projects/026481e0d68b452196fc4e10f4d2cce8/users/1aa7c3c5a4054fe6bddfa1cbc59d666b/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:16.021995 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc4609-768b-4810-bf74-3460a4a42773 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:16.114313 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:16.211834 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc4609-768b-4810-bf74-3460a4a42773 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:16.228569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6b3e4-9a3e-4940-8596-4605cf967edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:16.230425 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6b3e4-9a3e-4940-8596-4605cf967edc admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:16.230722 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6b3e4-9a3e-4940-8596-4605cf967edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:16.231010 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6b3e4-9a3e-4940-8596-4605cf967edc admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:16.264269 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6b3e4-9a3e-4940-8596-4605cf967edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:16.266240 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6b3e4-9a3e-4940-8596-4605cf967edc admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:16.300322 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b70d52-11a3-4f57-8ac0-0e802e476b94 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:16.319714 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c246809-91cc-4127-8311-5587fd3c7bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:16.321914 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c246809-91cc-4127-8311-5587fd3c7bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:16.322306 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c246809-91cc-4127-8311-5587fd3c7bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:16.322884 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c246809-91cc-4127-8311-5587fd3c7bc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:16.325067 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c246809-91cc-4127-8311-5587fd3c7bc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:16.327703 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c246809-91cc-4127-8311-5587fd3c7bc0 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:16.328325 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 858/1719] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:54:16.329886 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ad3da-91c1-4df7-9200-e57e88eadcca None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:16.330911 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ad3da-91c1-4df7-9200-e57e88eadcca None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:16.331202 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ad3da-91c1-4df7-9200-e57e88eadcca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:16.401569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-a37ad3da-91c1-4df7-9200-e57e88eadcca None None] MFA Rules not processed for user `7e3e3935d57a48f195a568f90ed25a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:16.401876 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 862/1720] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:54:15 2022] POST /identity/v3/users => generated 288 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:54:16.405071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c246809-91cc-4127-8311-5587fd3c7bc0 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:16.410595 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a37ad3da-91c1-4df7-9200-e57e88eadcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:16.439738 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c246809-91cc-4127-8311-5587fd3c7bc0 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:16.459007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3aefb-f43a-4f71-9189-4fa870ac71b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:16.460129 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3aefb-f43a-4f71-9189-4fa870ac71b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:16.460748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3aefb-f43a-4f71-9189-4fa870ac71b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:16.461137 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3aefb-f43a-4f71-9189-4fa870ac71b7 admin admin] PATH_INFO: `/v3/projects/026481e0d68b452196fc4e10f4d2cce8/users/1aa7c3c5a4054fe6bddfa1cbc59d666b/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:16.465313 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a3aefb-f43a-4f71-9189-4fa870ac71b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=026481e0d68b452196fc4e10f4d2cce8, user_id=1aa7c3c5a4054fe6bddfa1cbc59d666b, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:16.469094 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a3aefb-f43a-4f71-9189-4fa870ac71b7 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:16.513990 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 863/1721] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:54:16 2022] PUT /identity/v3/projects/026481e0d68b452196fc4e10f4d2cce8/users/1aa7c3c5a4054fe6bddfa1cbc59d666b/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:16.525461 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3aefb-f43a-4f71-9189-4fa870ac71b7 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:16.651754 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 859/1722] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:16.652997 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a74a91-321a-4e7a-9cc9-bb1d2168881b None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:16.653290 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a74a91-321a-4e7a-9cc9-bb1d2168881b None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:16.653572 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a74a91-321a-4e7a-9cc9-bb1d2168881b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:16.742879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3aefb-f43a-4f71-9189-4fa870ac71b7 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:16.744921 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-09a74a91-321a-4e7a-9cc9-bb1d2168881b None None] MFA Rules not processed for user `1aa7c3c5a4054fe6bddfa1cbc59d666b`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:16.746567 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-09a74a91-321a-4e7a-9cc9-bb1d2168881b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:16.767056 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf1714-0463-443a-8b3d-5f5d7614fc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:16.767980 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf1714-0463-443a-8b3d-5f5d7614fc79 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:16.768434 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf1714-0463-443a-8b3d-5f5d7614fc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:16.768841 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf1714-0463-443a-8b3d-5f5d7614fc79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:16.769715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf1714-0463-443a-8b3d-5f5d7614fc79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:16.771883 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf1714-0463-443a-8b3d-5f5d7614fc79 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:16.818037 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 864/1723] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:54:16.819476 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf1714-0463-443a-8b3d-5f5d7614fc79 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:16.853036 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf1714-0463-443a-8b3d-5f5d7614fc79 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:16.873002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16355ee5-19f3-4823-b70b-8d610f5db1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:16.874114 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16355ee5-19f3-4823-b70b-8d610f5db1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:16.874624 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16355ee5-19f3-4823-b70b-8d610f5db1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:16.875150 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16355ee5-19f3-4823-b70b-8d610f5db1d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:16.876151 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16355ee5-19f3-4823-b70b-8d610f5db1d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:16.878201 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16355ee5-19f3-4823-b70b-8d610f5db1d8 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:16.929123 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 865/1724] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:54:16.930280 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16355ee5-19f3-4823-b70b-8d610f5db1d8 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:16.957711 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 860/1725] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:16.963497 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16355ee5-19f3-4823-b70b-8d610f5db1d8 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:16.973670 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a74a91-321a-4e7a-9cc9-bb1d2168881b None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:16.978487 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-09a74a91-321a-4e7a-9cc9-bb1d2168881b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:16.985733 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048686a9-dc14-41ed-9de5-7d49ba58e9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:16.987094 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048686a9-dc14-41ed-9de5-7d49ba58e9cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:16.987604 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048686a9-dc14-41ed-9de5-7d49ba58e9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:16.988123 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048686a9-dc14-41ed-9de5-7d49ba58e9cd admin admin] PATH_INFO: `/v3/projects/6d68a7112ffc4ead95e98f4d74ff9abc/users/0f589ef92c104b6eaff43692bdc7c2b9/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:16.997038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:17.043524 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048686a9-dc14-41ed-9de5-7d49ba58e9cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d68a7112ffc4ead95e98f4d74ff9abc, user_id=0f589ef92c104b6eaff43692bdc7c2b9, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:17.046493 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048686a9-dc14-41ed-9de5-7d49ba58e9cd admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:17.075970 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 866/1726] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:54:16 2022] PUT /identity/v3/projects/6d68a7112ffc4ead95e98f4d74ff9abc/users/0f589ef92c104b6eaff43692bdc7c2b9/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:17.092722 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e124a8-455e-403e-b52d-94945ea018d6 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:17.093442 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e124a8-455e-403e-b52d-94945ea018d6 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:17.094591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e124a8-455e-403e-b52d-94945ea018d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:17.171034 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-f7e124a8-455e-403e-b52d-94945ea018d6 None None] MFA Rules not processed for user `0f589ef92c104b6eaff43692bdc7c2b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:17.172725 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f7e124a8-455e-403e-b52d-94945ea018d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:17.247743 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a74a91-321a-4e7a-9cc9-bb1d2168881b None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:17.269510 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:17.393119 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 867/1727] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:17.401374 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e124a8-455e-403e-b52d-94945ea018d6 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:17.414847 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de961cca-9f89-4431-b1ab-4ac0891bb599 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:17.415521 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de961cca-9f89-4431-b1ab-4ac0891bb599 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:17.415808 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de961cca-9f89-4431-b1ab-4ac0891bb599 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:17.416085 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de961cca-9f89-4431-b1ab-4ac0891bb599 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:17.569624 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de961cca-9f89-4431-b1ab-4ac0891bb599 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:17.571293 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de961cca-9f89-4431-b1ab-4ac0891bb599 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:17.606861 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 861/1728] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:54:17.647639 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e124a8-455e-403e-b52d-94945ea018d6 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:17.663265 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a42509-ac08-427e-a7d5-e0808354fd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:17.663712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a42509-ac08-427e-a7d5-e0808354fd52 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:17.664225 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a42509-ac08-427e-a7d5-e0808354fd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:17.664507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a42509-ac08-427e-a7d5-e0808354fd52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:17.665242 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a42509-ac08-427e-a7d5-e0808354fd52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:17.667948 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a42509-ac08-427e-a7d5-e0808354fd52 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:17.736928 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 868/1729] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:54:17 2022] POST /identity/v3/projects => generated 375 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:54:17.744397 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a42509-ac08-427e-a7d5-e0808354fd52 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:17.744723 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de961cca-9f89-4431-b1ab-4ac0891bb599 service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:17.843500 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de961cca-9f89-4431-b1ab-4ac0891bb599 service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:17.928422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:17.939623 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a42509-ac08-427e-a7d5-e0808354fd52 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:17.957811 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96269b-2341-459b-bf7f-a0f55fc94f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:17.959258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96269b-2341-459b-bf7f-a0f55fc94f4f admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:17.962473 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96269b-2341-459b-bf7f-a0f55fc94f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:17.963499 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96269b-2341-459b-bf7f-a0f55fc94f4f admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:17.966894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96269b-2341-459b-bf7f-a0f55fc94f4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:17.969802 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96269b-2341-459b-bf7f-a0f55fc94f4f admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:18.021104 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 869/1730] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:54:17 2022] POST /identity/v3/users => generated 294 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:54:18.022861 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96269b-2341-459b-bf7f-a0f55fc94f4f admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:18.056622 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96269b-2341-459b-bf7f-a0f55fc94f4f admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:18.076235 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25bb280-81c0-4369-bab2-a99e5973d959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:18.091829 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bb280-81c0-4369-bab2-a99e5973d959 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:18.092876 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bb280-81c0-4369-bab2-a99e5973d959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:18.119303 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bb280-81c0-4369-bab2-a99e5973d959 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:18.121910 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25bb280-81c0-4369-bab2-a99e5973d959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:18.125349 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25bb280-81c0-4369-bab2-a99e5973d959 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:18.144844 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 870/1731] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:54:18.151038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25bb280-81c0-4369-bab2-a99e5973d959 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:18.179986 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4606ccc-3e4d-4ac2-bd22-66f466ae70dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:18.181258 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4606ccc-3e4d-4ac2-bd22-66f466ae70dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:18.186319 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4606ccc-3e4d-4ac2-bd22-66f466ae70dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:18.186665 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4606ccc-3e4d-4ac2-bd22-66f466ae70dd admin admin] PATH_INFO: `/v3/users/58944a0134754d948cf91d9b079a8eb4` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:18.193986 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25bb280-81c0-4369-bab2-a99e5973d959 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:18.198981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4606ccc-3e4d-4ac2-bd22-66f466ae70dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=58944a0134754d948cf91d9b079a8eb4)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:18.201104 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4606ccc-3e4d-4ac2-bd22-66f466ae70dd admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:18.222751 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60ad41-b10b-4403-8b9d-d18d8a89e7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:18.224062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60ad41-b10b-4403-8b9d-d18d8a89e7fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:18.226050 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60ad41-b10b-4403-8b9d-d18d8a89e7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:18.226050 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60ad41-b10b-4403-8b9d-d18d8a89e7fc admin admin] PATH_INFO: `/v3/projects/7cc35edadd984aa3a32cf2c2bd937c06/users/bf66477099014a73867629e4b899d021/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:18.294445 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60ad41-b10b-4403-8b9d-d18d8a89e7fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cc35edadd984aa3a32cf2c2bd937c06, user_id=bf66477099014a73867629e4b899d021, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:18.314145 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60ad41-b10b-4403-8b9d-d18d8a89e7fc admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:18.376278 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 871/1732] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:54:18 2022] PUT /identity/v3/projects/7cc35edadd984aa3a32cf2c2bd937c06/users/bf66477099014a73867629e4b899d021/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:18.379601 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c4606ccc-3e4d-4ac2-bd22-66f466ae70dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58944a0134754d948cf91d9b079a8eb4'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:18.389800 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60ad41-b10b-4403-8b9d-d18d8a89e7fc admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:18.400427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c4606ccc-3e4d-4ac2-bd22-66f466ae70dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58944a0134754d948cf91d9b079a8eb4'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:18.401339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c4606ccc-3e4d-4ac2-bd22-66f466ae70dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58944a0134754d948cf91d9b079a8eb4'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:18.401748 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c4606ccc-3e4d-4ac2-bd22-66f466ae70dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58944a0134754d948cf91d9b079a8eb4'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:18.415621 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:18.430822 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c4606ccc-3e4d-4ac2-bd22-66f466ae70dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58944a0134754d948cf91d9b079a8eb4'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:18.478018 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 862/1733] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:54:17 2022] DELETE /identity/v3/users/58944a0134754d948cf91d9b079a8eb4 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:18.482303 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1037e-d911-4dd0-9a7f-92c23865e937 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:18.482604 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1037e-d911-4dd0-9a7f-92c23865e937 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:18.483125 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1037e-d911-4dd0-9a7f-92c23865e937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:18.526968 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-50a1037e-d911-4dd0-9a7f-92c23865e937 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:18.535665 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-50a1037e-d911-4dd0-9a7f-92c23865e937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:18.557265 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60ad41-b10b-4403-8b9d-d18d8a89e7fc admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:18.708384 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 863/1734] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:18.716118 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1037e-d911-4dd0-9a7f-92c23865e937 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:18.723666 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-50a1037e-d911-4dd0-9a7f-92c23865e937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:18.744154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53182167-5c84-444e-a17a-03205fbe6d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:18.745470 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53182167-5c84-444e-a17a-03205fbe6d55 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:18.747538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53182167-5c84-444e-a17a-03205fbe6d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:18.748014 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53182167-5c84-444e-a17a-03205fbe6d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:18.751562 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53182167-5c84-444e-a17a-03205fbe6d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:18.758382 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53182167-5c84-444e-a17a-03205fbe6d55 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:18.778107 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 872/1735] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:54:18.783129 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53182167-5c84-444e-a17a-03205fbe6d55 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:18.792421 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-53182167-5c84-444e-a17a-03205fbe6d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:18.810384 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53182167-5c84-444e-a17a-03205fbe6d55 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:18.816997 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0303c8f-3145-40f4-b318-026a8dfcf896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:18.818348 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0303c8f-3145-40f4-b318-026a8dfcf896 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:18.818490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0303c8f-3145-40f4-b318-026a8dfcf896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:18.818754 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0303c8f-3145-40f4-b318-026a8dfcf896 admin admin] PATH_INFO: `/v3/projects/7cc35edadd984aa3a32cf2c2bd937c06/users/bf66477099014a73867629e4b899d021/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:18.823697 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0303c8f-3145-40f4-b318-026a8dfcf896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cc35edadd984aa3a32cf2c2bd937c06, user_id=bf66477099014a73867629e4b899d021, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:18.826452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0303c8f-3145-40f4-b318-026a8dfcf896 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:18.851490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 873/1736] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:54:18 2022] PUT /identity/v3/projects/7cc35edadd984aa3a32cf2c2bd937c06/users/bf66477099014a73867629e4b899d021/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:18.864705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cb1dc-702b-4317-8681-775f8c168185 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:18.864992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cb1dc-702b-4317-8681-775f8c168185 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:18.865345 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cb1dc-702b-4317-8681-775f8c168185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:18.928456 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1037e-d911-4dd0-9a7f-92c23865e937 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:18.990825 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-030cb1dc-702b-4317-8681-775f8c168185 None None] MFA Rules not processed for user `bf66477099014a73867629e4b899d021`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:18.992221 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-030cb1dc-702b-4317-8681-775f8c168185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:19.089703 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc90d9-aa0a-4d0a-8864-aa776730f780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:19.090494 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc90d9-aa0a-4d0a-8864-aa776730f780 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:19.090703 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc90d9-aa0a-4d0a-8864-aa776730f780 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:19.091843 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc90d9-aa0a-4d0a-8864-aa776730f780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:19.138861 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:19.234846 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 874/1737] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:54:19.247227 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cb1dc-702b-4317-8681-775f8c168185 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:19.250379 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-030cb1dc-702b-4317-8681-775f8c168185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:19.263225 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:19.300930 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc90d9-aa0a-4d0a-8864-aa776730f780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:19.305358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc90d9-aa0a-4d0a-8864-aa776730f780 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:19.352227 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 864/1738] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:54:19.600501 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cb1dc-702b-4317-8681-775f8c168185 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:19.617704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4d911-4c8c-4418-a376-57ffbe768c40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:19.618676 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4d911-4c8c-4418-a376-57ffbe768c40 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:19.619107 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4d911-4c8c-4418-a376-57ffbe768c40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:19.619527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4d911-4c8c-4418-a376-57ffbe768c40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:19.621576 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-dbd4d911-4c8c-4418-a376-57ffbe768c40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:19.823808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4d911-4c8c-4418-a376-57ffbe768c40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:19.824879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4d911-4c8c-4418-a376-57ffbe768c40 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:19.848556 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 875/1739] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:54:19.910637 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc90d9-aa0a-4d0a-8864-aa776730f780 service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:19.920709 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-dcdc90d9-aa0a-4d0a-8864-aa776730f780 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:19.943094 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc90d9-aa0a-4d0a-8864-aa776730f780 service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:19.951055 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e4b80-65a1-4916-8afc-bf6849d728e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:19.952567 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e4b80-65a1-4916-8afc-bf6849d728e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:19.953713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e4b80-65a1-4916-8afc-bf6849d728e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:19.954273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e4b80-65a1-4916-8afc-bf6849d728e5 admin admin] PATH_INFO: `/v3/projects/7f9cd000cc014a1da028d8a0fb3186ab` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:19.956662 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e4b80-65a1-4916-8afc-bf6849d728e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f9cd000cc014a1da028d8a0fb3186ab)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:19.959277 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e4b80-65a1-4916-8afc-bf6849d728e5 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:20.030195 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1a0e4b80-65a1-4916-8afc-bf6849d728e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f9cd000cc014a1da028d8a0fb3186ab', 'request_id': 'req-1a0e4b80-65a1-4916-8afc-bf6849d728e5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:20.040651 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1a0e4b80-65a1-4916-8afc-bf6849d728e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f9cd000cc014a1da028d8a0fb3186ab', 'request_id': 'req-1a0e4b80-65a1-4916-8afc-bf6849d728e5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:20.049706 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1a0e4b80-65a1-4916-8afc-bf6849d728e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f9cd000cc014a1da028d8a0fb3186ab', 'request_id': 'req-1a0e4b80-65a1-4916-8afc-bf6849d728e5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:20.065667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1a0e4b80-65a1-4916-8afc-bf6849d728e5 admin admin] The token cache is being invalidate because project 7f9cd000cc014a1da028d8a0fb3186ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:54:20.066284 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1a0e4b80-65a1-4916-8afc-bf6849d728e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:20.067379 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1a0e4b80-65a1-4916-8afc-bf6849d728e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:20.070521 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 865/1740] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:54:19 2022] DELETE /identity/v3/projects/7f9cd000cc014a1da028d8a0fb3186ab => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:20.075876 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4d911-4c8c-4418-a376-57ffbe768c40 service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:20.092064 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4d911-4c8c-4418-a376-57ffbe768c40 service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:20.271805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcb388-d50d-429e-8a43-07bee2d3ad02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:20.274785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcb388-d50d-429e-8a43-07bee2d3ad02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:20.275947 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcb388-d50d-429e-8a43-07bee2d3ad02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:20.276439 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcb388-d50d-429e-8a43-07bee2d3ad02 admin admin] PATH_INFO: `/v3/users/1aa7c3c5a4054fe6bddfa1cbc59d666b` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:20.279194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dcb388-d50d-429e-8a43-07bee2d3ad02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aa7c3c5a4054fe6bddfa1cbc59d666b)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:20.284666 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dcb388-d50d-429e-8a43-07bee2d3ad02 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:20.357717 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:20.424344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a4dcb388-d50d-429e-8a43-07bee2d3ad02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aa7c3c5a4054fe6bddfa1cbc59d666b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:20.463298 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a4dcb388-d50d-429e-8a43-07bee2d3ad02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aa7c3c5a4054fe6bddfa1cbc59d666b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:20.464426 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a4dcb388-d50d-429e-8a43-07bee2d3ad02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aa7c3c5a4054fe6bddfa1cbc59d666b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:20.486379 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a4dcb388-d50d-429e-8a43-07bee2d3ad02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aa7c3c5a4054fe6bddfa1cbc59d666b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:20.509140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a4dcb388-d50d-429e-8a43-07bee2d3ad02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aa7c3c5a4054fe6bddfa1cbc59d666b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:20.522990 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 876/1741] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:54:20 2022] DELETE /identity/v3/users/1aa7c3c5a4054fe6bddfa1cbc59d666b => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:21.091832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd527066-2119-4c26-aab0-82d8ac564dd5 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:21.092370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd527066-2119-4c26-aab0-82d8ac564dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:21.092370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd527066-2119-4c26-aab0-82d8ac564dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:21.120107 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-dd527066-2119-4c26-aab0-82d8ac564dd5 None None] MFA Rules not processed for user `abd380b05ae94a29bdf56c529f1d411e`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:21.121188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-dd527066-2119-4c26-aab0-82d8ac564dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:21.335851 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 866/1742] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:21.392417 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149d89c-5652-4111-b90d-ca585274726e None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:21.392881 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149d89c-5652-4111-b90d-ca585274726e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:21.392985 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149d89c-5652-4111-b90d-ca585274726e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:21.479129 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-9149d89c-5652-4111-b90d-ca585274726e None None] MFA Rules not processed for user `af8e0eb5ff8c40ae848929780d99e72d`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:21.484270 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9149d89c-5652-4111-b90d-ca585274726e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:21.629863 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 877/1743] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jun 21 05:54:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:21.874005 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd527066-2119-4c26-aab0-82d8ac564dd5 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:21.877338 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-dd527066-2119-4c26-aab0-82d8ac564dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:22.105858 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd527066-2119-4c26-aab0-82d8ac564dd5 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:22.120669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77245d94-d28e-48dc-b70a-4a51d0b4ba24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac485a336d8b4360bce4f495bd02dbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:22.122127 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77245d94-d28e-48dc-b70a-4a51d0b4ba24 service swift] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:22.122522 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77245d94-d28e-48dc-b70a-4a51d0b4ba24 service swift] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:22.122804 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77245d94-d28e-48dc-b70a-4a51d0b4ba24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:22.155973 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77245d94-d28e-48dc-b70a-4a51d0b4ba24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:22.159717 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77245d94-d28e-48dc-b70a-4a51d0b4ba24 service swift] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:22.186722 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 867/1744] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 21 05:54:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 05:54:22.493200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149d89c-5652-4111-b90d-ca585274726e None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:22.495496 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9149d89c-5652-4111-b90d-ca585274726e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:22.659364 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149d89c-5652-4111-b90d-ca585274726e None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:22.676054 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ba6e6-5c4c-46ed-9c60-2f400b6febe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:22.676947 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ba6e6-5c4c-46ed-9c60-2f400b6febe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:22.677234 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ba6e6-5c4c-46ed-9c60-2f400b6febe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:22.677516 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ba6e6-5c4c-46ed-9c60-2f400b6febe2 admin admin] PATH_INFO: `/v3/projects/026481e0d68b452196fc4e10f4d2cce8` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:22.679267 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ba6e6-5c4c-46ed-9c60-2f400b6febe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=026481e0d68b452196fc4e10f4d2cce8)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:22.686644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ba6e6-5c4c-46ed-9c60-2f400b6febe2 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:22.742765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207fcaf-bb10-497e-80a3-1404039cc98d None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:22.743336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207fcaf-bb10-497e-80a3-1404039cc98d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:22.743798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207fcaf-bb10-497e-80a3-1404039cc98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:22.757409 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:22.782808 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-f207fcaf-bb10-497e-80a3-1404039cc98d None None] MFA Rules not processed for user `f4cd1d7c5a4a4b658f7abf8e434cf716`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:22.784586 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f207fcaf-bb10-497e-80a3-1404039cc98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:22.836815 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:22.851510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e43ba6e6-5c4c-46ed-9c60-2f400b6febe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '026481e0d68b452196fc4e10f4d2cce8', 'request_id': 'req-e43ba6e6-5c4c-46ed-9c60-2f400b6febe2'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:22.868538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e43ba6e6-5c4c-46ed-9c60-2f400b6febe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '026481e0d68b452196fc4e10f4d2cce8', 'request_id': 'req-e43ba6e6-5c4c-46ed-9c60-2f400b6febe2'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:22.883658 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e43ba6e6-5c4c-46ed-9c60-2f400b6febe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '026481e0d68b452196fc4e10f4d2cce8', 'request_id': 'req-e43ba6e6-5c4c-46ed-9c60-2f400b6febe2'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:22.913807 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e43ba6e6-5c4c-46ed-9c60-2f400b6febe2 admin admin] The token cache is being invalidate because project 026481e0d68b452196fc4e10f4d2cce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:54:22.914149 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e43ba6e6-5c4c-46ed-9c60-2f400b6febe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:22.915431 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e43ba6e6-5c4c-46ed-9c60-2f400b6febe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:22.918475 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 878/1745] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:54:22 2022] DELETE /identity/v3/projects/026481e0d68b452196fc4e10f4d2cce8 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:22.928893 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381e772-7d0e-45a5-a6cd-3197a1c2e943 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:22.929188 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381e772-7d0e-45a5-a6cd-3197a1c2e943 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:22.929479 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381e772-7d0e-45a5-a6cd-3197a1c2e943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:22.966014 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 868/1746] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:22.970420 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-e381e772-7d0e-45a5-a6cd-3197a1c2e943 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:22.971718 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e381e772-7d0e-45a5-a6cd-3197a1c2e943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:23.160930 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 879/1747] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:23.168868 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff60705-812c-4300-85ee-14ef31cd35c3 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:23.169754 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff60705-812c-4300-85ee-14ef31cd35c3 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:23.170238 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff60705-812c-4300-85ee-14ef31cd35c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:23.215871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-5ff60705-812c-4300-85ee-14ef31cd35c3 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:23.219401 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5ff60705-812c-4300-85ee-14ef31cd35c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:23.240819 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 869/1748] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:23.245605 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381e772-7d0e-45a5-a6cd-3197a1c2e943 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:23.262249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381e772-7d0e-45a5-a6cd-3197a1c2e943 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:23.276644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5247cb-dc20-47f6-aee7-58e8dcce55ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:23.278744 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5247cb-dc20-47f6-aee7-58e8dcce55ec admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:23.280159 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5247cb-dc20-47f6-aee7-58e8dcce55ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:23.280452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5247cb-dc20-47f6-aee7-58e8dcce55ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:23.283495 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5247cb-dc20-47f6-aee7-58e8dcce55ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:54:23.284222 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5247cb-dc20-47f6-aee7-58e8dcce55ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:23.289130 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5247cb-dc20-47f6-aee7-58e8dcce55ec admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:23.334593 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 880/1749] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:54:23.334942 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff60705-812c-4300-85ee-14ef31cd35c3 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:23.344872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff60705-812c-4300-85ee-14ef31cd35c3 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:23.363433 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7ed2e-1867-44b3-bdcc-a2157b1373c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:23.364517 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7ed2e-1867-44b3-bdcc-a2157b1373c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:23.364984 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7ed2e-1867-44b3-bdcc-a2157b1373c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:23.365442 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7ed2e-1867-44b3-bdcc-a2157b1373c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:23.366416 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7ed2e-1867-44b3-bdcc-a2157b1373c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:23.370181 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7ed2e-1867-44b3-bdcc-a2157b1373c8 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:23.438331 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 870/1750] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:54:23 2022] POST /identity/v3/projects => generated 393 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 05:54:23.442946 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5247cb-dc20-47f6-aee7-58e8dcce55ec admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:23.455974 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5247cb-dc20-47f6-aee7-58e8dcce55ec admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:23.752299 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1d1d8-9cc8-4110-906d-5ae50a665453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:23.753110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1d1d8-9cc8-4110-906d-5ae50a665453 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:23.754246 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1d1d8-9cc8-4110-906d-5ae50a665453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:23.755110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1d1d8-9cc8-4110-906d-5ae50a665453 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:23.756415 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1d1d8-9cc8-4110-906d-5ae50a665453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:23.760372 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1d1d8-9cc8-4110-906d-5ae50a665453 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:23.830374 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 881/1751] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:54:23 2022] POST /identity/v3/users => generated 297 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:54:23.831905 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7ed2e-1867-44b3-bdcc-a2157b1373c8 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:23.842547 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7ed2e-1867-44b3-bdcc-a2157b1373c8 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:23.871552 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399fb416-64c5-4b5e-86a5-9a2a1df5d9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:23.872234 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399fb416-64c5-4b5e-86a5-9a2a1df5d9fb admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:23.872731 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399fb416-64c5-4b5e-86a5-9a2a1df5d9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:23.873184 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399fb416-64c5-4b5e-86a5-9a2a1df5d9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:23.874114 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399fb416-64c5-4b5e-86a5-9a2a1df5d9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:23.876390 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399fb416-64c5-4b5e-86a5-9a2a1df5d9fb admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:23.900448 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 871/1752] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:54:23.904422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1d1d8-9cc8-4110-906d-5ae50a665453 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:23.919387 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1d1d8-9cc8-4110-906d-5ae50a665453 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:23.939427 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0e18e-0f97-4570-8342-260e1bdfe1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:23.940197 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0e18e-0f97-4570-8342-260e1bdfe1a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:23.940578 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0e18e-0f97-4570-8342-260e1bdfe1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:23.940819 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0e18e-0f97-4570-8342-260e1bdfe1a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:23.941631 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0e18e-0f97-4570-8342-260e1bdfe1a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:23.943285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0e18e-0f97-4570-8342-260e1bdfe1a5 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:23.972925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 882/1753] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:54:23.975180 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399fb416-64c5-4b5e-86a5-9a2a1df5d9fb admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:23.988653 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399fb416-64c5-4b5e-86a5-9a2a1df5d9fb admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:24.010111 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efbb8e-acf0-42e9-8ac2-ea2e7e47b4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:24.017470 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efbb8e-acf0-42e9-8ac2-ea2e7e47b4d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:24.018104 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efbb8e-acf0-42e9-8ac2-ea2e7e47b4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:24.018593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efbb8e-acf0-42e9-8ac2-ea2e7e47b4d6 admin admin] PATH_INFO: `/v3/projects/36b055c585ec4ac896ceddb780966cdf/users/c8423e24aa9d4d84b6729077df105c08/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:24.056937 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efbb8e-acf0-42e9-8ac2-ea2e7e47b4d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36b055c585ec4ac896ceddb780966cdf, user_id=c8423e24aa9d4d84b6729077df105c08, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:24.059876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efbb8e-acf0-42e9-8ac2-ea2e7e47b4d6 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:24.087060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 872/1754] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:54:23 2022] PUT /identity/v3/projects/36b055c585ec4ac896ceddb780966cdf/users/c8423e24aa9d4d84b6729077df105c08/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:24.099960 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f99d88-bfae-4bda-ad1d-4e1d4ffe5286 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:24.104084 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f99d88-bfae-4bda-ad1d-4e1d4ffe5286 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:24.104084 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f99d88-bfae-4bda-ad1d-4e1d4ffe5286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:24.177909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-06f99d88-bfae-4bda-ad1d-4e1d4ffe5286 None None] MFA Rules not processed for user `c8423e24aa9d4d84b6729077df105c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:24.182656 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-06f99d88-bfae-4bda-ad1d-4e1d4ffe5286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:24.306369 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384b333-e084-421d-b725-cdca9304dd61 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:24.307347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384b333-e084-421d-b725-cdca9304dd61 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:24.307832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384b333-e084-421d-b725-cdca9304dd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:24.312679 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:24.379071 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-3384b333-e084-421d-b725-cdca9304dd61 None None] MFA Rules not processed for user `51e845d0dc2c4a1fa612556c1aa73ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:24.382481 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3384b333-e084-421d-b725-cdca9304dd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:24.496272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 883/1755] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:24.503151 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f99d88-bfae-4bda-ad1d-4e1d4ffe5286 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:24.716381 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 873/1756] 10.222.0.23 () {58 vars in 1015 bytes} [Tue Jun 21 05:54:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:24.767936 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f99d88-bfae-4bda-ad1d-4e1d4ffe5286 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:24.782571 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68f241-dc46-4dd4-8be8-da3eb8b6f491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:24.783506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68f241-dc46-4dd4-8be8-da3eb8b6f491 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:24.783506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68f241-dc46-4dd4-8be8-da3eb8b6f491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:24.783807 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68f241-dc46-4dd4-8be8-da3eb8b6f491 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:24.784519 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68f241-dc46-4dd4-8be8-da3eb8b6f491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:24.786513 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68f241-dc46-4dd4-8be8-da3eb8b6f491 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:24.854439 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 884/1757] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:54:24 2022] POST /identity/v3/projects => generated 393 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:54:24.855875 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384b333-e084-421d-b725-cdca9304dd61 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:24.887188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384b333-e084-421d-b725-cdca9304dd61 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:25.048281 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:25.080265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e2d32-b4f9-442f-b239-2a27d42cccb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:25.085126 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e2d32-b4f9-442f-b239-2a27d42cccb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:25.085773 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e2d32-b4f9-442f-b239-2a27d42cccb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:25.086226 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e2d32-b4f9-442f-b239-2a27d42cccb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:25.087160 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e2d32-b4f9-442f-b239-2a27d42cccb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:25.096547 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e2d32-b4f9-442f-b239-2a27d42cccb1 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:25.150483 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 874/1758] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:54:24 2022] POST /identity/v3/users => generated 303 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:54:25.152892 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68f241-dc46-4dd4-8be8-da3eb8b6f491 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:25.174059 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68f241-dc46-4dd4-8be8-da3eb8b6f491 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:25.192356 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c2278-db64-4c81-9ee3-1ba5639a030c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:25.193137 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c2278-db64-4c81-9ee3-1ba5639a030c admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:25.193575 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c2278-db64-4c81-9ee3-1ba5639a030c admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:25.193985 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c2278-db64-4c81-9ee3-1ba5639a030c admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:25.194809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c2278-db64-4c81-9ee3-1ba5639a030c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:25.196731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c2278-db64-4c81-9ee3-1ba5639a030c admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:25.226182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 885/1759] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:54:25.231048 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e2d32-b4f9-442f-b239-2a27d42cccb1 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:25.250237 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e2d32-b4f9-442f-b239-2a27d42cccb1 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:25.259748 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c0c38-deb6-400c-9a63-615b026bdc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:25.260707 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c0c38-deb6-400c-9a63-615b026bdc4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:25.260927 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c0c38-deb6-400c-9a63-615b026bdc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:25.261210 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c0c38-deb6-400c-9a63-615b026bdc4b admin admin] PATH_INFO: `/v3/projects/29b5d3424ee6453886e26d4c09f11dac/users/4ff9b695a2894735b413d63fe252b176/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:25.300841 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c0c38-deb6-400c-9a63-615b026bdc4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b5d3424ee6453886e26d4c09f11dac, user_id=4ff9b695a2894735b413d63fe252b176, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:25.304650 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c0c38-deb6-400c-9a63-615b026bdc4b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:25.344970 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 875/1760] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:54:25 2022] PUT /identity/v3/projects/29b5d3424ee6453886e26d4c09f11dac/users/4ff9b695a2894735b413d63fe252b176/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 05:54:25.348776 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c2278-db64-4c81-9ee3-1ba5639a030c admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:25.367084 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c2278-db64-4c81-9ee3-1ba5639a030c admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:25.551544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86613e6c-a88d-445c-9f4d-c5498a76b417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:25.554125 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86613e6c-a88d-445c-9f4d-c5498a76b417 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:25.554661 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86613e6c-a88d-445c-9f4d-c5498a76b417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:25.555082 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86613e6c-a88d-445c-9f4d-c5498a76b417 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:25.556342 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86613e6c-a88d-445c-9f4d-c5498a76b417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:25.558540 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86613e6c-a88d-445c-9f4d-c5498a76b417 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:25.586472 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c0c38-deb6-400c-9a63-615b026bdc4b admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:25.587849 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 886/1761] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:54:25.614571 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c0c38-deb6-400c-9a63-615b026bdc4b admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:25.621458 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e023b-234e-4065-93f9-1357f0374e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:25.623167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e023b-234e-4065-93f9-1357f0374e71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:25.623743 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e023b-234e-4065-93f9-1357f0374e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:25.624242 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e023b-234e-4065-93f9-1357f0374e71 admin admin] PATH_INFO: `/v3/projects/29b5d3424ee6453886e26d4c09f11dac/users/4ff9b695a2894735b413d63fe252b176/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:25.627269 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e023b-234e-4065-93f9-1357f0374e71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b5d3424ee6453886e26d4c09f11dac, user_id=4ff9b695a2894735b413d63fe252b176, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:25.637781 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e023b-234e-4065-93f9-1357f0374e71 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:25.677629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 876/1762] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:54:25 2022] PUT /identity/v3/projects/29b5d3424ee6453886e26d4c09f11dac/users/4ff9b695a2894735b413d63fe252b176/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:25.679919 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b490f-63a7-4c70-a4a5-7a942616f391 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:25.680209 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b490f-63a7-4c70-a4a5-7a942616f391 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:25.680493 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b490f-63a7-4c70-a4a5-7a942616f391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:25.730202 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-598b490f-63a7-4c70-a4a5-7a942616f391 None None] MFA Rules not processed for user `4ff9b695a2894735b413d63fe252b176`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:25.732656 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-598b490f-63a7-4c70-a4a5-7a942616f391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:25.782317 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:25.849995 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 887/1763] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:25.865493 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e023b-234e-4065-93f9-1357f0374e71 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:25.867791 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-360e023b-234e-4065-93f9-1357f0374e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:25.946526 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e023b-234e-4065-93f9-1357f0374e71 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:25.950888 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d54e07-e1bb-4d7d-b767-5347ee7885ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:25.953206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d54e07-e1bb-4d7d-b767-5347ee7885ac service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:25.953206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d54e07-e1bb-4d7d-b767-5347ee7885ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:25.953206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d54e07-e1bb-4d7d-b767-5347ee7885ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:25.972244 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d54e07-e1bb-4d7d-b767-5347ee7885ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:25.975682 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d54e07-e1bb-4d7d-b767-5347ee7885ac service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:26.012442 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 877/1764] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:54:26.109001 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b490f-63a7-4c70-a4a5-7a942616f391 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:26.110372 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-598b490f-63a7-4c70-a4a5-7a942616f391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:26.127241 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b490f-63a7-4c70-a4a5-7a942616f391 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:26.139093 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b79d7b-1ade-474f-afab-4bd423793a9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:26.139794 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b79d7b-1ade-474f-afab-4bd423793a9b service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:26.140622 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b79d7b-1ade-474f-afab-4bd423793a9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:26.140905 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b79d7b-1ade-474f-afab-4bd423793a9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:26.279920 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b79d7b-1ade-474f-afab-4bd423793a9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:26.281972 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b79d7b-1ade-474f-afab-4bd423793a9b service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:26.295346 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 888/1765] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:54:27.312607 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d54e07-e1bb-4d7d-b767-5347ee7885ac service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:27.325591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d54e07-e1bb-4d7d-b767-5347ee7885ac service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:27.355262 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489fe1b-1b84-472c-8003-440f2a0ed0b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:27.356452 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489fe1b-1b84-472c-8003-440f2a0ed0b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:27.360805 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489fe1b-1b84-472c-8003-440f2a0ed0b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:27.361418 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489fe1b-1b84-472c-8003-440f2a0ed0b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:27.368360 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-4489fe1b-1b84-472c-8003-440f2a0ed0b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:27.604722 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4489fe1b-1b84-472c-8003-440f2a0ed0b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:27.606632 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4489fe1b-1b84-472c-8003-440f2a0ed0b1 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:27.647744 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 878/1766] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:27 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:54:32.192712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b79d7b-1ade-474f-afab-4bd423793a9b service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:32.306245 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b79d7b-1ade-474f-afab-4bd423793a9b service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:32.317126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384e4cb-3c6e-4c5e-a6d2-9e7c326b3914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:32.322743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384e4cb-3c6e-4c5e-a6d2-9e7c326b3914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:32.323138 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384e4cb-3c6e-4c5e-a6d2-9e7c326b3914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:32.323320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384e4cb-3c6e-4c5e-a6d2-9e7c326b3914 admin admin] PATH_INFO: `/v3/users/c8423e24aa9d4d84b6729077df105c08` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:32.325158 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384e4cb-3c6e-4c5e-a6d2-9e7c326b3914 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8423e24aa9d4d84b6729077df105c08)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:32.328504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384e4cb-3c6e-4c5e-a6d2-9e7c326b3914 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:32.386303 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8384e4cb-3c6e-4c5e-a6d2-9e7c326b3914 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8423e24aa9d4d84b6729077df105c08'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:32.396490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8384e4cb-3c6e-4c5e-a6d2-9e7c326b3914 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8423e24aa9d4d84b6729077df105c08'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:32.397354 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8384e4cb-3c6e-4c5e-a6d2-9e7c326b3914 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8423e24aa9d4d84b6729077df105c08'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:32.419743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8384e4cb-3c6e-4c5e-a6d2-9e7c326b3914 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8423e24aa9d4d84b6729077df105c08'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:32.428528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:32.449525 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8384e4cb-3c6e-4c5e-a6d2-9e7c326b3914 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8423e24aa9d4d84b6729077df105c08'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:32.458103 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 889/1767] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:54:32 2022] DELETE /identity/v3/users/c8423e24aa9d4d84b6729077df105c08 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:32.462645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1ad80-c4e6-4dcb-8425-126800ccde11 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:32.463157 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1ad80-c4e6-4dcb-8425-126800ccde11 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:32.463316 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1ad80-c4e6-4dcb-8425-126800ccde11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:32.482719 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-3fe1ad80-c4e6-4dcb-8425-126800ccde11 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:32.484079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3fe1ad80-c4e6-4dcb-8425-126800ccde11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:32.544126 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:32.568594 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 879/1768] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:32.583800 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384e4cb-3c6e-4c5e-a6d2-9e7c326b3914 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:32.586571 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-8384e4cb-3c6e-4c5e-a6d2-9e7c326b3914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:32.690278 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384e4cb-3c6e-4c5e-a6d2-9e7c326b3914 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:32.698590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d3f51-f17e-42a8-aa64-daf62c48f83e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:32.699256 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d3f51-f17e-42a8-aa64-daf62c48f83e service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:32.699490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d3f51-f17e-42a8-aa64-daf62c48f83e service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:32.699770 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d3f51-f17e-42a8-aa64-daf62c48f83e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:32.711521 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d3f51-f17e-42a8-aa64-daf62c48f83e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:32.713148 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d3f51-f17e-42a8-aa64-daf62c48f83e service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:32.729162 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 890/1769] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:54:33.324283 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1ad80-c4e6-4dcb-8425-126800ccde11 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:33.326818 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3fe1ad80-c4e6-4dcb-8425-126800ccde11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:33.362806 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1ad80-c4e6-4dcb-8425-126800ccde11 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:33.377480 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61bb2e-b116-4ed2-8c6d-5fd999f12018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:33.378395 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61bb2e-b116-4ed2-8c6d-5fd999f12018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:33.378677 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61bb2e-b116-4ed2-8c6d-5fd999f12018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:33.378949 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61bb2e-b116-4ed2-8c6d-5fd999f12018 admin admin] PATH_INFO: `/v3/projects/36b055c585ec4ac896ceddb780966cdf` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:33.380336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61bb2e-b116-4ed2-8c6d-5fd999f12018 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36b055c585ec4ac896ceddb780966cdf)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:33.388737 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61bb2e-b116-4ed2-8c6d-5fd999f12018 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:33.475326 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7c61bb2e-b116-4ed2-8c6d-5fd999f12018 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36b055c585ec4ac896ceddb780966cdf', 'request_id': 'req-7c61bb2e-b116-4ed2-8c6d-5fd999f12018'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:33.491669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7c61bb2e-b116-4ed2-8c6d-5fd999f12018 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36b055c585ec4ac896ceddb780966cdf', 'request_id': 'req-7c61bb2e-b116-4ed2-8c6d-5fd999f12018'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:33.500089 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7c61bb2e-b116-4ed2-8c6d-5fd999f12018 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36b055c585ec4ac896ceddb780966cdf', 'request_id': 'req-7c61bb2e-b116-4ed2-8c6d-5fd999f12018'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:33.518380 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7c61bb2e-b116-4ed2-8c6d-5fd999f12018 admin admin] The token cache is being invalidate because project 36b055c585ec4ac896ceddb780966cdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:54:33.518673 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7c61bb2e-b116-4ed2-8c6d-5fd999f12018 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:33.519511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7c61bb2e-b116-4ed2-8c6d-5fd999f12018 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:33.521165 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 880/1770] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:54:33 2022] DELETE /identity/v3/projects/36b055c585ec4ac896ceddb780966cdf => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:33.528456 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d3f51-f17e-42a8-aa64-daf62c48f83e service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:33.537527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d3f51-f17e-42a8-aa64-daf62c48f83e service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:33.628320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590572a9-d64f-4d29-ba4a-121e5de50f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:33.629227 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590572a9-d64f-4d29-ba4a-121e5de50f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:33.629490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590572a9-d64f-4d29-ba4a-121e5de50f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:33.629787 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590572a9-d64f-4d29-ba4a-121e5de50f4d admin admin] PATH_INFO: `/v3/users/4ff9b695a2894735b413d63fe252b176` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:33.631504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590572a9-d64f-4d29-ba4a-121e5de50f4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ff9b695a2894735b413d63fe252b176)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:33.634693 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590572a9-d64f-4d29-ba4a-121e5de50f4d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:33.691420 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-590572a9-d64f-4d29-ba4a-121e5de50f4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ff9b695a2894735b413d63fe252b176'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:33.698789 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-590572a9-d64f-4d29-ba4a-121e5de50f4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ff9b695a2894735b413d63fe252b176'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:33.699605 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-590572a9-d64f-4d29-ba4a-121e5de50f4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ff9b695a2894735b413d63fe252b176'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:33.709279 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-590572a9-d64f-4d29-ba4a-121e5de50f4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ff9b695a2894735b413d63fe252b176'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:33.727487 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-590572a9-d64f-4d29-ba4a-121e5de50f4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ff9b695a2894735b413d63fe252b176'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:33.734153 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 891/1771] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:54:33 2022] DELETE /identity/v3/users/4ff9b695a2894735b413d63fe252b176 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:34.294317 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61bb2e-b116-4ed2-8c6d-5fd999f12018 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:34.297052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-7c61bb2e-b116-4ed2-8c6d-5fd999f12018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:34.334879 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61bb2e-b116-4ed2-8c6d-5fd999f12018 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:34.554203 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9922a5-5c03-4c09-920c-537d7343238c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:34.557428 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9922a5-5c03-4c09-920c-537d7343238c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:34.557852 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9922a5-5c03-4c09-920c-537d7343238c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:34.558381 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9922a5-5c03-4c09-920c-537d7343238c admin admin] PATH_INFO: `/v3/projects/29b5d3424ee6453886e26d4c09f11dac` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:34.565623 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9922a5-5c03-4c09-920c-537d7343238c admin admin] RBAC: Authorizing `identity:delete_project(project_id=29b5d3424ee6453886e26d4c09f11dac)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:34.565623 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9922a5-5c03-4c09-920c-537d7343238c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:34.669704 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-af9922a5-5c03-4c09-920c-537d7343238c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29b5d3424ee6453886e26d4c09f11dac', 'request_id': 'req-af9922a5-5c03-4c09-920c-537d7343238c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:34.680537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-af9922a5-5c03-4c09-920c-537d7343238c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29b5d3424ee6453886e26d4c09f11dac', 'request_id': 'req-af9922a5-5c03-4c09-920c-537d7343238c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:34.689609 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-af9922a5-5c03-4c09-920c-537d7343238c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29b5d3424ee6453886e26d4c09f11dac', 'request_id': 'req-af9922a5-5c03-4c09-920c-537d7343238c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:34.698258 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:34.704398 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-af9922a5-5c03-4c09-920c-537d7343238c admin admin] The token cache is being invalidate because project 29b5d3424ee6453886e26d4c09f11dac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:54:34.705066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-af9922a5-5c03-4c09-920c-537d7343238c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:34.706564 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-af9922a5-5c03-4c09-920c-537d7343238c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:34.712464 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 881/1772] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:54:34 2022] DELETE /identity/v3/projects/29b5d3424ee6453886e26d4c09f11dac => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:34.714314 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3c141-7a54-4550-959a-1a41e4ca7172 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:34.715005 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3c141-7a54-4550-959a-1a41e4ca7172 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:34.715005 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3c141-7a54-4550-959a-1a41e4ca7172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:34.730182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:34.741329 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-5ae3c141-7a54-4550-959a-1a41e4ca7172 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:34.743098 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-5ae3c141-7a54-4550-959a-1a41e4ca7172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:34.810832 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 892/1773] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:34.818377 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9854796-e269-4d32-bf35-acebb2f4c410 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:34.818664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9854796-e269-4d32-bf35-acebb2f4c410 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:34.818940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9854796-e269-4d32-bf35-acebb2f4c410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:34.846513 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-b9854796-e269-4d32-bf35-acebb2f4c410 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:34.847215 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b9854796-e269-4d32-bf35-acebb2f4c410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:34.857632 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 882/1774] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:34.864127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3c141-7a54-4550-959a-1a41e4ca7172 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:34.874911 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3c141-7a54-4550-959a-1a41e4ca7172 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:34.879569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e07a26-a2b4-427b-9054-5917463829d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:34.880292 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e07a26-a2b4-427b-9054-5917463829d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:34.880575 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e07a26-a2b4-427b-9054-5917463829d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:34.880867 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e07a26-a2b4-427b-9054-5917463829d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:34.881602 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e07a26-a2b4-427b-9054-5917463829d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:54:34.881909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e07a26-a2b4-427b-9054-5917463829d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:34.883758 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e07a26-a2b4-427b-9054-5917463829d4 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:34.901982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 893/1775] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:54:34.905055 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9854796-e269-4d32-bf35-acebb2f4c410 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:34.915084 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9854796-e269-4d32-bf35-acebb2f4c410 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:34.919857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26515f4-4040-4b8c-81ff-bedc0f0a7a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:34.920514 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26515f4-4040-4b8c-81ff-bedc0f0a7a52 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:34.920824 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26515f4-4040-4b8c-81ff-bedc0f0a7a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:34.921100 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26515f4-4040-4b8c-81ff-bedc0f0a7a52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:34.921808 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26515f4-4040-4b8c-81ff-bedc0f0a7a52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:34.923730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26515f4-4040-4b8c-81ff-bedc0f0a7a52 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:34.960209 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 883/1776] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:54:34 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:54:34.961524 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e07a26-a2b4-427b-9054-5917463829d4 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:34.972164 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e07a26-a2b4-427b-9054-5917463829d4 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:35.031576 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d3e41-2a4b-4347-8d5e-054eb1868611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:35.032258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d3e41-2a4b-4347-8d5e-054eb1868611 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:35.032544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d3e41-2a4b-4347-8d5e-054eb1868611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:35.032825 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d3e41-2a4b-4347-8d5e-054eb1868611 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:35.033525 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d3e41-2a4b-4347-8d5e-054eb1868611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:35.035473 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d3e41-2a4b-4347-8d5e-054eb1868611 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:35.054565 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 894/1777] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:54:34 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:54:35.058790 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26515f4-4040-4b8c-81ff-bedc0f0a7a52 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:35.068958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26515f4-4040-4b8c-81ff-bedc0f0a7a52 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:35.073706 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1b349-4f75-4f20-809b-e21c6248aef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:35.074393 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1b349-4f75-4f20-809b-e21c6248aef3 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:35.074678 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1b349-4f75-4f20-809b-e21c6248aef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:35.074956 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1b349-4f75-4f20-809b-e21c6248aef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:35.075681 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1b349-4f75-4f20-809b-e21c6248aef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:35.077803 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1b349-4f75-4f20-809b-e21c6248aef3 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:35.088062 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 884/1778] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:54:35.092129 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d3e41-2a4b-4347-8d5e-054eb1868611 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:35.104940 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d3e41-2a4b-4347-8d5e-054eb1868611 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:35.109566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624167c-657d-43b2-91e3-af50f96e7303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:35.110255 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624167c-657d-43b2-91e3-af50f96e7303 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:35.110538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624167c-657d-43b2-91e3-af50f96e7303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:35.110812 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624167c-657d-43b2-91e3-af50f96e7303 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:35.111534 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624167c-657d-43b2-91e3-af50f96e7303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:35.113161 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624167c-657d-43b2-91e3-af50f96e7303 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:35.125208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 895/1779] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:54:35.129513 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1b349-4f75-4f20-809b-e21c6248aef3 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:35.140003 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1b349-4f75-4f20-809b-e21c6248aef3 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:35.144860 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9eadb-179a-46d5-b428-a5af42c2ec67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:35.145739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9eadb-179a-46d5-b428-a5af42c2ec67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:35.146049 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9eadb-179a-46d5-b428-a5af42c2ec67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:35.146327 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9eadb-179a-46d5-b428-a5af42c2ec67 admin admin] PATH_INFO: `/v3/projects/e694e0143a6b4480a5bac8aad2e7c884/users/15c67a61e2554dfe9ebdbc9862460090/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:35.162011 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9eadb-179a-46d5-b428-a5af42c2ec67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e694e0143a6b4480a5bac8aad2e7c884, user_id=15c67a61e2554dfe9ebdbc9862460090, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:35.164675 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9eadb-179a-46d5-b428-a5af42c2ec67 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:35.178392 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 885/1780] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:54:35 2022] PUT /identity/v3/projects/e694e0143a6b4480a5bac8aad2e7c884/users/15c67a61e2554dfe9ebdbc9862460090/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:35.189643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c4072-e628-4b4d-a079-54673fa00064 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:35.189926 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c4072-e628-4b4d-a079-54673fa00064 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:35.190249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c4072-e628-4b4d-a079-54673fa00064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:35.219285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-d20c4072-e628-4b4d-a079-54673fa00064 None None] MFA Rules not processed for user `15c67a61e2554dfe9ebdbc9862460090`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:35.220521 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d20c4072-e628-4b4d-a079-54673fa00064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:35.285436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 896/1781] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:35 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:35.290293 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9eadb-179a-46d5-b428-a5af42c2ec67 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:35.357627 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9eadb-179a-46d5-b428-a5af42c2ec67 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:35.362201 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a9eb3-036c-43f8-a6a2-2bc15717cf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:35.362864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a9eb3-036c-43f8-a6a2-2bc15717cf3f admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:35.363148 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a9eb3-036c-43f8-a6a2-2bc15717cf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:35.363424 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a9eb3-036c-43f8-a6a2-2bc15717cf3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:35.364129 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a9eb3-036c-43f8-a6a2-2bc15717cf3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:35.366056 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a9eb3-036c-43f8-a6a2-2bc15717cf3f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:35.392695 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 886/1782] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:54:35 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:54:35.396967 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c4072-e628-4b4d-a079-54673fa00064 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:35.402353 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:35.408760 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c4072-e628-4b4d-a079-54673fa00064 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:35.463916 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533527a4-b85c-4c90-8242-04393c3c718e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:35.464587 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533527a4-b85c-4c90-8242-04393c3c718e admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:35.464869 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533527a4-b85c-4c90-8242-04393c3c718e admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:35.465148 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533527a4-b85c-4c90-8242-04393c3c718e admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:35.465825 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533527a4-b85c-4c90-8242-04393c3c718e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:35.467803 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533527a4-b85c-4c90-8242-04393c3c718e admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:35.489087 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 897/1783] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:54:35 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:54:35.493226 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a9eb3-036c-43f8-a6a2-2bc15717cf3f admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:35.504147 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a9eb3-036c-43f8-a6a2-2bc15717cf3f admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:35.509014 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef4a2f-9d9e-4976-a361-077ff1cc6e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:35.509691 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef4a2f-9d9e-4976-a361-077ff1cc6e53 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:35.510002 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef4a2f-9d9e-4976-a361-077ff1cc6e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:35.510281 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef4a2f-9d9e-4976-a361-077ff1cc6e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:35.511023 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef4a2f-9d9e-4976-a361-077ff1cc6e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:35.512623 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef4a2f-9d9e-4976-a361-077ff1cc6e53 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:35.524388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 887/1784] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:54:35.528426 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533527a4-b85c-4c90-8242-04393c3c718e admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:35.541530 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533527a4-b85c-4c90-8242-04393c3c718e admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:35.546516 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9886d-d653-4776-8970-cb4c3e38f9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:35.547530 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9886d-d653-4776-8970-cb4c3e38f9e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:35.547818 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9886d-d653-4776-8970-cb4c3e38f9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:35.548100 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9886d-d653-4776-8970-cb4c3e38f9e4 admin admin] PATH_INFO: `/v3/projects/58a9b1e4187d4f358b6e69d2c2778d9e/users/170273a62259412fad77fb3fd02ad755/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:35.565155 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9886d-d653-4776-8970-cb4c3e38f9e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58a9b1e4187d4f358b6e69d2c2778d9e, user_id=170273a62259412fad77fb3fd02ad755, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:35.567870 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9886d-d653-4776-8970-cb4c3e38f9e4 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:35.582127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 898/1785] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:54:35 2022] PUT /identity/v3/projects/58a9b1e4187d4f358b6e69d2c2778d9e/users/170273a62259412fad77fb3fd02ad755/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 05:54:35.586045 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef4a2f-9d9e-4976-a361-077ff1cc6e53 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:35.596973 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef4a2f-9d9e-4976-a361-077ff1cc6e53 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:35.673729 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103ce59-0b55-4583-83f0-bb60dca0df60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:35.674577 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103ce59-0b55-4583-83f0-bb60dca0df60 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:35.674933 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103ce59-0b55-4583-83f0-bb60dca0df60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:35.675282 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103ce59-0b55-4583-83f0-bb60dca0df60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:35.676088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103ce59-0b55-4583-83f0-bb60dca0df60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:35.678172 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103ce59-0b55-4583-83f0-bb60dca0df60 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:35.696531 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 888/1786] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:54:35.697389 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9886d-d653-4776-8970-cb4c3e38f9e4 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:35.712274 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9886d-d653-4776-8970-cb4c3e38f9e4 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:35.721475 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4e01c-151b-45fe-b22a-e81cfe219b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:35.722782 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4e01c-151b-45fe-b22a-e81cfe219b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:35.723167 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4e01c-151b-45fe-b22a-e81cfe219b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:35.731367 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4e01c-151b-45fe-b22a-e81cfe219b84 admin admin] PATH_INFO: `/v3/projects/58a9b1e4187d4f358b6e69d2c2778d9e/users/170273a62259412fad77fb3fd02ad755/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:35.731930 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4e01c-151b-45fe-b22a-e81cfe219b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58a9b1e4187d4f358b6e69d2c2778d9e, user_id=170273a62259412fad77fb3fd02ad755, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:35.735345 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4e01c-151b-45fe-b22a-e81cfe219b84 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:35.749670 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 899/1787] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:54:35 2022] PUT /identity/v3/projects/58a9b1e4187d4f358b6e69d2c2778d9e/users/170273a62259412fad77fb3fd02ad755/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 05:54:35.762928 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e3c2b-9c30-4f0e-8359-7e0b27d02f79 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:35.762928 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e3c2b-9c30-4f0e-8359-7e0b27d02f79 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:35.762928 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e3c2b-9c30-4f0e-8359-7e0b27d02f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:35.767615 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:35.794533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-b20e3c2b-9c30-4f0e-8359-7e0b27d02f79 None None] MFA Rules not processed for user `170273a62259412fad77fb3fd02ad755`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:35.796836 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b20e3c2b-9c30-4f0e-8359-7e0b27d02f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:35.877620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 889/1788] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:35 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:35.889879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4e01c-151b-45fe-b22a-e81cfe219b84 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:35.891620 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-71f4e01c-151b-45fe-b22a-e81cfe219b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:35.954712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4e01c-151b-45fe-b22a-e81cfe219b84 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:35.958406 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd57297-9566-4238-96d4-7b27ca6a5dee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:35.959060 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd57297-9566-4238-96d4-7b27ca6a5dee service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:35.959345 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd57297-9566-4238-96d4-7b27ca6a5dee service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:35.959624 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd57297-9566-4238-96d4-7b27ca6a5dee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:35.969800 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd57297-9566-4238-96d4-7b27ca6a5dee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:35.971249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd57297-9566-4238-96d4-7b27ca6a5dee service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:35.981240 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 900/1789] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:35 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:54:36.069068 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e3c2b-9c30-4f0e-8359-7e0b27d02f79 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:36.079400 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e3c2b-9c30-4f0e-8359-7e0b27d02f79 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:36.088167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef3ba2-d613-435e-8af5-26810cfcd2eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:36.088856 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef3ba2-d613-435e-8af5-26810cfcd2eb service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:36.089140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef3ba2-d613-435e-8af5-26810cfcd2eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:36.089549 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef3ba2-d613-435e-8af5-26810cfcd2eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:36.149471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef3ba2-d613-435e-8af5-26810cfcd2eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:36.151214 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef3ba2-d613-435e-8af5-26810cfcd2eb service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:36.161518 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 890/1790] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 05:54:40.993417 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd57297-9566-4238-96d4-7b27ca6a5dee service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:40.998051 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ecd57297-9566-4238-96d4-7b27ca6a5dee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:41.000103 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef3ba2-d613-435e-8af5-26810cfcd2eb service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:41.002230 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-60ef3ba2-d613-435e-8af5-26810cfcd2eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:41.137720 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef3ba2-d613-435e-8af5-26810cfcd2eb service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:41.143816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106bef4-f00e-4668-adea-44812c6b26f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:41.144499 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106bef4-f00e-4668-adea-44812c6b26f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:41.144963 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106bef4-f00e-4668-adea-44812c6b26f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:41.145319 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106bef4-f00e-4668-adea-44812c6b26f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:41.148539 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-9106bef4-f00e-4668-adea-44812c6b26f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:41.163930 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106bef4-f00e-4668-adea-44812c6b26f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:41.165620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106bef4-f00e-4668-adea-44812c6b26f2 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:41.177700 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 891/1791] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:54:41.211269 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd57297-9566-4238-96d4-7b27ca6a5dee service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:41.220020 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a891d-ab6e-40e8-b397-204dc8f5e9c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:41.221212 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a891d-ab6e-40e8-b397-204dc8f5e9c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:41.221739 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a891d-ab6e-40e8-b397-204dc8f5e9c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:41.222241 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a891d-ab6e-40e8-b397-204dc8f5e9c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:41.242876 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a891d-ab6e-40e8-b397-204dc8f5e9c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:41.247657 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a891d-ab6e-40e8-b397-204dc8f5e9c4 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:41.258885 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:41.273028 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 901/1792] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:54:44.759473 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410e3b4-5097-4b6b-a204-2a117095fbf0 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:44.760563 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410e3b4-5097-4b6b-a204-2a117095fbf0 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:44.761156 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410e3b4-5097-4b6b-a204-2a117095fbf0 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:44.764805 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 892/1793] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jun 21 05:54:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:54:44.801425 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f2d90-8717-46fd-a653-0213cae3b4ec None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:44.802631 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f2d90-8717-46fd-a653-0213cae3b4ec None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:44.804231 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f2d90-8717-46fd-a653-0213cae3b4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:44.865578 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-aa0f2d90-8717-46fd-a653-0213cae3b4ec None None] MFA Rules not processed for user `f702830987ba4548a4c2ee3d0e302d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:44.868789 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-aa0f2d90-8717-46fd-a653-0213cae3b4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:45.157023 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 902/1794] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jun 21 05:54:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:45.244651 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410e3b4-5097-4b6b-a204-2a117095fbf0 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:45.247768 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3410e3b4-5097-4b6b-a204-2a117095fbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:45.294433 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410e3b4-5097-4b6b-a204-2a117095fbf0 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:45.304877 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff088c-33c7-4f64-83da-c093c9b8b684 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:45.306183 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff088c-33c7-4f64-83da-c093c9b8b684 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:45.306813 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff088c-33c7-4f64-83da-c093c9b8b684 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:45.307789 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff088c-33c7-4f64-83da-c093c9b8b684 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:45.332710 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff088c-33c7-4f64-83da-c093c9b8b684 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:45.336357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff088c-33c7-4f64-83da-c093c9b8b684 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:45.361428 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 893/1795] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:54:46.839276 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f2d90-8717-46fd-a653-0213cae3b4ec None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:47.030984 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f2d90-8717-46fd-a653-0213cae3b4ec None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:47.038479 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12790d2c-6519-4910-9660-78600d6baca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:47.040490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12790d2c-6519-4910-9660-78600d6baca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:47.041237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12790d2c-6519-4910-9660-78600d6baca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:47.042035 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12790d2c-6519-4910-9660-78600d6baca5 admin admin] PATH_INFO: `/v3/users/15c67a61e2554dfe9ebdbc9862460090` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:47.046584 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12790d2c-6519-4910-9660-78600d6baca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15c67a61e2554dfe9ebdbc9862460090)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:47.050858 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12790d2c-6519-4910-9660-78600d6baca5 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:47.158539 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-12790d2c-6519-4910-9660-78600d6baca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15c67a61e2554dfe9ebdbc9862460090'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:47.167642 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-12790d2c-6519-4910-9660-78600d6baca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15c67a61e2554dfe9ebdbc9862460090'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:47.168828 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-12790d2c-6519-4910-9660-78600d6baca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15c67a61e2554dfe9ebdbc9862460090'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:47.204755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-12790d2c-6519-4910-9660-78600d6baca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15c67a61e2554dfe9ebdbc9862460090'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:47.238592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-12790d2c-6519-4910-9660-78600d6baca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15c67a61e2554dfe9ebdbc9862460090'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:47.253619 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 903/1796] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:54:46 2022] DELETE /identity/v3/users/15c67a61e2554dfe9ebdbc9862460090 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:47.264502 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040fef1-49dd-4811-bb78-d051eaad57ee None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:47.266040 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040fef1-49dd-4811-bb78-d051eaad57ee None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:47.266610 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040fef1-49dd-4811-bb78-d051eaad57ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:47.300644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12790d2c-6519-4910-9660-78600d6baca5 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:47.301600 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-12790d2c-6519-4910-9660-78600d6baca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:47.318722 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-7040fef1-49dd-4811-bb78-d051eaad57ee None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:47.322016 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-7040fef1-49dd-4811-bb78-d051eaad57ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:47.331136 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:47.361896 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:47.436593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 894/1797] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:47.450864 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12790d2c-6519-4910-9660-78600d6baca5 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:47.469110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5392b9c-d803-4894-9fb6-ff6356d8d4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:47.470217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5392b9c-d803-4894-9fb6-ff6356d8d4df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:47.470552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5392b9c-d803-4894-9fb6-ff6356d8d4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:47.470841 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5392b9c-d803-4894-9fb6-ff6356d8d4df admin admin] PATH_INFO: `/v3/users/d1df1aba890145ff8f974715e37781e9` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:47.473539 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5392b9c-d803-4894-9fb6-ff6356d8d4df admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1df1aba890145ff8f974715e37781e9)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:47.476036 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5392b9c-d803-4894-9fb6-ff6356d8d4df admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:47.540062 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040fef1-49dd-4811-bb78-d051eaad57ee None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:47.542235 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-7040fef1-49dd-4811-bb78-d051eaad57ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:47.573481 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a5392b9c-d803-4894-9fb6-ff6356d8d4df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1df1aba890145ff8f974715e37781e9'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:47.586105 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a5392b9c-d803-4894-9fb6-ff6356d8d4df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1df1aba890145ff8f974715e37781e9'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:47.587259 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a5392b9c-d803-4894-9fb6-ff6356d8d4df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1df1aba890145ff8f974715e37781e9'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:47.599621 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a5392b9c-d803-4894-9fb6-ff6356d8d4df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1df1aba890145ff8f974715e37781e9'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:47.626185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a5392b9c-d803-4894-9fb6-ff6356d8d4df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1df1aba890145ff8f974715e37781e9'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:47.634633 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 904/1798] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:54:47 2022] DELETE /identity/v3/users/d1df1aba890145ff8f974715e37781e9 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:47.640614 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f62ff-610d-4b36-994f-506f862ad2bd None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:47.641189 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f62ff-610d-4b36-994f-506f862ad2bd None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:47.641552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f62ff-610d-4b36-994f-506f862ad2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:47.687179 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-db9f62ff-610d-4b36-994f-506f862ad2bd None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:47.692422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-db9f62ff-610d-4b36-994f-506f862ad2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:47.727473 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040fef1-49dd-4811-bb78-d051eaad57ee None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:47.825921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 905/1799] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:47.914561 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0dd8d-128b-44af-9842-12d4a4c31ae5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:47.917854 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0dd8d-128b-44af-9842-12d4a4c31ae5 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:47.920281 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0dd8d-128b-44af-9842-12d4a4c31ae5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:47.921766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0dd8d-128b-44af-9842-12d4a4c31ae5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:47.929245 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-7cd0dd8d-128b-44af-9842-12d4a4c31ae5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:47.967957 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0dd8d-128b-44af-9842-12d4a4c31ae5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:47.967957 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0dd8d-128b-44af-9842-12d4a4c31ae5 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:47.978279 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 895/1800] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:54:47.987430 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f62ff-610d-4b36-994f-506f862ad2bd None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:47.991065 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-db9f62ff-610d-4b36-994f-506f862ad2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:48.014934 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f62ff-610d-4b36-994f-506f862ad2bd None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:48.025213 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16decbb-a461-474a-afb8-c04e049fb2df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:48.026494 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16decbb-a461-474a-afb8-c04e049fb2df service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:48.026717 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16decbb-a461-474a-afb8-c04e049fb2df service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:48.029126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16decbb-a461-474a-afb8-c04e049fb2df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:48.047692 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16decbb-a461-474a-afb8-c04e049fb2df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:48.049358 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16decbb-a461-474a-afb8-c04e049fb2df service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:48.063775 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 906/1801] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:54:48.767580 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc83489-b0b8-49fe-8971-af6c824007d5 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:48.768224 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc83489-b0b8-49fe-8971-af6c824007d5 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:48.768224 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc83489-b0b8-49fe-8971-af6c824007d5 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:48.769859 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 896/1802] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jun 21 05:54:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:54:48.787821 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875b76f-de52-465e-a9fe-dfc6e99f06ab None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:48.788346 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875b76f-de52-465e-a9fe-dfc6e99f06ab None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:48.788783 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875b76f-de52-465e-a9fe-dfc6e99f06ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:48.838458 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-1875b76f-de52-465e-a9fe-dfc6e99f06ab None None] MFA Rules not processed for user `f702830987ba4548a4c2ee3d0e302d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:48.840180 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1875b76f-de52-465e-a9fe-dfc6e99f06ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:48.880448 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:49.034674 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 907/1803] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jun 21 05:54:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:49.369697 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc83489-b0b8-49fe-8971-af6c824007d5 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:49.371523 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3fc83489-b0b8-49fe-8971-af6c824007d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:49.405707 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc83489-b0b8-49fe-8971-af6c824007d5 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:49.414321 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ca29b-4eb3-457e-af56-cd847596db29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:49.416397 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ca29b-4eb3-457e-af56-cd847596db29 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:49.418623 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ca29b-4eb3-457e-af56-cd847596db29 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:49.419474 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ca29b-4eb3-457e-af56-cd847596db29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:49.450258 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ca29b-4eb3-457e-af56-cd847596db29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:49.453194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875b76f-de52-465e-a9fe-dfc6e99f06ab None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:49.456216 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1875b76f-de52-465e-a9fe-dfc6e99f06ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:49.460452 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ca29b-4eb3-457e-af56-cd847596db29 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:49.483394 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 897/1804] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:54:49.529265 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875b76f-de52-465e-a9fe-dfc6e99f06ab None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:49.563097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd9e2e-44ab-469f-bca9-d21c7af3e589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:49.564329 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd9e2e-44ab-469f-bca9-d21c7af3e589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:49.568431 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd9e2e-44ab-469f-bca9-d21c7af3e589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:49.570520 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd9e2e-44ab-469f-bca9-d21c7af3e589 admin admin] PATH_INFO: `/v3/projects/e694e0143a6b4480a5bac8aad2e7c884` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:49.583026 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd9e2e-44ab-469f-bca9-d21c7af3e589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e694e0143a6b4480a5bac8aad2e7c884)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:49.588445 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd9e2e-44ab-469f-bca9-d21c7af3e589 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:49.607671 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ca29b-4eb3-457e-af56-cd847596db29 service nova] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:49.609552 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ce9ca29b-4eb3-457e-af56-cd847596db29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:49.649883 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ca29b-4eb3-457e-af56-cd847596db29 service nova] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:49.685186 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5e2d7-ca91-4d71-9c4c-7927aa905f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:49.691765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5e2d7-ca91-4d71-9c4c-7927aa905f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:49.692636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5e2d7-ca91-4d71-9c4c-7927aa905f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:49.693159 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5e2d7-ca91-4d71-9c4c-7927aa905f24 admin admin] PATH_INFO: `/v3/projects/687fb9e9d7b64ce8b18b417ab2089bd4` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:49.695954 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5e2d7-ca91-4d71-9c4c-7927aa905f24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=687fb9e9d7b64ce8b18b417ab2089bd4)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:49.697906 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5e2d7-ca91-4d71-9c4c-7927aa905f24 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:49.734886 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-7bfd9e2e-44ab-469f-bca9-d21c7af3e589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e694e0143a6b4480a5bac8aad2e7c884', 'request_id': 'req-7bfd9e2e-44ab-469f-bca9-d21c7af3e589'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:49.765788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-7bfd9e2e-44ab-469f-bca9-d21c7af3e589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e694e0143a6b4480a5bac8aad2e7c884', 'request_id': 'req-7bfd9e2e-44ab-469f-bca9-d21c7af3e589'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:49.782245 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-7bfd9e2e-44ab-469f-bca9-d21c7af3e589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e694e0143a6b4480a5bac8aad2e7c884', 'request_id': 'req-7bfd9e2e-44ab-469f-bca9-d21c7af3e589'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:49.807359 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-7bfd9e2e-44ab-469f-bca9-d21c7af3e589 admin admin] The token cache is being invalidate because project e694e0143a6b4480a5bac8aad2e7c884 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:54:49.807696 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-7bfd9e2e-44ab-469f-bca9-d21c7af3e589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:49.809204 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-7bfd9e2e-44ab-469f-bca9-d21c7af3e589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:49.810181 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-2af5e2d7-ca91-4d71-9c4c-7927aa905f24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '687fb9e9d7b64ce8b18b417ab2089bd4', 'request_id': 'req-2af5e2d7-ca91-4d71-9c4c-7927aa905f24'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:49.813522 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 908/1805] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:54:49 2022] DELETE /identity/v3/projects/e694e0143a6b4480a5bac8aad2e7c884 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:49.817808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd9e2e-44ab-469f-bca9-d21c7af3e589 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:49.819448 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-7bfd9e2e-44ab-469f-bca9-d21c7af3e589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:49.825286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-2af5e2d7-ca91-4d71-9c4c-7927aa905f24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '687fb9e9d7b64ce8b18b417ab2089bd4', 'request_id': 'req-2af5e2d7-ca91-4d71-9c4c-7927aa905f24'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:49.829613 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:49.847419 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-2af5e2d7-ca91-4d71-9c4c-7927aa905f24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '687fb9e9d7b64ce8b18b417ab2089bd4', 'request_id': 'req-2af5e2d7-ca91-4d71-9c4c-7927aa905f24'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:49.871525 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-2af5e2d7-ca91-4d71-9c4c-7927aa905f24 admin admin] The token cache is being invalidate because project 687fb9e9d7b64ce8b18b417ab2089bd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:54:49.872320 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-2af5e2d7-ca91-4d71-9c4c-7927aa905f24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:49.874255 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-2af5e2d7-ca91-4d71-9c4c-7927aa905f24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:49.878200 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 898/1806] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:54:49 2022] DELETE /identity/v3/projects/687fb9e9d7b64ce8b18b417ab2089bd4 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 05:54:49.883551 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5e2d7-ca91-4d71-9c4c-7927aa905f24 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:49.886028 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-2af5e2d7-ca91-4d71-9c4c-7927aa905f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:49.932961 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd9e2e-44ab-469f-bca9-d21c7af3e589 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:49.989246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5e2d7-ca91-4d71-9c4c-7927aa905f24 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:49.996015 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:50.006987 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e157886-d0fb-452c-abd0-695057e75b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:50.008675 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e157886-d0fb-452c-abd0-695057e75b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:50.009091 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e157886-d0fb-452c-abd0-695057e75b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:50.009376 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e157886-d0fb-452c-abd0-695057e75b05 admin admin] PATH_INFO: `/v3/users/7d758ba84a95423e86d0b2cdcaeaeb86` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:50.012496 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e157886-d0fb-452c-abd0-695057e75b05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d758ba84a95423e86d0b2cdcaeaeb86)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:50.015830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e157886-d0fb-452c-abd0-695057e75b05 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:50.036141 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c0ea2-6eb9-4c85-891b-9bd0dd98ffed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:50.037628 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c0ea2-6eb9-4c85-891b-9bd0dd98ffed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:50.038382 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c0ea2-6eb9-4c85-891b-9bd0dd98ffed admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:50.038666 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c0ea2-6eb9-4c85-891b-9bd0dd98ffed admin admin] PATH_INFO: `/v3/users/170273a62259412fad77fb3fd02ad755` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:50.040103 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c0ea2-6eb9-4c85-891b-9bd0dd98ffed admin admin] RBAC: Authorizing `identity:delete_user(user_id=170273a62259412fad77fb3fd02ad755)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:50.049731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c0ea2-6eb9-4c85-891b-9bd0dd98ffed admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:50.082279 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5e157886-d0fb-452c-abd0-695057e75b05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d758ba84a95423e86d0b2cdcaeaeb86'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:50.107069 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5e157886-d0fb-452c-abd0-695057e75b05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d758ba84a95423e86d0b2cdcaeaeb86'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:50.108663 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5e157886-d0fb-452c-abd0-695057e75b05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d758ba84a95423e86d0b2cdcaeaeb86'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:50.109724 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5e157886-d0fb-452c-abd0-695057e75b05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d758ba84a95423e86d0b2cdcaeaeb86'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:50.137543 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8c8c0ea2-6eb9-4c85-891b-9bd0dd98ffed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '170273a62259412fad77fb3fd02ad755'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:50.148511 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8c8c0ea2-6eb9-4c85-891b-9bd0dd98ffed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '170273a62259412fad77fb3fd02ad755'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:50.149370 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8c8c0ea2-6eb9-4c85-891b-9bd0dd98ffed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '170273a62259412fad77fb3fd02ad755'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:50.163091 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8c8c0ea2-6eb9-4c85-891b-9bd0dd98ffed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '170273a62259412fad77fb3fd02ad755'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:50.167089 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5e157886-d0fb-452c-abd0-695057e75b05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d758ba84a95423e86d0b2cdcaeaeb86'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:50.189386 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8c8c0ea2-6eb9-4c85-891b-9bd0dd98ffed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '170273a62259412fad77fb3fd02ad755'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:50.189995 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 899/1807] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:54:49 2022] DELETE /identity/v3/users/7d758ba84a95423e86d0b2cdcaeaeb86 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:50.201141 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 909/1808] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:54:49 2022] DELETE /identity/v3/users/170273a62259412fad77fb3fd02ad755 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:50.594530 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e157886-d0fb-452c-abd0-695057e75b05 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:50.596915 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5e157886-d0fb-452c-abd0-695057e75b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:50.707372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e157886-d0fb-452c-abd0-695057e75b05 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:50.720859 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:50.794905 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89f684-f013-4418-b4fa-8cd9437edb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:50.796139 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89f684-f013-4418-b4fa-8cd9437edb76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:50.796445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89f684-f013-4418-b4fa-8cd9437edb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:50.796794 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89f684-f013-4418-b4fa-8cd9437edb76 admin admin] PATH_INFO: `/v3/projects/a6c9249bb4cf4dedbfc2ea66eea140c2` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:50.798107 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89f684-f013-4418-b4fa-8cd9437edb76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6c9249bb4cf4dedbfc2ea66eea140c2)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:50.800133 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89f684-f013-4418-b4fa-8cd9437edb76 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:50.842486 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c0ea2-6eb9-4c85-891b-9bd0dd98ffed admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:50.845258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-8c8c0ea2-6eb9-4c85-891b-9bd0dd98ffed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:50.860104 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c0ea2-6eb9-4c85-891b-9bd0dd98ffed admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:50.866888 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0d513-3d6a-49e4-86cf-b3745087c887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:50.868577 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0d513-3d6a-49e4-86cf-b3745087c887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:50.868936 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0d513-3d6a-49e4-86cf-b3745087c887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:50.869291 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0d513-3d6a-49e4-86cf-b3745087c887 admin admin] PATH_INFO: `/v3/projects/58a9b1e4187d4f358b6e69d2c2778d9e` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:50.871355 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0d513-3d6a-49e4-86cf-b3745087c887 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58a9b1e4187d4f358b6e69d2c2778d9e)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:50.873841 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0d513-3d6a-49e4-86cf-b3745087c887 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:50.879765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-3a89f684-f013-4418-b4fa-8cd9437edb76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6c9249bb4cf4dedbfc2ea66eea140c2', 'request_id': 'req-3a89f684-f013-4418-b4fa-8cd9437edb76'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:50.893920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-3a89f684-f013-4418-b4fa-8cd9437edb76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6c9249bb4cf4dedbfc2ea66eea140c2', 'request_id': 'req-3a89f684-f013-4418-b4fa-8cd9437edb76'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:50.909949 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-3a89f684-f013-4418-b4fa-8cd9437edb76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6c9249bb4cf4dedbfc2ea66eea140c2', 'request_id': 'req-3a89f684-f013-4418-b4fa-8cd9437edb76'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:50.947271 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-3a89f684-f013-4418-b4fa-8cd9437edb76 admin admin] The token cache is being invalidate because project a6c9249bb4cf4dedbfc2ea66eea140c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:54:50.948054 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-3a89f684-f013-4418-b4fa-8cd9437edb76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:50.948963 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-3a89f684-f013-4418-b4fa-8cd9437edb76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:50.951942 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 900/1809] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:54:50 2022] DELETE /identity/v3/projects/a6c9249bb4cf4dedbfc2ea66eea140c2 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:50.958878 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02e595-a713-4ce7-a130-8e69b60456c3 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:50.959507 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02e595-a713-4ce7-a130-8e69b60456c3 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:50.959942 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02e595-a713-4ce7-a130-8e69b60456c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:50.962982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b6d0d513-3d6a-49e4-86cf-b3745087c887 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58a9b1e4187d4f358b6e69d2c2778d9e', 'request_id': 'req-b6d0d513-3d6a-49e4-86cf-b3745087c887'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:50.977433 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b6d0d513-3d6a-49e4-86cf-b3745087c887 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58a9b1e4187d4f358b6e69d2c2778d9e', 'request_id': 'req-b6d0d513-3d6a-49e4-86cf-b3745087c887'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:50.988948 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b6d0d513-3d6a-49e4-86cf-b3745087c887 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58a9b1e4187d4f358b6e69d2c2778d9e', 'request_id': 'req-b6d0d513-3d6a-49e4-86cf-b3745087c887'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:50.994428 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-5e02e595-a713-4ce7-a130-8e69b60456c3 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:50.996965 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5e02e595-a713-4ce7-a130-8e69b60456c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:51.015200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b6d0d513-3d6a-49e4-86cf-b3745087c887 admin admin] The token cache is being invalidate because project 58a9b1e4187d4f358b6e69d2c2778d9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:54:51.015765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b6d0d513-3d6a-49e4-86cf-b3745087c887 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:51.016687 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b6d0d513-3d6a-49e4-86cf-b3745087c887 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:51.020273 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 910/1810] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:54:50 2022] DELETE /identity/v3/projects/58a9b1e4187d4f358b6e69d2c2778d9e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 05:54:51.025641 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559afe94-da92-4ff0-8645-2eb846629736 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:51.026025 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559afe94-da92-4ff0-8645-2eb846629736 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:51.026409 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559afe94-da92-4ff0-8645-2eb846629736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:51.046531 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-559afe94-da92-4ff0-8645-2eb846629736 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:51.047913 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-559afe94-da92-4ff0-8645-2eb846629736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:51.086921 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 901/1811] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:51.095170 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c8527-9de1-4e48-aa21-fac5eae8eef0 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:51.095454 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c8527-9de1-4e48-aa21-fac5eae8eef0 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:51.095927 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c8527-9de1-4e48-aa21-fac5eae8eef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:51.109293 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:51.130678 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-319c8527-9de1-4e48-aa21-fac5eae8eef0 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:51.132094 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-319c8527-9de1-4e48-aa21-fac5eae8eef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:51.148905 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 902/1812] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:51.149829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c8527-9de1-4e48-aa21-fac5eae8eef0 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:51.156659 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 911/1813] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:54:51.167631 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb560e-de5b-4640-a092-ce8bf1b53d3a None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:51.170761 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb560e-de5b-4640-a092-ce8bf1b53d3a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:51.171204 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb560e-de5b-4640-a092-ce8bf1b53d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:51.175914 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c8527-9de1-4e48-aa21-fac5eae8eef0 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:51.196800 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9cb2d-ba21-47b7-808a-44cf71015fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:51.202858 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9cb2d-ba21-47b7-808a-44cf71015fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:51.203856 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9cb2d-ba21-47b7-808a-44cf71015fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:51.203856 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9cb2d-ba21-47b7-808a-44cf71015fc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:51.204546 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9cb2d-ba21-47b7-808a-44cf71015fc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:54:51.204882 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9cb2d-ba21-47b7-808a-44cf71015fc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:51.207048 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9cb2d-ba21-47b7-808a-44cf71015fc5 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:51.217378 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-4afb560e-de5b-4640-a092-ce8bf1b53d3a None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:51.219151 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4afb560e-de5b-4640-a092-ce8bf1b53d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:51.233258 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 903/1814] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:54:51.240438 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9cb2d-ba21-47b7-808a-44cf71015fc5 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:51.254453 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 912/1815] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:51.256043 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb560e-de5b-4640-a092-ce8bf1b53d3a None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:51.272999 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9cb2d-ba21-47b7-808a-44cf71015fc5 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:51.289554 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604c159-7cd7-47c5-ae84-4012c1955094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:51.290841 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604c159-7cd7-47c5-ae84-4012c1955094 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:51.291898 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb560e-de5b-4640-a092-ce8bf1b53d3a None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:51.293195 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604c159-7cd7-47c5-ae84-4012c1955094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:51.293195 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604c159-7cd7-47c5-ae84-4012c1955094 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:51.296764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604c159-7cd7-47c5-ae84-4012c1955094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:51.301144 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604c159-7cd7-47c5-ae84-4012c1955094 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:51.307516 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b10a5-e68b-4124-9035-e1ddb19e75ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:51.308776 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b10a5-e68b-4124-9035-e1ddb19e75ae admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:51.309372 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b10a5-e68b-4124-9035-e1ddb19e75ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:51.310027 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b10a5-e68b-4124-9035-e1ddb19e75ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:51.311996 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b10a5-e68b-4124-9035-e1ddb19e75ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:54:51.312657 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b10a5-e68b-4124-9035-e1ddb19e75ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:51.315735 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b10a5-e68b-4124-9035-e1ddb19e75ae admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:51.347033 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 913/1816] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:54:51.349162 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b10a5-e68b-4124-9035-e1ddb19e75ae admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:51.359209 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 904/1817] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:54:51 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:54:51.360857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604c159-7cd7-47c5-ae84-4012c1955094 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:51.371210 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:51.375885 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b10a5-e68b-4124-9035-e1ddb19e75ae admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:51.496018 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb44e5d-17ee-4f9d-aef6-15a60f130085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:51.496704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb44e5d-17ee-4f9d-aef6-15a60f130085 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:51.497059 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb44e5d-17ee-4f9d-aef6-15a60f130085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:51.497365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb44e5d-17ee-4f9d-aef6-15a60f130085 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:51.498217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb44e5d-17ee-4f9d-aef6-15a60f130085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:51.501847 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb44e5d-17ee-4f9d-aef6-15a60f130085 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:51.539418 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604c159-7cd7-47c5-ae84-4012c1955094 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:51.551141 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 914/1818] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:54:51 2022] POST /identity/v3/projects => generated 373 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 05:54:51.552285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb44e5d-17ee-4f9d-aef6-15a60f130085 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:51.642788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb44e5d-17ee-4f9d-aef6-15a60f130085 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:51.647516 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f959134-db02-4aa7-aaf2-acafd245a129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:51.648604 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f959134-db02-4aa7-aaf2-acafd245a129 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:51.648921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf762c-15f9-44c0-b0c5-e141b0207145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:51.649035 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f959134-db02-4aa7-aaf2-acafd245a129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:51.649409 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f959134-db02-4aa7-aaf2-acafd245a129 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:51.649633 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf762c-15f9-44c0-b0c5-e141b0207145 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:51.650469 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf762c-15f9-44c0-b0c5-e141b0207145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:51.650469 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf762c-15f9-44c0-b0c5-e141b0207145 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:51.650637 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f959134-db02-4aa7-aaf2-acafd245a129 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:51.651127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf762c-15f9-44c0-b0c5-e141b0207145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:51.653599 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf762c-15f9-44c0-b0c5-e141b0207145 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:51.653725 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f959134-db02-4aa7-aaf2-acafd245a129 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:51.681175 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 915/1819] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:54:51 2022] POST /identity/v3/users => generated 287 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:54:51.685331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf762c-15f9-44c0-b0c5-e141b0207145 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:51.686698 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 905/1820] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:54:51 2022] POST /identity/v3/users => generated 283 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:54:51.692278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f959134-db02-4aa7-aaf2-acafd245a129 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:51.702734 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf762c-15f9-44c0-b0c5-e141b0207145 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:51.709853 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c3cfc-71bb-4a1c-98ac-b8611ef31081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:51.710888 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c3cfc-71bb-4a1c-98ac-b8611ef31081 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:51.711140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c3cfc-71bb-4a1c-98ac-b8611ef31081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:51.711518 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c3cfc-71bb-4a1c-98ac-b8611ef31081 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:51.712257 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f959134-db02-4aa7-aaf2-acafd245a129 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:51.712502 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c3cfc-71bb-4a1c-98ac-b8611ef31081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:51.715209 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c3cfc-71bb-4a1c-98ac-b8611ef31081 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:51.722041 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c5a37-c2c8-48a7-a073-e18ed6bd05f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:51.723426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c5a37-c2c8-48a7-a073-e18ed6bd05f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:51.724164 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c5a37-c2c8-48a7-a073-e18ed6bd05f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:51.724684 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c5a37-c2c8-48a7-a073-e18ed6bd05f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:51.725861 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c5a37-c2c8-48a7-a073-e18ed6bd05f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:51.729965 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c5a37-c2c8-48a7-a073-e18ed6bd05f6 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:51.734042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 916/1821] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 05:54:51.748356 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c3cfc-71bb-4a1c-98ac-b8611ef31081 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:51.762444 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 906/1822] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:54:51.764439 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c5a37-c2c8-48a7-a073-e18ed6bd05f6 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:51.770243 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c3cfc-71bb-4a1c-98ac-b8611ef31081 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:51.791861 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622ab15-5599-4766-9376-4370feee3877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:51.791861 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622ab15-5599-4766-9376-4370feee3877 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:51.792323 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622ab15-5599-4766-9376-4370feee3877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:51.792941 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622ab15-5599-4766-9376-4370feee3877 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:51.794079 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622ab15-5599-4766-9376-4370feee3877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:51.794276 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c5a37-c2c8-48a7-a073-e18ed6bd05f6 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:51.795422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622ab15-5599-4766-9376-4370feee3877 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:51.813557 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 917/1823] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:54:51.819986 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622ab15-5599-4766-9376-4370feee3877 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:51.820303 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f833bf3-62eb-4a87-a75b-8d67ffdc1cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:51.821460 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f833bf3-62eb-4a87-a75b-8d67ffdc1cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:51.821827 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f833bf3-62eb-4a87-a75b-8d67ffdc1cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:51.822444 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f833bf3-62eb-4a87-a75b-8d67ffdc1cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:51.823425 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f833bf3-62eb-4a87-a75b-8d67ffdc1cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:51.825234 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f833bf3-62eb-4a87-a75b-8d67ffdc1cc9 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:51.837915 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622ab15-5599-4766-9376-4370feee3877 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:51.847592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bca7c9-0e2d-43bf-a192-ea718d236992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:51.848621 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bca7c9-0e2d-43bf-a192-ea718d236992 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:51.849290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bca7c9-0e2d-43bf-a192-ea718d236992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:51.849676 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bca7c9-0e2d-43bf-a192-ea718d236992 admin admin] PATH_INFO: `/v3/projects/487a0115fb1249e4a7944e09af2b3005/users/aaf5f9bceabb47f6a1f19e83deb7f434/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:51.854870 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 907/1824] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 05:54:51.864992 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f833bf3-62eb-4a87-a75b-8d67ffdc1cc9 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:51.881648 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:51.894742 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bca7c9-0e2d-43bf-a192-ea718d236992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=487a0115fb1249e4a7944e09af2b3005, user_id=aaf5f9bceabb47f6a1f19e83deb7f434, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:51.898002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bca7c9-0e2d-43bf-a192-ea718d236992 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:51.906915 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f833bf3-62eb-4a87-a75b-8d67ffdc1cc9 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:51.913147 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7a836-7963-4a1f-9089-5600eeffe417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:51.914369 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7a836-7963-4a1f-9089-5600eeffe417 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:51.914971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7a836-7963-4a1f-9089-5600eeffe417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:51.914971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7a836-7963-4a1f-9089-5600eeffe417 admin admin] PATH_INFO: `/v3/projects/fc302b38a5f746ac8ded162e5baca61e/users/4cd9db45f850458aaa5c18b912b1f620/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:51.922232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 918/1825] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:54:51 2022] PUT /identity/v3/projects/487a0115fb1249e4a7944e09af2b3005/users/aaf5f9bceabb47f6a1f19e83deb7f434/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 05:54:51.942326 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b2ae9-fef7-4766-af83-8afb2b0b9a2e None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:51.942860 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b2ae9-fef7-4766-af83-8afb2b0b9a2e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:51.943384 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b2ae9-fef7-4766-af83-8afb2b0b9a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:51.970193 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc7a836-7963-4a1f-9089-5600eeffe417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc302b38a5f746ac8ded162e5baca61e, user_id=4cd9db45f850458aaa5c18b912b1f620, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:51.976552 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc7a836-7963-4a1f-9089-5600eeffe417 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:51.996393 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-525b2ae9-fef7-4766-af83-8afb2b0b9a2e None None] MFA Rules not processed for user `aaf5f9bceabb47f6a1f19e83deb7f434`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:51.998311 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-525b2ae9-fef7-4766-af83-8afb2b0b9a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:52.007335 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 908/1826] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:54:51 2022] PUT /identity/v3/projects/fc302b38a5f746ac8ded162e5baca61e/users/4cd9db45f850458aaa5c18b912b1f620/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:52.023957 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23540060-d3d2-41d5-9cc3-1f407665fb4a None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:52.024732 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23540060-d3d2-41d5-9cc3-1f407665fb4a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:52.025376 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23540060-d3d2-41d5-9cc3-1f407665fb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:52.090378 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-23540060-d3d2-41d5-9cc3-1f407665fb4a None None] MFA Rules not processed for user `4cd9db45f850458aaa5c18b912b1f620`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:52.093357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-23540060-d3d2-41d5-9cc3-1f407665fb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:52.166515 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 919/1827] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:52.170777 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b2ae9-fef7-4766-af83-8afb2b0b9a2e None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:52.186790 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:52.235803 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 909/1828] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:52.242592 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23540060-d3d2-41d5-9cc3-1f407665fb4a None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:52.280081 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b2ae9-fef7-4766-af83-8afb2b0b9a2e None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:52.286635 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4fef9-7a49-4507-b3a2-8aed65314e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:52.287832 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4fef9-7a49-4507-b3a2-8aed65314e97 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:52.288349 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4fef9-7a49-4507-b3a2-8aed65314e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:52.288771 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4fef9-7a49-4507-b3a2-8aed65314e97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:52.289739 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4fef9-7a49-4507-b3a2-8aed65314e97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:52.292304 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4fef9-7a49-4507-b3a2-8aed65314e97 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:52.335095 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23540060-d3d2-41d5-9cc3-1f407665fb4a None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:52.340655 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042619f-0d0c-42d2-bf2f-aaca15a39e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:52.341341 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042619f-0d0c-42d2-bf2f-aaca15a39e02 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:52.341638 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042619f-0d0c-42d2-bf2f-aaca15a39e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:52.342023 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042619f-0d0c-42d2-bf2f-aaca15a39e02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:52.342845 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042619f-0d0c-42d2-bf2f-aaca15a39e02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:52.344858 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042619f-0d0c-42d2-bf2f-aaca15a39e02 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:52.350090 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 920/1829] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:54:52 2022] POST /identity/v3/projects => generated 373 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:54:52.356530 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4fef9-7a49-4507-b3a2-8aed65314e97 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:52.390675 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 910/1830] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:54:52 2022] POST /identity/v3/projects => generated 363 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:54:52.395149 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042619f-0d0c-42d2-bf2f-aaca15a39e02 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:52.473332 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4fef9-7a49-4507-b3a2-8aed65314e97 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:52.491280 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:52.511846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042619f-0d0c-42d2-bf2f-aaca15a39e02 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:52.524600 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74425dd9-2bb7-4223-b6e3-c13ea3cfc154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:52.526478 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74425dd9-2bb7-4223-b6e3-c13ea3cfc154 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:52.527042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74425dd9-2bb7-4223-b6e3-c13ea3cfc154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:52.527332 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74425dd9-2bb7-4223-b6e3-c13ea3cfc154 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:52.530398 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74425dd9-2bb7-4223-b6e3-c13ea3cfc154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:52.533345 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74425dd9-2bb7-4223-b6e3-c13ea3cfc154 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:52.570914 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 911/1831] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:54:52 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 05:54:52.576154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74425dd9-2bb7-4223-b6e3-c13ea3cfc154 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:52.593060 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645adf5-5330-4b3b-8278-8f9b89760cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:52.594405 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645adf5-5330-4b3b-8278-8f9b89760cee admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:52.595345 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645adf5-5330-4b3b-8278-8f9b89760cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:52.595878 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645adf5-5330-4b3b-8278-8f9b89760cee admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:52.596307 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74425dd9-2bb7-4223-b6e3-c13ea3cfc154 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:52.597613 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645adf5-5330-4b3b-8278-8f9b89760cee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:52.603821 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645adf5-5330-4b3b-8278-8f9b89760cee admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:52.604689 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c5c19-f504-4806-98cd-c1221c788bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:52.606761 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c5c19-f504-4806-98cd-c1221c788bee admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:52.609822 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c5c19-f504-4806-98cd-c1221c788bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:52.610307 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c5c19-f504-4806-98cd-c1221c788bee admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:52.611282 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c5c19-f504-4806-98cd-c1221c788bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:52.615130 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c5c19-f504-4806-98cd-c1221c788bee admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:52.640723 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 912/1832] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:54:52.642482 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c5c19-f504-4806-98cd-c1221c788bee admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:52.658545 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c5c19-f504-4806-98cd-c1221c788bee admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:52.666979 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32068203-39cf-4db9-9851-1c0fb8f536dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:52.668195 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32068203-39cf-4db9-9851-1c0fb8f536dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:52.668574 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32068203-39cf-4db9-9851-1c0fb8f536dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:52.669184 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32068203-39cf-4db9-9851-1c0fb8f536dd admin admin] PATH_INFO: `/v3/projects/2d7079386ca145f39d360604c00e1d65/users/3bd1c6d538674919b02fb1d8ceece07b/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:52.688074 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 921/1833] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:54:52 2022] POST /identity/v3/users => generated 293 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:54:52.689873 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645adf5-5330-4b3b-8278-8f9b89760cee admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:52.700008 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32068203-39cf-4db9-9851-1c0fb8f536dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7079386ca145f39d360604c00e1d65, user_id=3bd1c6d538674919b02fb1d8ceece07b, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:52.710649 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32068203-39cf-4db9-9851-1c0fb8f536dd admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:52.727287 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645adf5-5330-4b3b-8278-8f9b89760cee admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:52.744881 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 913/1834] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:54:52 2022] PUT /identity/v3/projects/2d7079386ca145f39d360604c00e1d65/users/3bd1c6d538674919b02fb1d8ceece07b/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:52.757673 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32068203-39cf-4db9-9851-1c0fb8f536dd admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:52.865917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:52.904953 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a310c0-2dca-4119-b88e-5f6d0ec70a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:52.906900 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a310c0-2dca-4119-b88e-5f6d0ec70a4f admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:52.907335 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a310c0-2dca-4119-b88e-5f6d0ec70a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:52.907657 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a310c0-2dca-4119-b88e-5f6d0ec70a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:52.908537 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a310c0-2dca-4119-b88e-5f6d0ec70a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:52.916854 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a310c0-2dca-4119-b88e-5f6d0ec70a4f admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:52.950084 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 922/1835] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:54:52.965692 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a310c0-2dca-4119-b88e-5f6d0ec70a4f admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:53.003856 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a310c0-2dca-4119-b88e-5f6d0ec70a4f admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:53.017606 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32068203-39cf-4db9-9851-1c0fb8f536dd admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:53.027478 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9f012-7af7-4275-8078-702ae49f6464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:53.028498 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9f012-7af7-4275-8078-702ae49f6464 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:53.028784 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9f012-7af7-4275-8078-702ae49f6464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:53.029925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9f012-7af7-4275-8078-702ae49f6464 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:53.032408 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9f012-7af7-4275-8078-702ae49f6464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:53.039584 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9f012-7af7-4275-8078-702ae49f6464 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:53.042617 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3bf950-9831-4578-aeda-5f9fd13625a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:53.043942 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3bf950-9831-4578-aeda-5f9fd13625a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:53.044765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3bf950-9831-4578-aeda-5f9fd13625a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:53.048128 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3bf950-9831-4578-aeda-5f9fd13625a0 admin admin] PATH_INFO: `/v3/projects/b6078ca6833849d0b0b659d481a610c6/users/86d7726c32954ff2bd43df407b36b902/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:53.059515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 914/1836] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:54:53.070192 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9f012-7af7-4275-8078-702ae49f6464 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:53.088846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9f012-7af7-4275-8078-702ae49f6464 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:53.096512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37465ab5-4a85-446e-ad86-36b59ab9e078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:53.104950 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37465ab5-4a85-446e-ad86-36b59ab9e078 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:53.105554 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37465ab5-4a85-446e-ad86-36b59ab9e078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:53.106163 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37465ab5-4a85-446e-ad86-36b59ab9e078 admin admin] PATH_INFO: `/v3/projects/2d7079386ca145f39d360604c00e1d65/users/3bd1c6d538674919b02fb1d8ceece07b/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:53.115933 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37465ab5-4a85-446e-ad86-36b59ab9e078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7079386ca145f39d360604c00e1d65, user_id=3bd1c6d538674919b02fb1d8ceece07b, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:53.119009 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37465ab5-4a85-446e-ad86-36b59ab9e078 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:53.130640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3bf950-9831-4578-aeda-5f9fd13625a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6078ca6833849d0b0b659d481a610c6, user_id=86d7726c32954ff2bd43df407b36b902, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:53.142266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3bf950-9831-4578-aeda-5f9fd13625a0 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:53.151256 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 915/1837] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:54:53 2022] PUT /identity/v3/projects/2d7079386ca145f39d360604c00e1d65/users/3bd1c6d538674919b02fb1d8ceece07b/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:53.152952 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b2f14-d35c-4950-b870-cc9c78170a31 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:53.153293 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b2f14-d35c-4950-b870-cc9c78170a31 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:53.153675 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b2f14-d35c-4950-b870-cc9c78170a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:53.191489 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-323b2f14-d35c-4950-b870-cc9c78170a31 None None] MFA Rules not processed for user `3bd1c6d538674919b02fb1d8ceece07b`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:53.193015 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-323b2f14-d35c-4950-b870-cc9c78170a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:53.219743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 923/1838] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:54:52 2022] PUT /identity/v3/projects/b6078ca6833849d0b0b659d481a610c6/users/86d7726c32954ff2bd43df407b36b902/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:53.223626 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3bf950-9831-4578-aeda-5f9fd13625a0 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:53.321126 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 916/1839] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:53 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:53.337147 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b2f14-d35c-4950-b870-cc9c78170a31 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:53.339970 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-323b2f14-d35c-4950-b870-cc9c78170a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:53.423112 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3bf950-9831-4578-aeda-5f9fd13625a0 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:53.432606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65e699-0442-4ae5-adf8-f75a77c071a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:53.433513 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65e699-0442-4ae5-adf8-f75a77c071a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:53.434037 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65e699-0442-4ae5-adf8-f75a77c071a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:53.434396 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65e699-0442-4ae5-adf8-f75a77c071a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:53.436057 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65e699-0442-4ae5-adf8-f75a77c071a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:53.439261 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65e699-0442-4ae5-adf8-f75a77c071a0 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:53.455516 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b2f14-d35c-4950-b870-cc9c78170a31 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:53.459750 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f7b01-33c3-427b-962f-8de7346cfbc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:53.460617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f7b01-33c3-427b-962f-8de7346cfbc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:53.461983 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f7b01-33c3-427b-962f-8de7346cfbc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:53.462282 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f7b01-33c3-427b-962f-8de7346cfbc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:53.475846 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 924/1840] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:54:53.478233 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65e699-0442-4ae5-adf8-f75a77c071a0 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:53.482186 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f7b01-33c3-427b-962f-8de7346cfbc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:53.483933 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f7b01-33c3-427b-962f-8de7346cfbc2 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:53.492230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65e699-0442-4ae5-adf8-f75a77c071a0 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:53.499026 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d99ff6-cd3b-489c-8100-4b73a905a52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:53.500031 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d99ff6-cd3b-489c-8100-4b73a905a52a admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:53.500701 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 917/1841] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:53 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:54:53.502235 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d99ff6-cd3b-489c-8100-4b73a905a52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:53.502705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d99ff6-cd3b-489c-8100-4b73a905a52a admin admin] PATH_INFO: `/v3/projects/b6078ca6833849d0b0b659d481a610c6/users/86d7726c32954ff2bd43df407b36b902/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:53.506759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d99ff6-cd3b-489c-8100-4b73a905a52a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6078ca6833849d0b0b659d481a610c6, user_id=86d7726c32954ff2bd43df407b36b902, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:53.511141 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d99ff6-cd3b-489c-8100-4b73a905a52a admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:53.520798 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:53.527560 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 925/1842] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:54:53 2022] PUT /identity/v3/projects/b6078ca6833849d0b0b659d481a610c6/users/86d7726c32954ff2bd43df407b36b902/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 05:54:53.543576 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28793e8-5858-40b4-a738-bff34179eaf7 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:53.543927 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28793e8-5858-40b4-a738-bff34179eaf7 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:53.544134 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28793e8-5858-40b4-a738-bff34179eaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:53.579455 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-a28793e8-5858-40b4-a738-bff34179eaf7 None None] MFA Rules not processed for user `86d7726c32954ff2bd43df407b36b902`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:53.589328 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a28793e8-5858-40b4-a738-bff34179eaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:53.633542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:53.754237 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 918/1843] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:53 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:53.756246 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d99ff6-cd3b-489c-8100-4b73a905a52a admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:53.758405 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e3d99ff6-cd3b-489c-8100-4b73a905a52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:53.910393 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d99ff6-cd3b-489c-8100-4b73a905a52a admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:53.914790 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95d3ae-51cc-4b89-9ace-1481da2ce8ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:53.915594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95d3ae-51cc-4b89-9ace-1481da2ce8ad service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:53.915924 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95d3ae-51cc-4b89-9ace-1481da2ce8ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:53.916164 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95d3ae-51cc-4b89-9ace-1481da2ce8ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:54.052126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95d3ae-51cc-4b89-9ace-1481da2ce8ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:54.057340 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95d3ae-51cc-4b89-9ace-1481da2ce8ad service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:54.084154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 926/1844] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:54:54.343692 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28793e8-5858-40b4-a738-bff34179eaf7 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:54.501985 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28793e8-5858-40b4-a738-bff34179eaf7 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:54.510273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a82474-e671-408a-8ba0-8e17f29dc900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:54.511475 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a82474-e671-408a-8ba0-8e17f29dc900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:54.512272 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a82474-e671-408a-8ba0-8e17f29dc900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:54.512676 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a82474-e671-408a-8ba0-8e17f29dc900 admin admin] PATH_INFO: `/v3/users/4cd9db45f850458aaa5c18b912b1f620` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:54.515123 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a82474-e671-408a-8ba0-8e17f29dc900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cd9db45f850458aaa5c18b912b1f620)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:54.521457 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a82474-e671-408a-8ba0-8e17f29dc900 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:54.663399 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-82a82474-e671-408a-8ba0-8e17f29dc900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cd9db45f850458aaa5c18b912b1f620'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:54.724194 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-82a82474-e671-408a-8ba0-8e17f29dc900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cd9db45f850458aaa5c18b912b1f620'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:54.734327 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-82a82474-e671-408a-8ba0-8e17f29dc900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cd9db45f850458aaa5c18b912b1f620'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:54.740695 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-82a82474-e671-408a-8ba0-8e17f29dc900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cd9db45f850458aaa5c18b912b1f620'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:54.797287 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-82a82474-e671-408a-8ba0-8e17f29dc900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cd9db45f850458aaa5c18b912b1f620'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:54.846204 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 919/1845] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:54:54 2022] DELETE /identity/v3/users/4cd9db45f850458aaa5c18b912b1f620 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:54.852628 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb5027-0b95-472c-9e93-bafce5d89567 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:54.853153 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb5027-0b95-472c-9e93-bafce5d89567 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:54.853244 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb5027-0b95-472c-9e93-bafce5d89567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:54.895222 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-6bfb5027-0b95-472c-9e93-bafce5d89567 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:54.900133 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6bfb5027-0b95-472c-9e93-bafce5d89567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:55.039869 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 927/1846] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:55.140089 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a82474-e671-408a-8ba0-8e17f29dc900 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:55.143510 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-82a82474-e671-408a-8ba0-8e17f29dc900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:55.218451 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:55.238041 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a82474-e671-408a-8ba0-8e17f29dc900 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:55.243713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e44f13-7840-4be7-a50e-8d70e2dca1a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:55.244266 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e44f13-7840-4be7-a50e-8d70e2dca1a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:55.244266 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e44f13-7840-4be7-a50e-8d70e2dca1a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:55.244625 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e44f13-7840-4be7-a50e-8d70e2dca1a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:55.255245 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e44f13-7840-4be7-a50e-8d70e2dca1a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:55.256820 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e44f13-7840-4be7-a50e-8d70e2dca1a3 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:55.269204 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 920/1847] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:54:55.899521 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb5027-0b95-472c-9e93-bafce5d89567 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:55.902284 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6bfb5027-0b95-472c-9e93-bafce5d89567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:55.921162 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb5027-0b95-472c-9e93-bafce5d89567 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:55.941066 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d96b94-fb05-48ed-bbba-f04c8dab53ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:55.941844 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d96b94-fb05-48ed-bbba-f04c8dab53ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:55.942153 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d96b94-fb05-48ed-bbba-f04c8dab53ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:55.942437 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d96b94-fb05-48ed-bbba-f04c8dab53ae admin admin] PATH_INFO: `/v3/projects/fc302b38a5f746ac8ded162e5baca61e` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:55.944515 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d96b94-fb05-48ed-bbba-f04c8dab53ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc302b38a5f746ac8ded162e5baca61e)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:55.946497 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d96b94-fb05-48ed-bbba-f04c8dab53ae admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:56.028036 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:56.029979 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-51d96b94-fb05-48ed-bbba-f04c8dab53ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc302b38a5f746ac8ded162e5baca61e', 'request_id': 'req-51d96b94-fb05-48ed-bbba-f04c8dab53ae'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:56.038089 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-51d96b94-fb05-48ed-bbba-f04c8dab53ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc302b38a5f746ac8ded162e5baca61e', 'request_id': 'req-51d96b94-fb05-48ed-bbba-f04c8dab53ae'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:56.046019 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-51d96b94-fb05-48ed-bbba-f04c8dab53ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc302b38a5f746ac8ded162e5baca61e', 'request_id': 'req-51d96b94-fb05-48ed-bbba-f04c8dab53ae'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:56.059625 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e44f13-7840-4be7-a50e-8d70e2dca1a3 service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:56.061731 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-71e44f13-7840-4be7-a50e-8d70e2dca1a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:56.071665 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-51d96b94-fb05-48ed-bbba-f04c8dab53ae admin admin] The token cache is being invalidate because project fc302b38a5f746ac8ded162e5baca61e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:54:56.071958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-51d96b94-fb05-48ed-bbba-f04c8dab53ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:56.073604 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-51d96b94-fb05-48ed-bbba-f04c8dab53ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:56.076809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 928/1848] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:54:55 2022] DELETE /identity/v3/projects/fc302b38a5f746ac8ded162e5baca61e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:56.079534 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e44f13-7840-4be7-a50e-8d70e2dca1a3 service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:56.081445 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d96b94-fb05-48ed-bbba-f04c8dab53ae admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:56.082993 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-51d96b94-fb05-48ed-bbba-f04c8dab53ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:56.152102 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6355e62-c4b5-4a13-9b1f-029a6d7463c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:56.153396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6355e62-c4b5-4a13-9b1f-029a6d7463c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:56.153853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6355e62-c4b5-4a13-9b1f-029a6d7463c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:56.154678 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6355e62-c4b5-4a13-9b1f-029a6d7463c6 admin admin] PATH_INFO: `/v3/users/0f589ef92c104b6eaff43692bdc7c2b9` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:56.156668 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6355e62-c4b5-4a13-9b1f-029a6d7463c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f589ef92c104b6eaff43692bdc7c2b9)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:56.159737 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6355e62-c4b5-4a13-9b1f-029a6d7463c6 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:56.170379 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d96b94-fb05-48ed-bbba-f04c8dab53ae admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:56.175408 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5c793-7a0f-4be4-8941-028aaa96a03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:56.176349 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5c793-7a0f-4be4-8941-028aaa96a03b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:56.176637 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5c793-7a0f-4be4-8941-028aaa96a03b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:56.176916 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5c793-7a0f-4be4-8941-028aaa96a03b admin admin] PATH_INFO: `/v3/users/3bd1c6d538674919b02fb1d8ceece07b` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:56.178431 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5c793-7a0f-4be4-8941-028aaa96a03b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bd1c6d538674919b02fb1d8ceece07b)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:56.180372 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5c793-7a0f-4be4-8941-028aaa96a03b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:56.234555 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b6355e62-c4b5-4a13-9b1f-029a6d7463c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f589ef92c104b6eaff43692bdc7c2b9'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:56.248930 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ffd5c793-7a0f-4be4-8941-028aaa96a03b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bd1c6d538674919b02fb1d8ceece07b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:56.249230 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b6355e62-c4b5-4a13-9b1f-029a6d7463c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f589ef92c104b6eaff43692bdc7c2b9'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:56.250390 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b6355e62-c4b5-4a13-9b1f-029a6d7463c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f589ef92c104b6eaff43692bdc7c2b9'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:56.251291 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b6355e62-c4b5-4a13-9b1f-029a6d7463c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f589ef92c104b6eaff43692bdc7c2b9'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:56.261464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ffd5c793-7a0f-4be4-8941-028aaa96a03b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bd1c6d538674919b02fb1d8ceece07b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:56.263013 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ffd5c793-7a0f-4be4-8941-028aaa96a03b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bd1c6d538674919b02fb1d8ceece07b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:56.273072 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ffd5c793-7a0f-4be4-8941-028aaa96a03b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bd1c6d538674919b02fb1d8ceece07b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:56.273275 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b6355e62-c4b5-4a13-9b1f-029a6d7463c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f589ef92c104b6eaff43692bdc7c2b9'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:56.290458 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ffd5c793-7a0f-4be4-8941-028aaa96a03b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bd1c6d538674919b02fb1d8ceece07b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:56.290865 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 921/1849] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:54:56 2022] DELETE /identity/v3/users/0f589ef92c104b6eaff43692bdc7c2b9 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:56.297234 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c38b7-e7f4-45b7-b05f-06a16f05e161 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:56.297721 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c38b7-e7f4-45b7-b05f-06a16f05e161 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:56.298198 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c38b7-e7f4-45b7-b05f-06a16f05e161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:56.300553 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 929/1850] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:54:56 2022] DELETE /identity/v3/users/3bd1c6d538674919b02fb1d8ceece07b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:56.357802 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-c32c38b7-e7f4-45b7-b05f-06a16f05e161 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:56.359146 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c32c38b7-e7f4-45b7-b05f-06a16f05e161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:56.437760 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:56.454096 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 922/1851] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:56.496169 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5c793-7a0f-4be4-8941-028aaa96a03b admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:56.500100 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ffd5c793-7a0f-4be4-8941-028aaa96a03b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:56.631380 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5c793-7a0f-4be4-8941-028aaa96a03b admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:56.648973 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e48298-23ad-49fc-974d-dc43dfd088f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:56.649717 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e48298-23ad-49fc-974d-dc43dfd088f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:56.650037 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e48298-23ad-49fc-974d-dc43dfd088f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:56.650226 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e48298-23ad-49fc-974d-dc43dfd088f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:56.671585 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e48298-23ad-49fc-974d-dc43dfd088f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:56.672892 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e48298-23ad-49fc-974d-dc43dfd088f9 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:56.677506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:56.695815 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 930/1852] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:54:56.794355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb666d67-f82f-4330-850f-62a0945e2cdf None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:56.795551 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb666d67-f82f-4330-850f-62a0945e2cdf None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:56.795898 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb666d67-f82f-4330-850f-62a0945e2cdf None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:56.797645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 923/1853] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jun 21 05:54:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:54:56.811313 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65761f72-8406-485a-8516-07c0e6395b1d None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:56.812139 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65761f72-8406-485a-8516-07c0e6395b1d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:56.812678 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65761f72-8406-485a-8516-07c0e6395b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:56.839106 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-65761f72-8406-485a-8516-07c0e6395b1d None None] MFA Rules not processed for user `f702830987ba4548a4c2ee3d0e302d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:56.842157 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-65761f72-8406-485a-8516-07c0e6395b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:56.935945 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 931/1854] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jun 21 05:54:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:56.974944 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb666d67-f82f-4330-850f-62a0945e2cdf None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:56.977261 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-fb666d67-f82f-4330-850f-62a0945e2cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:56.995030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65761f72-8406-485a-8516-07c0e6395b1d None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:56.996385 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-65761f72-8406-485a-8516-07c0e6395b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:57.014223 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb666d67-f82f-4330-850f-62a0945e2cdf None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:57.020802 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2b516-c8e8-4498-83b1-5e0b38ebe907 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:57.022071 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2b516-c8e8-4498-83b1-5e0b38ebe907 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:57.022071 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2b516-c8e8-4498-83b1-5e0b38ebe907 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:57.022071 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2b516-c8e8-4498-83b1-5e0b38ebe907 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:57.033435 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65761f72-8406-485a-8516-07c0e6395b1d None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:57.034156 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2b516-c8e8-4498-83b1-5e0b38ebe907 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:57.036633 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2b516-c8e8-4498-83b1-5e0b38ebe907 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:57.048573 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba85b2a-0ec4-423d-a807-151e6b8065f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:57.049824 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 924/1855] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:54:57.049959 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba85b2a-0ec4-423d-a807-151e6b8065f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:57.058703 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba85b2a-0ec4-423d-a807-151e6b8065f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:57.059087 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba85b2a-0ec4-423d-a807-151e6b8065f8 admin admin] PATH_INFO: `/v3/projects/2d7079386ca145f39d360604c00e1d65` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:57.063613 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba85b2a-0ec4-423d-a807-151e6b8065f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d7079386ca145f39d360604c00e1d65)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:57.065632 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba85b2a-0ec4-423d-a807-151e6b8065f8 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:57.148898 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2b516-c8e8-4498-83b1-5e0b38ebe907 service nova] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:57.150618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c0b2b516-c8e8-4498-83b1-5e0b38ebe907 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:57.171343 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2b516-c8e8-4498-83b1-5e0b38ebe907 service nova] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:57.191837 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc9175-80d4-4ad1-8368-10be739fe386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:57.193676 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc9175-80d4-4ad1-8368-10be739fe386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:57.195669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc9175-80d4-4ad1-8368-10be739fe386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:57.195991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc9175-80d4-4ad1-8368-10be739fe386 admin admin] PATH_INFO: `/v3/users/aaf5f9bceabb47f6a1f19e83deb7f434` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:57.198564 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc9175-80d4-4ad1-8368-10be739fe386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaf5f9bceabb47f6a1f19e83deb7f434)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:57.200615 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc9175-80d4-4ad1-8368-10be739fe386 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:57.211645 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6ba85b2a-0ec4-423d-a807-151e6b8065f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d7079386ca145f39d360604c00e1d65', 'request_id': 'req-6ba85b2a-0ec4-423d-a807-151e6b8065f8'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:57.229130 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6ba85b2a-0ec4-423d-a807-151e6b8065f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d7079386ca145f39d360604c00e1d65', 'request_id': 'req-6ba85b2a-0ec4-423d-a807-151e6b8065f8'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:57.247428 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6ba85b2a-0ec4-423d-a807-151e6b8065f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d7079386ca145f39d360604c00e1d65', 'request_id': 'req-6ba85b2a-0ec4-423d-a807-151e6b8065f8'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:57.288564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6ba85b2a-0ec4-423d-a807-151e6b8065f8 admin admin] The token cache is being invalidate because project 2d7079386ca145f39d360604c00e1d65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:54:57.289039 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6ba85b2a-0ec4-423d-a807-151e6b8065f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:57.290237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6ba85b2a-0ec4-423d-a807-151e6b8065f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:57.298279 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 932/1856] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:54:56 2022] DELETE /identity/v3/projects/2d7079386ca145f39d360604c00e1d65 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:57.299486 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba85b2a-0ec4-423d-a807-151e6b8065f8 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:57.302618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6ba85b2a-0ec4-423d-a807-151e6b8065f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:57.405897 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba85b2a-0ec4-423d-a807-151e6b8065f8 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:57.411522 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e7806-7f84-46ef-b3bc-c438342b0766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:57.412796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e7806-7f84-46ef-b3bc-c438342b0766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:57.413250 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e7806-7f84-46ef-b3bc-c438342b0766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:57.413721 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e7806-7f84-46ef-b3bc-c438342b0766 admin admin] PATH_INFO: `/v3/projects/6d68a7112ffc4ead95e98f4d74ff9abc` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:57.415194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e7806-7f84-46ef-b3bc-c438342b0766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d68a7112ffc4ead95e98f4d74ff9abc)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:57.417422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e7806-7f84-46ef-b3bc-c438342b0766 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:57.455084 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:57.488872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-16cc9175-80d4-4ad1-8368-10be739fe386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaf5f9bceabb47f6a1f19e83deb7f434'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:57.495177 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a01e7806-7f84-46ef-b3bc-c438342b0766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d68a7112ffc4ead95e98f4d74ff9abc', 'request_id': 'req-a01e7806-7f84-46ef-b3bc-c438342b0766'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:57.499667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-16cc9175-80d4-4ad1-8368-10be739fe386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaf5f9bceabb47f6a1f19e83deb7f434'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:57.500372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-16cc9175-80d4-4ad1-8368-10be739fe386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaf5f9bceabb47f6a1f19e83deb7f434'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:57.501376 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-16cc9175-80d4-4ad1-8368-10be739fe386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaf5f9bceabb47f6a1f19e83deb7f434'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:57.502995 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a01e7806-7f84-46ef-b3bc-c438342b0766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d68a7112ffc4ead95e98f4d74ff9abc', 'request_id': 'req-a01e7806-7f84-46ef-b3bc-c438342b0766'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:57.509804 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a01e7806-7f84-46ef-b3bc-c438342b0766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d68a7112ffc4ead95e98f4d74ff9abc', 'request_id': 'req-a01e7806-7f84-46ef-b3bc-c438342b0766'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:57.519704 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-16cc9175-80d4-4ad1-8368-10be739fe386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaf5f9bceabb47f6a1f19e83deb7f434'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:57.528776 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a01e7806-7f84-46ef-b3bc-c438342b0766 admin admin] The token cache is being invalidate because project 6d68a7112ffc4ead95e98f4d74ff9abc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:54:57.529708 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a01e7806-7f84-46ef-b3bc-c438342b0766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:57.531491 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a01e7806-7f84-46ef-b3bc-c438342b0766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:57.538853 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 933/1857] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:54:57 2022] DELETE /identity/v3/projects/6d68a7112ffc4ead95e98f4d74ff9abc => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:57.540985 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a5607-c90b-4375-8450-47f7fa845646 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:57.541456 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a5607-c90b-4375-8450-47f7fa845646 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:57.542072 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a5607-c90b-4375-8450-47f7fa845646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:57.546974 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 925/1858] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:54:57 2022] DELETE /identity/v3/users/aaf5f9bceabb47f6a1f19e83deb7f434 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:57.550243 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc9175-80d4-4ad1-8368-10be739fe386 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:57.552481 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-16cc9175-80d4-4ad1-8368-10be739fe386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:57.574407 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-517a5607-c90b-4375-8450-47f7fa845646 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:57.576895 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-517a5607-c90b-4375-8450-47f7fa845646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:57.682193 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 934/1859] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:57.686885 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08d3ee-f031-41c9-8afc-946d36779024 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:57.690144 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08d3ee-f031-41c9-8afc-946d36779024 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:57.690730 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08d3ee-f031-41c9-8afc-946d36779024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:57.691457 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc9175-80d4-4ad1-8368-10be739fe386 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:57.699342 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b001e1-c41b-40a8-a612-4fc6fe277109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:57.701762 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b001e1-c41b-40a8-a612-4fc6fe277109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:57.702130 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b001e1-c41b-40a8-a612-4fc6fe277109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:57.702605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b001e1-c41b-40a8-a612-4fc6fe277109 admin admin] PATH_INFO: `/v3/users/bf66477099014a73867629e4b899d021` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:57.704664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b001e1-c41b-40a8-a612-4fc6fe277109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf66477099014a73867629e4b899d021)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:57.708571 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b001e1-c41b-40a8-a612-4fc6fe277109 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:57.714042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-2d08d3ee-f031-41c9-8afc-946d36779024 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:57.715254 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-2d08d3ee-f031-41c9-8afc-946d36779024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:57.726232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 935/1860] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:57.731261 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9621eb1-03ff-4f4d-b45d-9838ccda01fc None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:57.731557 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9621eb1-03ff-4f4d-b45d-9838ccda01fc None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:57.731845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9621eb1-03ff-4f4d-b45d-9838ccda01fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:57.764617 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-a9621eb1-03ff-4f4d-b45d-9838ccda01fc None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:57.765854 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a9621eb1-03ff-4f4d-b45d-9838ccda01fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:57.775705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 936/1861] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:57.782627 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9621eb1-03ff-4f4d-b45d-9838ccda01fc None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:57.784167 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a9621eb1-03ff-4f4d-b45d-9838ccda01fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:57.796419 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e2b001e1-c41b-40a8-a612-4fc6fe277109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf66477099014a73867629e4b899d021'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:57.812635 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e2b001e1-c41b-40a8-a612-4fc6fe277109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf66477099014a73867629e4b899d021'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:57.814591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e2b001e1-c41b-40a8-a612-4fc6fe277109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf66477099014a73867629e4b899d021'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:57.816058 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e2b001e1-c41b-40a8-a612-4fc6fe277109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf66477099014a73867629e4b899d021'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:57.830182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:57.852467 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e2b001e1-c41b-40a8-a612-4fc6fe277109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf66477099014a73867629e4b899d021'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:57.855728 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9621eb1-03ff-4f4d-b45d-9838ccda01fc None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:57.861029 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be724eb5-1aa3-446f-a072-a627a403e9be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:57.861698 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be724eb5-1aa3-446f-a072-a627a403e9be service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:57.862185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be724eb5-1aa3-446f-a072-a627a403e9be service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:57.862725 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be724eb5-1aa3-446f-a072-a627a403e9be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:57.869096 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-be724eb5-1aa3-446f-a072-a627a403e9be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:57.875094 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 926/1862] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:54:57 2022] DELETE /identity/v3/users/bf66477099014a73867629e4b899d021 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:57.876243 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b001e1-c41b-40a8-a612-4fc6fe277109 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:57.877726 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e2b001e1-c41b-40a8-a612-4fc6fe277109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:57.895715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be724eb5-1aa3-446f-a072-a627a403e9be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:57.897444 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be724eb5-1aa3-446f-a072-a627a403e9be service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:57.913034 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 937/1863] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:54:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:54:57.959147 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b001e1-c41b-40a8-a612-4fc6fe277109 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:57.967504 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812621c-14bb-41c4-926d-263741a8b7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:57.968423 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812621c-14bb-41c4-926d-263741a8b7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:57.968782 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812621c-14bb-41c4-926d-263741a8b7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:57.969223 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812621c-14bb-41c4-926d-263741a8b7f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:57.970226 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812621c-14bb-41c4-926d-263741a8b7f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:54:57.970541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812621c-14bb-41c4-926d-263741a8b7f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:57.972460 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812621c-14bb-41c4-926d-263741a8b7f3 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:57.989721 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 927/1864] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:54:57.995572 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be724eb5-1aa3-446f-a072-a627a403e9be service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:58.007146 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be724eb5-1aa3-446f-a072-a627a403e9be service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:58.012749 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f628b9-f8bb-494c-9f29-3cf1e6e356c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:58.013472 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f628b9-f8bb-494c-9f29-3cf1e6e356c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:58.013763 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f628b9-f8bb-494c-9f29-3cf1e6e356c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:58.014237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f628b9-f8bb-494c-9f29-3cf1e6e356c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:58.014958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f628b9-f8bb-494c-9f29-3cf1e6e356c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:58.017555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f628b9-f8bb-494c-9f29-3cf1e6e356c5 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:58.066048 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 938/1865] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:54:57 2022] POST /identity/v3/projects => generated 381 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 05:54:58.067146 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812621c-14bb-41c4-926d-263741a8b7f3 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:58.109814 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812621c-14bb-41c4-926d-263741a8b7f3 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:58.214857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bde068-8a20-4109-8993-221291c1a03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:58.217478 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bde068-8a20-4109-8993-221291c1a03a admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:58.217880 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bde068-8a20-4109-8993-221291c1a03a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:58.220602 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bde068-8a20-4109-8993-221291c1a03a admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:58.227953 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bde068-8a20-4109-8993-221291c1a03a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:58.233836 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bde068-8a20-4109-8993-221291c1a03a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:58.270365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f628b9-f8bb-494c-9f29-3cf1e6e356c5 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:58.273424 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-15f628b9-f8bb-494c-9f29-3cf1e6e356c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:58.303874 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f628b9-f8bb-494c-9f29-3cf1e6e356c5 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:58.323280 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574cbc39-9bcc-477c-8065-c8c4922ce3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:58.324591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574cbc39-9bcc-477c-8065-c8c4922ce3d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:58.324973 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574cbc39-9bcc-477c-8065-c8c4922ce3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:58.328658 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574cbc39-9bcc-477c-8065-c8c4922ce3d6 admin admin] PATH_INFO: `/v3/projects/7cc35edadd984aa3a32cf2c2bd937c06` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:58.331283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574cbc39-9bcc-477c-8065-c8c4922ce3d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cc35edadd984aa3a32cf2c2bd937c06)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:58.337230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574cbc39-9bcc-477c-8065-c8c4922ce3d6 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:58.343429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 928/1866] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:54:58 2022] POST /identity/v3/users => generated 291 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:54:58.347961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bde068-8a20-4109-8993-221291c1a03a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:58.364141 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:58.382324 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bde068-8a20-4109-8993-221291c1a03a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:58.403198 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef4126-ecbd-439c-9052-815f46d1f23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:58.404724 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef4126-ecbd-439c-9052-815f46d1f23c admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:58.405029 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef4126-ecbd-439c-9052-815f46d1f23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:58.405314 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef4126-ecbd-439c-9052-815f46d1f23c admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:58.407198 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef4126-ecbd-439c-9052-815f46d1f23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:58.411385 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef4126-ecbd-439c-9052-815f46d1f23c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:58.426351 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 929/1867] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 05:54:58.431338 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef4126-ecbd-439c-9052-815f46d1f23c admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:58.453895 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef4126-ecbd-439c-9052-815f46d1f23c admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:58.463545 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-574cbc39-9bcc-477c-8065-c8c4922ce3d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cc35edadd984aa3a32cf2c2bd937c06', 'request_id': 'req-574cbc39-9bcc-477c-8065-c8c4922ce3d6'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:58.475764 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-574cbc39-9bcc-477c-8065-c8c4922ce3d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cc35edadd984aa3a32cf2c2bd937c06', 'request_id': 'req-574cbc39-9bcc-477c-8065-c8c4922ce3d6'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:58.488263 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-574cbc39-9bcc-477c-8065-c8c4922ce3d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cc35edadd984aa3a32cf2c2bd937c06', 'request_id': 'req-574cbc39-9bcc-477c-8065-c8c4922ce3d6'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:58.508972 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-574cbc39-9bcc-477c-8065-c8c4922ce3d6 admin admin] The token cache is being invalidate because project 7cc35edadd984aa3a32cf2c2bd937c06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:54:58.509326 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-574cbc39-9bcc-477c-8065-c8c4922ce3d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:58.510217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-574cbc39-9bcc-477c-8065-c8c4922ce3d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:58.516064 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 939/1868] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:54:58 2022] DELETE /identity/v3/projects/7cc35edadd984aa3a32cf2c2bd937c06 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:58.518296 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2a729-e15d-4478-8529-3ada5d16cd72 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:58.518592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2a729-e15d-4478-8529-3ada5d16cd72 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:58.519163 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2a729-e15d-4478-8529-3ada5d16cd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:58.549598 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-6fc2a729-e15d-4478-8529-3ada5d16cd72 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:58.551218 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6fc2a729-e15d-4478-8529-3ada5d16cd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:58.579298 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:58.596461 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e45b9-3c79-490c-9e3b-044fb69e9753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:58.597583 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e45b9-3c79-490c-9e3b-044fb69e9753 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:58.598569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e45b9-3c79-490c-9e3b-044fb69e9753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:58.598569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e45b9-3c79-490c-9e3b-044fb69e9753 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:58.599615 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e45b9-3c79-490c-9e3b-044fb69e9753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:58.602526 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e45b9-3c79-490c-9e3b-044fb69e9753 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:58.622259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 930/1869] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:54:58.623938 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e45b9-3c79-490c-9e3b-044fb69e9753 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:58.627649 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-692e45b9-3c79-490c-9e3b-044fb69e9753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:58.639512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 940/1870] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:58.645426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e45b9-3c79-490c-9e3b-044fb69e9753 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:58.647932 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015528e4-2b37-4c21-9d93-1df0ca1d21c7 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:58.648992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015528e4-2b37-4c21-9d93-1df0ca1d21c7 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:58.649417 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015528e4-2b37-4c21-9d93-1df0ca1d21c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:58.651600 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c95ffe-fd0b-47b7-af3e-95f2094d9a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:58.652868 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c95ffe-fd0b-47b7-af3e-95f2094d9a0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:58.654794 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c95ffe-fd0b-47b7-af3e-95f2094d9a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:58.655319 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c95ffe-fd0b-47b7-af3e-95f2094d9a0d admin admin] PATH_INFO: `/v3/projects/e6c54b977ef64f06942356a40e231dc9/users/bc7f7785593c4af096e98a6033c7d889/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:58.675714 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c95ffe-fd0b-47b7-af3e-95f2094d9a0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6c54b977ef64f06942356a40e231dc9, user_id=bc7f7785593c4af096e98a6033c7d889, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:58.678758 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-015528e4-2b37-4c21-9d93-1df0ca1d21c7 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:58.679300 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c95ffe-fd0b-47b7-af3e-95f2094d9a0d admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:58.680325 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-015528e4-2b37-4c21-9d93-1df0ca1d21c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:58.712580 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 931/1871] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:54:58 2022] PUT /identity/v3/projects/e6c54b977ef64f06942356a40e231dc9/users/bc7f7785593c4af096e98a6033c7d889/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:58.714012 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb9ed7-09eb-4ae0-bbfd-e8b6b0f1b0f3 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:58.714370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb9ed7-09eb-4ae0-bbfd-e8b6b0f1b0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:58.714711 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb9ed7-09eb-4ae0-bbfd-e8b6b0f1b0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:58.716301 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 941/1872] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:58.720692 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015528e4-2b37-4c21-9d93-1df0ca1d21c7 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:58.735599 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015528e4-2b37-4c21-9d93-1df0ca1d21c7 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:58.755965 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-3edb9ed7-09eb-4ae0-bbfd-e8b6b0f1b0f3 None None] MFA Rules not processed for user `bc7f7785593c4af096e98a6033c7d889`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:54:58.756155 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3edb9ed7-09eb-4ae0-bbfd-e8b6b0f1b0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:58.833030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d443629-262b-432d-8843-a4bab9d1ecae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:58.833786 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d443629-262b-432d-8843-a4bab9d1ecae admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:58.834203 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d443629-262b-432d-8843-a4bab9d1ecae admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:58.834452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d443629-262b-432d-8843-a4bab9d1ecae admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:58.835178 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d443629-262b-432d-8843-a4bab9d1ecae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:54:58.835483 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d443629-262b-432d-8843-a4bab9d1ecae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:58.837199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d443629-262b-432d-8843-a4bab9d1ecae admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:58.850087 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 932/1873] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:54:58.851368 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb9ed7-09eb-4ae0-bbfd-e8b6b0f1b0f3 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:58.853188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3edb9ed7-09eb-4ae0-bbfd-e8b6b0f1b0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:58.854769 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 942/1874] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:54:58.855669 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d443629-262b-432d-8843-a4bab9d1ecae admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:58.869394 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d443629-262b-432d-8843-a4bab9d1ecae admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:58.869923 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb9ed7-09eb-4ae0-bbfd-e8b6b0f1b0f3 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:58.875568 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a29fe-1d11-42c1-a0de-e5b82fad7c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:58.875758 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a29fe-1d11-42c1-a0de-e5b82fad7c0f admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:58.876105 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a29fe-1d11-42c1-a0de-e5b82fad7c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:58.876451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a29fe-1d11-42c1-a0de-e5b82fad7c0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:58.876544 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe717da-141c-41d8-a75f-84f0052b6a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:58.877244 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a29fe-1d11-42c1-a0de-e5b82fad7c0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:58.877531 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe717da-141c-41d8-a75f-84f0052b6a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:58.877824 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe717da-141c-41d8-a75f-84f0052b6a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:58.878137 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe717da-141c-41d8-a75f-84f0052b6a43 admin admin] PATH_INFO: `/v3/projects/487a0115fb1249e4a7944e09af2b3005` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:58.879486 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe717da-141c-41d8-a75f-84f0052b6a43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=487a0115fb1249e4a7944e09af2b3005)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:58.879614 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a29fe-1d11-42c1-a0de-e5b82fad7c0f admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:58.881411 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe717da-141c-41d8-a75f-84f0052b6a43 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:58.905954 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:58.912439 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 943/1875] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:54:58 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:54:58.913519 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a29fe-1d11-42c1-a0de-e5b82fad7c0f admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:58.944461 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-dbe717da-141c-41d8-a75f-84f0052b6a43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '487a0115fb1249e4a7944e09af2b3005', 'request_id': 'req-dbe717da-141c-41d8-a75f-84f0052b6a43'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:58.953907 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-dbe717da-141c-41d8-a75f-84f0052b6a43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '487a0115fb1249e4a7944e09af2b3005', 'request_id': 'req-dbe717da-141c-41d8-a75f-84f0052b6a43'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:58.962103 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-dbe717da-141c-41d8-a75f-84f0052b6a43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '487a0115fb1249e4a7944e09af2b3005', 'request_id': 'req-dbe717da-141c-41d8-a75f-84f0052b6a43'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:58.983936 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-dbe717da-141c-41d8-a75f-84f0052b6a43 admin admin] The token cache is being invalidate because project 487a0115fb1249e4a7944e09af2b3005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:54:58.984239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-dbe717da-141c-41d8-a75f-84f0052b6a43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:58.984999 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-dbe717da-141c-41d8-a75f-84f0052b6a43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:58.986629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 933/1876] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:54:58 2022] DELETE /identity/v3/projects/487a0115fb1249e4a7944e09af2b3005 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:58.990522 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe717da-141c-41d8-a75f-84f0052b6a43 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:58.992068 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-dbe717da-141c-41d8-a75f-84f0052b6a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:59.000600 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a29fe-1d11-42c1-a0de-e5b82fad7c0f admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:59.035710 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:59.060035 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd78e16-4581-420b-945f-e36dab0929a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:59.061257 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd78e16-4581-420b-945f-e36dab0929a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:59.061713 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd78e16-4581-420b-945f-e36dab0929a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:59.062053 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd78e16-4581-420b-945f-e36dab0929a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:59.062847 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd78e16-4581-420b-945f-e36dab0929a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:59.063292 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe717da-141c-41d8-a75f-84f0052b6a43 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:59.064957 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd78e16-4581-420b-945f-e36dab0929a6 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:59.068237 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf1917-1b26-42da-8bdc-8216752fd930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:59.069248 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf1917-1b26-42da-8bdc-8216752fd930 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:59.069537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf1917-1b26-42da-8bdc-8216752fd930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:59.069815 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf1917-1b26-42da-8bdc-8216752fd930 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:59.071849 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf1917-1b26-42da-8bdc-8216752fd930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:59.072854 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf1917-1b26-42da-8bdc-8216752fd930 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:59.124050 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 944/1877] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:54:58 2022] POST /identity/v3/projects => generated 385 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:54:59.125342 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd78e16-4581-420b-945f-e36dab0929a6 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:59.128671 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6fd78e16-4581-420b-945f-e36dab0929a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:59.132886 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 934/1878] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:54:58 2022] POST /identity/v3/users => generated 297 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:54:59.132886 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf1917-1b26-42da-8bdc-8216752fd930 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:59.133609 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-23cf1917-1b26-42da-8bdc-8216752fd930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:59.159346 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf1917-1b26-42da-8bdc-8216752fd930 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:59.244236 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd78e16-4581-420b-945f-e36dab0929a6 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:59.249309 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d468981-230e-42b2-9f59-6ae09ee73c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:59.251055 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d468981-230e-42b2-9f59-6ae09ee73c95 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:59.251055 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d468981-230e-42b2-9f59-6ae09ee73c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:59.251271 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d468981-230e-42b2-9f59-6ae09ee73c95 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:59.251961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d468981-230e-42b2-9f59-6ae09ee73c95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:59.253260 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d7c23-2d7b-4bcb-a225-150820642eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:59.254470 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d7c23-2d7b-4bcb-a225-150820642eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:59.254824 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d468981-230e-42b2-9f59-6ae09ee73c95 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:59.255211 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d7c23-2d7b-4bcb-a225-150820642eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:59.256082 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d7c23-2d7b-4bcb-a225-150820642eee admin admin] PATH_INFO: `/v3/users/86d7726c32954ff2bd43df407b36b902` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:59.258322 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d7c23-2d7b-4bcb-a225-150820642eee admin admin] RBAC: Authorizing `identity:delete_user(user_id=86d7726c32954ff2bd43df407b36b902)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:59.261048 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d7c23-2d7b-4bcb-a225-150820642eee admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:59.315419 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 935/1879] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:54:59 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:54:59.315419 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d468981-230e-42b2-9f59-6ae09ee73c95 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:59.340347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d468981-230e-42b2-9f59-6ae09ee73c95 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:59.356962 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1b8b4-6e2d-4717-97d5-2109e1dfee20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:59.361529 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1b8b4-6e2d-4717-97d5-2109e1dfee20 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:59.363542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1b8b4-6e2d-4717-97d5-2109e1dfee20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:59.364020 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1b8b4-6e2d-4717-97d5-2109e1dfee20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:59.367349 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1b8b4-6e2d-4717-97d5-2109e1dfee20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:59.371866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1b8b4-6e2d-4717-97d5-2109e1dfee20 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:59.377042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:59.401022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 936/1880] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:54:59.402014 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1b8b4-6e2d-4717-97d5-2109e1dfee20 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:59.404064 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a77d7c23-2d7b-4bcb-a225-150820642eee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86d7726c32954ff2bd43df407b36b902'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:59.430364 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a77d7c23-2d7b-4bcb-a225-150820642eee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86d7726c32954ff2bd43df407b36b902'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:59.432614 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a77d7c23-2d7b-4bcb-a225-150820642eee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86d7726c32954ff2bd43df407b36b902'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:59.436776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1b8b4-6e2d-4717-97d5-2109e1dfee20 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:59.447166 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672af2f1-8d68-4366-a43c-ad9b575793a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:59.447998 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672af2f1-8d68-4366-a43c-ad9b575793a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:59.448288 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672af2f1-8d68-4366-a43c-ad9b575793a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:59.448565 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672af2f1-8d68-4366-a43c-ad9b575793a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:59.449373 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672af2f1-8d68-4366-a43c-ad9b575793a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:59.452260 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672af2f1-8d68-4366-a43c-ad9b575793a1 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:59.476170 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a77d7c23-2d7b-4bcb-a225-150820642eee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86d7726c32954ff2bd43df407b36b902'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:59.485246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 937/1881] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:54:59.489891 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672af2f1-8d68-4366-a43c-ad9b575793a1 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:59.494604 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a77d7c23-2d7b-4bcb-a225-150820642eee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86d7726c32954ff2bd43df407b36b902'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:54:59.512552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 945/1882] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:54:59 2022] DELETE /identity/v3/users/86d7726c32954ff2bd43df407b36b902 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:59.513623 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672af2f1-8d68-4366-a43c-ad9b575793a1 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:59.513770 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d7c23-2d7b-4bcb-a225-150820642eee admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:59.521488 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a77d7c23-2d7b-4bcb-a225-150820642eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:59.672227 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d7c23-2d7b-4bcb-a225-150820642eee admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:59.680948 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf26a5-2d90-4f00-b005-4d1aaca289b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:59.681205 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455d2a5-aa7b-4e63-b914-4fa424904536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:59.681807 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf26a5-2d90-4f00-b005-4d1aaca289b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:59.682213 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf26a5-2d90-4f00-b005-4d1aaca289b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:59.682570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf26a5-2d90-4f00-b005-4d1aaca289b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:59.682807 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455d2a5-aa7b-4e63-b914-4fa424904536 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:59.683296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455d2a5-aa7b-4e63-b914-4fa424904536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:59.683404 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf26a5-2d90-4f00-b005-4d1aaca289b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:59.683637 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455d2a5-aa7b-4e63-b914-4fa424904536 admin admin] PATH_INFO: `/v3/projects/2b6bf0c1c0594938aa8f3af4cea010c3/users/bcd1253988534c33b6022fef19ebb6a7/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:59.685430 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf26a5-2d90-4f00-b005-4d1aaca289b1 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:59.707407 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 946/1883] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:54:59.708965 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf26a5-2d90-4f00-b005-4d1aaca289b1 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:59.712410 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455d2a5-aa7b-4e63-b914-4fa424904536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b6bf0c1c0594938aa8f3af4cea010c3, user_id=bcd1253988534c33b6022fef19ebb6a7, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:59.715729 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455d2a5-aa7b-4e63-b914-4fa424904536 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:59.733922 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf26a5-2d90-4f00-b005-4d1aaca289b1 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:59.737730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 938/1884] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:54:59 2022] PUT /identity/v3/projects/2b6bf0c1c0594938aa8f3af4cea010c3/users/bcd1253988534c33b6022fef19ebb6a7/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:59.741647 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455d2a5-aa7b-4e63-b914-4fa424904536 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:59.744868 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d455d2a5-aa7b-4e63-b914-4fa424904536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:54:59.773300 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:59.840223 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455d2a5-aa7b-4e63-b914-4fa424904536 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:59.847276 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68c277-9aa0-4b99-a34b-63a1a59e8c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:59.848162 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68c277-9aa0-4b99-a34b-63a1a59e8c58 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:59.848474 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68c277-9aa0-4b99-a34b-63a1a59e8c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:59.849108 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68c277-9aa0-4b99-a34b-63a1a59e8c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:59.849965 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68c277-9aa0-4b99-a34b-63a1a59e8c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:59.851740 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68c277-9aa0-4b99-a34b-63a1a59e8c58 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:59.867018 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 939/1885] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:54:59.871645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68c277-9aa0-4b99-a34b-63a1a59e8c58 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:54:59.876512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab4479-2501-4e39-9fee-92bae888844c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:59.878441 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab4479-2501-4e39-9fee-92bae888844c admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:59.879586 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab4479-2501-4e39-9fee-92bae888844c admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:59.880278 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab4479-2501-4e39-9fee-92bae888844c admin admin] PATH_INFO: `/v3/projects/4bc66833f9f8412688d341f69681dee3/users/8a7c1bd202cd448f97eb4b32bdf4c321/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:59.888574 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68c277-9aa0-4b99-a34b-63a1a59e8c58 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:54:59.901690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34130947-b8e0-4df8-84f4-39a36a36cd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:54:59.902901 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34130947-b8e0-4df8-84f4-39a36a36cd3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:59.903329 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34130947-b8e0-4df8-84f4-39a36a36cd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:59.905977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34130947-b8e0-4df8-84f4-39a36a36cd3d admin admin] PATH_INFO: `/v3/projects/2b6bf0c1c0594938aa8f3af4cea010c3/users/bcd1253988534c33b6022fef19ebb6a7/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:59.909438 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34130947-b8e0-4df8-84f4-39a36a36cd3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b6bf0c1c0594938aa8f3af4cea010c3, user_id=bcd1253988534c33b6022fef19ebb6a7, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:59.913413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34130947-b8e0-4df8-84f4-39a36a36cd3d admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:59.918045 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab4479-2501-4e39-9fee-92bae888844c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bc66833f9f8412688d341f69681dee3, user_id=8a7c1bd202cd448f97eb4b32bdf4c321, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:54:59.921577 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab4479-2501-4e39-9fee-92bae888844c admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:54:59.940883 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 940/1886] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:54:59 2022] PUT /identity/v3/projects/2b6bf0c1c0594938aa8f3af4cea010c3/users/bcd1253988534c33b6022fef19ebb6a7/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:54:59.941987 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 947/1887] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:54:59 2022] PUT /identity/v3/projects/4bc66833f9f8412688d341f69681dee3/users/8a7c1bd202cd448f97eb4b32bdf4c321/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 05:54:59.951463 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275bee4-5bd9-4e15-b2bb-5457afbdb522 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:59.951764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275bee4-5bd9-4e15-b2bb-5457afbdb522 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:59.953708 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c0bda-2803-4d55-a984-cf08d5d75f69 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:54:59.954028 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c0bda-2803-4d55-a984-cf08d5d75f69 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:54:59.954313 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c0bda-2803-4d55-a984-cf08d5d75f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:59.954706 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275bee4-5bd9-4e15-b2bb-5457afbdb522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:54:59.998295 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-7275bee4-5bd9-4e15-b2bb-5457afbdb522 None None] MFA Rules not processed for user `bcd1253988534c33b6022fef19ebb6a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:00.000714 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-7275bee4-5bd9-4e15-b2bb-5457afbdb522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:00.061175 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-f88c0bda-2803-4d55-a984-cf08d5d75f69 None None] MFA Rules not processed for user `8a7c1bd202cd448f97eb4b32bdf4c321`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:00.063136 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f88c0bda-2803-4d55-a984-cf08d5d75f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:00.115523 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:00.180326 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 941/1888] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:59 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:00.192538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 948/1889] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:54:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:00.196257 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275bee4-5bd9-4e15-b2bb-5457afbdb522 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:00.197792 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c0bda-2803-4d55-a984-cf08d5d75f69 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:00.202952 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-7275bee4-5bd9-4e15-b2bb-5457afbdb522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:00.302769 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c0bda-2803-4d55-a984-cf08d5d75f69 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:00.307770 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911ef1f-1240-4c06-972d-e7664ce473aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:00.308462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911ef1f-1240-4c06-972d-e7664ce473aa admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:00.308747 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911ef1f-1240-4c06-972d-e7664ce473aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:00.309026 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911ef1f-1240-4c06-972d-e7664ce473aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:00.309736 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911ef1f-1240-4c06-972d-e7664ce473aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:00.312073 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911ef1f-1240-4c06-972d-e7664ce473aa admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:00.350632 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 949/1890] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:55:00 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:00.369158 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911ef1f-1240-4c06-972d-e7664ce473aa admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:00.385323 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275bee4-5bd9-4e15-b2bb-5457afbdb522 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:00.434831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:00.450185 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de49f8-5a00-45cd-aae8-2df7472776fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:00.451480 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de49f8-5a00-45cd-aae8-2df7472776fc service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:00.451767 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de49f8-5a00-45cd-aae8-2df7472776fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:00.452603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de49f8-5a00-45cd-aae8-2df7472776fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:00.496606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911ef1f-1240-4c06-972d-e7664ce473aa admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:00.503700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969537a-9704-4d49-bb7a-da24de66058a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:00.505692 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969537a-9704-4d49-bb7a-da24de66058a admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:00.506205 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969537a-9704-4d49-bb7a-da24de66058a admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:00.506587 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969537a-9704-4d49-bb7a-da24de66058a admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:00.507512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969537a-9704-4d49-bb7a-da24de66058a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:00.524102 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969537a-9704-4d49-bb7a-da24de66058a admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:00.567147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 950/1891] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:55:00 2022] POST /identity/v3/users => generated 294 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 05:55:00.567147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969537a-9704-4d49-bb7a-da24de66058a admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:00.579861 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3969537a-9704-4d49-bb7a-da24de66058a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:00.594388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969537a-9704-4d49-bb7a-da24de66058a admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:00.598919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de49f8-5a00-45cd-aae8-2df7472776fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:00.599913 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a9ca3-f01e-4b23-82f9-13ab60b1e897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:00.600949 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a9ca3-f01e-4b23-82f9-13ab60b1e897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:00.601239 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a9ca3-f01e-4b23-82f9-13ab60b1e897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:00.601478 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de49f8-5a00-45cd-aae8-2df7472776fc service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:00.601595 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a9ca3-f01e-4b23-82f9-13ab60b1e897 admin admin] PATH_INFO: `/v3/projects/b6078ca6833849d0b0b659d481a610c6` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:00.602809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a9ca3-f01e-4b23-82f9-13ab60b1e897 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6078ca6833849d0b0b659d481a610c6)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:00.604731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a9ca3-f01e-4b23-82f9-13ab60b1e897 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:00.613967 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 942/1892] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:55:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 05:55:00.615147 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de49f8-5a00-45cd-aae8-2df7472776fc service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:00.628810 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de49f8-5a00-45cd-aae8-2df7472776fc service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:00.634216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798d2c4-4de2-45e2-9975-46815f6fa08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:00.635119 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798d2c4-4de2-45e2-9975-46815f6fa08e admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:00.635842 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798d2c4-4de2-45e2-9975-46815f6fa08e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:00.636192 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798d2c4-4de2-45e2-9975-46815f6fa08e admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:00.637182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798d2c4-4de2-45e2-9975-46815f6fa08e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:00.640399 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798d2c4-4de2-45e2-9975-46815f6fa08e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:00.657959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 943/1893] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:55:00.659279 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798d2c4-4de2-45e2-9975-46815f6fa08e admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:00.669205 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:00.673114 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798d2c4-4de2-45e2-9975-46815f6fa08e admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:00.688970 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-687a9ca3-f01e-4b23-82f9-13ab60b1e897 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6078ca6833849d0b0b659d481a610c6', 'request_id': 'req-687a9ca3-f01e-4b23-82f9-13ab60b1e897'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:00.705759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-687a9ca3-f01e-4b23-82f9-13ab60b1e897 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6078ca6833849d0b0b659d481a610c6', 'request_id': 'req-687a9ca3-f01e-4b23-82f9-13ab60b1e897'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:00.714102 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-687a9ca3-f01e-4b23-82f9-13ab60b1e897 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6078ca6833849d0b0b659d481a610c6', 'request_id': 'req-687a9ca3-f01e-4b23-82f9-13ab60b1e897'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:00.737988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-687a9ca3-f01e-4b23-82f9-13ab60b1e897 admin admin] The token cache is being invalidate because project b6078ca6833849d0b0b659d481a610c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:55:00.737988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-687a9ca3-f01e-4b23-82f9-13ab60b1e897 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:00.737988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-687a9ca3-f01e-4b23-82f9-13ab60b1e897 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:00.737988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 951/1894] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:55:00 2022] DELETE /identity/v3/projects/b6078ca6833849d0b0b659d481a610c6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:00.741516 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf2316-3da9-40c0-9a65-0c847195c223 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:00.741977 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf2316-3da9-40c0-9a65-0c847195c223 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:00.742305 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf2316-3da9-40c0-9a65-0c847195c223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:00.764304 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b7936-840e-4137-a407-f31725381ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:00.764992 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b7936-840e-4137-a407-f31725381ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:00.765274 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b7936-840e-4137-a407-f31725381ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:00.765625 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b7936-840e-4137-a407-f31725381ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:00.766338 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b7936-840e-4137-a407-f31725381ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:00.767493 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-d5bf2316-3da9-40c0-9a65-0c847195c223 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:00.767994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b7936-840e-4137-a407-f31725381ad1 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:00.769088 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d5bf2316-3da9-40c0-9a65-0c847195c223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:00.778941 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 952/1895] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:55:00.788415 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 944/1896] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:55:00.791513 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb05d9-fe35-4a30-93e3-183a994a7d10 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:00.791813 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb05d9-fe35-4a30-93e3-183a994a7d10 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:00.792099 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb05d9-fe35-4a30-93e3-183a994a7d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:00.799290 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b7936-840e-4137-a407-f31725381ad1 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:00.801603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-2b2b7936-840e-4137-a407-f31725381ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:00.818445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b7936-840e-4137-a407-f31725381ad1 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:00.823452 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bd0e8-224d-4cce-b382-911687f78a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:00.824471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bd0e8-224d-4cce-b382-911687f78a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:00.824591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bd0e8-224d-4cce-b382-911687f78a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:00.825446 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bd0e8-224d-4cce-b382-911687f78a92 admin admin] PATH_INFO: `/v3/projects/a24c1ffa39a74075bb5a8a9b731ef05a/users/48a9a8c804cd40a8a2af5e440781b824/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:00.825561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-fabb05d9-fe35-4a30-93e3-183a994a7d10 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:00.827369 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-fabb05d9-fe35-4a30-93e3-183a994a7d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:00.838401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 953/1897] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:00.842842 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb05d9-fe35-4a30-93e3-183a994a7d10 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:00.849550 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9bd0e8-224d-4cce-b382-911687f78a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a24c1ffa39a74075bb5a8a9b731ef05a, user_id=48a9a8c804cd40a8a2af5e440781b824, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:00.853253 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9bd0e8-224d-4cce-b382-911687f78a92 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:00.855147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb05d9-fe35-4a30-93e3-183a994a7d10 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:00.864046 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3071e2-6295-4ae1-bebd-84f1edf49a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:00.864773 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3071e2-6295-4ae1-bebd-84f1edf49a55 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:00.865302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3071e2-6295-4ae1-bebd-84f1edf49a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:00.865797 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3071e2-6295-4ae1-bebd-84f1edf49a55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:00.867039 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3071e2-6295-4ae1-bebd-84f1edf49a55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:55:00.867461 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3071e2-6295-4ae1-bebd-84f1edf49a55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:00.869235 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3071e2-6295-4ae1-bebd-84f1edf49a55 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:00.875644 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 945/1898] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:55:00 2022] PUT /identity/v3/projects/a24c1ffa39a74075bb5a8a9b731ef05a/users/48a9a8c804cd40a8a2af5e440781b824/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:00.885151 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 954/1899] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:55:00.887068 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78df9ec-af4a-4594-b361-74ee9c5040ab None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:00.887544 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78df9ec-af4a-4594-b361-74ee9c5040ab None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:00.887972 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78df9ec-af4a-4594-b361-74ee9c5040ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:00.891206 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3071e2-6295-4ae1-bebd-84f1edf49a55 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:00.904469 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3071e2-6295-4ae1-bebd-84f1edf49a55 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:00.920988 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-d78df9ec-af4a-4594-b361-74ee9c5040ab None None] MFA Rules not processed for user `48a9a8c804cd40a8a2af5e440781b824`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:00.922294 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d78df9ec-af4a-4594-b361-74ee9c5040ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:00.977692 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:00.990486 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5292a04-744b-49fa-859a-d6157632c54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:00.991184 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5292a04-744b-49fa-859a-d6157632c54d admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:00.991577 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5292a04-744b-49fa-859a-d6157632c54d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:00.991855 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5292a04-744b-49fa-859a-d6157632c54d admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:00.992724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5292a04-744b-49fa-859a-d6157632c54d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:00.995089 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5292a04-744b-49fa-859a-d6157632c54d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:01.030517 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 946/1900] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:01.034144 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 955/1901] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:55:00 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:01.035491 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78df9ec-af4a-4594-b361-74ee9c5040ab None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:01.038999 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5292a04-744b-49fa-859a-d6157632c54d admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:01.074824 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78df9ec-af4a-4594-b361-74ee9c5040ab None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:01.127480 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5292a04-744b-49fa-859a-d6157632c54d admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:01.142202 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15425013-04a6-4ce3-ba49-4615e5fab970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:01.143973 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15425013-04a6-4ce3-ba49-4615e5fab970 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:01.144848 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15425013-04a6-4ce3-ba49-4615e5fab970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:01.145231 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15425013-04a6-4ce3-ba49-4615e5fab970 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:01.146293 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15425013-04a6-4ce3-ba49-4615e5fab970 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:01.149483 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15425013-04a6-4ce3-ba49-4615e5fab970 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:01.185648 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9c728-c50e-4219-bbf0-325099b2f1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:01.186047 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9c728-c50e-4219-bbf0-325099b2f1f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:01.186370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9c728-c50e-4219-bbf0-325099b2f1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:01.186845 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9c728-c50e-4219-bbf0-325099b2f1f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:01.187680 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9c728-c50e-4219-bbf0-325099b2f1f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:01.191005 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9c728-c50e-4219-bbf0-325099b2f1f6 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:01.198203 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 956/1902] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:55:01 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:01.199543 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15425013-04a6-4ce3-ba49-4615e5fab970 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:01.203801 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-15425013-04a6-4ce3-ba49-4615e5fab970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:01.210470 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:01.221845 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 947/1903] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:55:01 2022] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:01.222932 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9c728-c50e-4219-bbf0-325099b2f1f6 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:01.234629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9c728-c50e-4219-bbf0-325099b2f1f6 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:01.304824 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15425013-04a6-4ce3-ba49-4615e5fab970 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:01.309645 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46087ab5-07a5-4488-b3a3-1209188c3d30 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcd1253988534c33b6022fef19ebb6a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b6bf0c1c0594938aa8f3af4cea010c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:01.310407 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46087ab5-07a5-4488-b3a3-1209188c3d30 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:01.310698 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46087ab5-07a5-4488-b3a3-1209188c3d30 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:01.311205 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46087ab5-07a5-4488-b3a3-1209188c3d30 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:01.311719 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46087ab5-07a5-4488-b3a3-1209188c3d30 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:55:01.312391 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46087ab5-07a5-4488-b3a3-1209188c3d30 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:01.314052 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46087ab5-07a5-4488-b3a3-1209188c3d30 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:01.322182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d3193-6bfd-47d8-bc00-c68d1e6d08fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:01.322938 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d3193-6bfd-47d8-bc00-c68d1e6d08fc admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:01.323229 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d3193-6bfd-47d8-bc00-c68d1e6d08fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:01.323515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d3193-6bfd-47d8-bc00-c68d1e6d08fc admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:01.324503 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d3193-6bfd-47d8-bc00-c68d1e6d08fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:01.326919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d3193-6bfd-47d8-bc00-c68d1e6d08fc admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:01.332590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 957/1904] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:55:01.332590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46087ab5-07a5-4488-b3a3-1209188c3d30 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:01.346626 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46087ab5-07a5-4488-b3a3-1209188c3d30 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:01.352245 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d524bc1-8751-4cf3-b44d-619b666b4f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:01.352932 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d524bc1-8751-4cf3-b44d-619b666b4f6e admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:01.353265 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d524bc1-8751-4cf3-b44d-619b666b4f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:01.353699 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d524bc1-8751-4cf3-b44d-619b666b4f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:01.354478 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d524bc1-8751-4cf3-b44d-619b666b4f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:01.358347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 948/1905] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:55:01 2022] POST /identity/v3/users => generated 299 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:01.358347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d3193-6bfd-47d8-bc00-c68d1e6d08fc admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:01.358586 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d524bc1-8751-4cf3-b44d-619b666b4f6e admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:01.371184 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d3193-6bfd-47d8-bc00-c68d1e6d08fc admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:01.373206 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 958/1906] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:55:01.374183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d524bc1-8751-4cf3-b44d-619b666b4f6e admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:01.379794 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6781ac6-4949-405c-8e0f-e36d5e3665d7 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcd1253988534c33b6022fef19ebb6a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b6bf0c1c0594938aa8f3af4cea010c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:01.380530 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6781ac6-4949-405c-8e0f-e36d5e3665d7 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:01.381090 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6781ac6-4949-405c-8e0f-e36d5e3665d7 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:01.381479 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6781ac6-4949-405c-8e0f-e36d5e3665d7 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:01.382328 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6781ac6-4949-405c-8e0f-e36d5e3665d7 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:01.384546 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6781ac6-4949-405c-8e0f-e36d5e3665d7 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:01.391732 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d524bc1-8751-4cf3-b44d-619b666b4f6e admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:01.397311 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85628e11-8698-4fd6-8eb8-ced29b8efec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:01.398076 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85628e11-8698-4fd6-8eb8-ced29b8efec8 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:01.398361 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85628e11-8698-4fd6-8eb8-ced29b8efec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:01.399840 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85628e11-8698-4fd6-8eb8-ced29b8efec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:01.399840 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85628e11-8698-4fd6-8eb8-ced29b8efec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:01.401862 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85628e11-8698-4fd6-8eb8-ced29b8efec8 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:01.418622 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 959/1907] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:55:01.418622 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85628e11-8698-4fd6-8eb8-ced29b8efec8 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:01.423321 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 949/1908] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:55:01 2022] POST /identity/v3/projects => generated 354 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:01.423321 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6781ac6-4949-405c-8e0f-e36d5e3665d7 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:01.430207 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85628e11-8698-4fd6-8eb8-ced29b8efec8 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:01.492203 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:01.514223 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb5b48-9521-42ab-9316-58b41e1cbbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:01.515013 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb5b48-9521-42ab-9316-58b41e1cbbce admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:01.515183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb5b48-9521-42ab-9316-58b41e1cbbce admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:01.515452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb5b48-9521-42ab-9316-58b41e1cbbce admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:01.516180 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb5b48-9521-42ab-9316-58b41e1cbbce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:01.517783 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb5b48-9521-42ab-9316-58b41e1cbbce admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:01.542142 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6781ac6-4949-405c-8e0f-e36d5e3665d7 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:01.547172 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 960/1909] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:55:01.551753 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb5b48-9521-42ab-9316-58b41e1cbbce admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:01.561238 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b8b71-145f-4d68-b1cd-74c32c7b0b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:01.562183 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b8b71-145f-4d68-b1cd-74c32c7b0b29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:01.562462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b8b71-145f-4d68-b1cd-74c32c7b0b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:01.562736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b8b71-145f-4d68-b1cd-74c32c7b0b29 admin admin] PATH_INFO: `/v3/projects/844501d4e89a4662ac6bdfc8899bd4a9/users/d66f7f1ad96d4df798489f173655e09b/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:01.589089 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b8b71-145f-4d68-b1cd-74c32c7b0b29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=844501d4e89a4662ac6bdfc8899bd4a9, user_id=d66f7f1ad96d4df798489f173655e09b, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:01.592900 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b8b71-145f-4d68-b1cd-74c32c7b0b29 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:01.613289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 950/1910] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:55:01 2022] PUT /identity/v3/projects/844501d4e89a4662ac6bdfc8899bd4a9/users/d66f7f1ad96d4df798489f173655e09b/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:01.614892 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b8b71-145f-4d68-b1cd-74c32c7b0b29 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:01.710370 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb5b48-9521-42ab-9316-58b41e1cbbce admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:01.718710 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b8b71-145f-4d68-b1cd-74c32c7b0b29 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:01.727672 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:01.734812 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a76a7-9185-4686-ace3-95b4e0e6c3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:01.735745 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a76a7-9185-4686-ace3-95b4e0e6c3f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:01.736046 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a76a7-9185-4686-ace3-95b4e0e6c3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:01.736292 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a76a7-9185-4686-ace3-95b4e0e6c3f4 admin admin] PATH_INFO: `/v3/projects/cbeaefc57cd14db6ba982fc059b70b70/users/2decc2b4793f4b2297d6da0b32eb512e/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:01.756380 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a76a7-9185-4686-ace3-95b4e0e6c3f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbeaefc57cd14db6ba982fc059b70b70, user_id=2decc2b4793f4b2297d6da0b32eb512e, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:01.759495 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a76a7-9185-4686-ace3-95b4e0e6c3f4 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:01.784456 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 951/1911] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:55:01 2022] PUT /identity/v3/projects/cbeaefc57cd14db6ba982fc059b70b70/users/2decc2b4793f4b2297d6da0b32eb512e/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:01.785319 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a76a7-9185-4686-ace3-95b4e0e6c3f4 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:01.821494 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd945ca-28c6-4678-9b59-c7390bd10951 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcd1253988534c33b6022fef19ebb6a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b6bf0c1c0594938aa8f3af4cea010c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:01.822369 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd945ca-28c6-4678-9b59-c7390bd10951 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:01.822735 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd945ca-28c6-4678-9b59-c7390bd10951 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:01.823087 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd945ca-28c6-4678-9b59-c7390bd10951 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:01.824568 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd945ca-28c6-4678-9b59-c7390bd10951 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:55:01.824960 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd945ca-28c6-4678-9b59-c7390bd10951 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:01.827993 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd945ca-28c6-4678-9b59-c7390bd10951 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:01.848114 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 961/1912] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:55:01.848114 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd95d7-1822-466c-a933-205e7bd95905 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:01.848114 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd95d7-1822-466c-a933-205e7bd95905 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:01.848114 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd95d7-1822-466c-a933-205e7bd95905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:01.874678 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-e6cd95d7-1822-466c-a933-205e7bd95905 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:01.876184 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e6cd95d7-1822-466c-a933-205e7bd95905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:01.882088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a76a7-9185-4686-ace3-95b4e0e6c3f4 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:01.885462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 962/1913] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:01.893535 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a93540-e43c-4bae-b421-8aa5f35de798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:01.894263 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a93540-e43c-4bae-b421-8aa5f35de798 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:01.894547 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a93540-e43c-4bae-b421-8aa5f35de798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:01.894827 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a93540-e43c-4bae-b421-8aa5f35de798 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:01.895565 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a93540-e43c-4bae-b421-8aa5f35de798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:01.897567 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a93540-e43c-4bae-b421-8aa5f35de798 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:01.900272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd95d7-1822-466c-a933-205e7bd95905 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:01.907858 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e6cd95d7-1822-466c-a933-205e7bd95905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:01.916545 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 952/1914] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:55:01.916545 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a93540-e43c-4bae-b421-8aa5f35de798 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:01.981497 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:02.009825 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd95d7-1822-466c-a933-205e7bd95905 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:02.017113 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d228a-6991-4aae-bf73-7a092f4bb275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:02.018027 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d228a-6991-4aae-bf73-7a092f4bb275 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:02.018501 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d228a-6991-4aae-bf73-7a092f4bb275 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:02.018980 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d228a-6991-4aae-bf73-7a092f4bb275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:02.024583 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a93540-e43c-4bae-b421-8aa5f35de798 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:02.030868 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521938c-5095-40d1-b24d-ad7a5c0e6ea9 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcd1253988534c33b6022fef19ebb6a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b6bf0c1c0594938aa8f3af4cea010c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:02.031832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521938c-5095-40d1-b24d-ad7a5c0e6ea9 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:02.032130 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521938c-5095-40d1-b24d-ad7a5c0e6ea9 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:02.032365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d228a-6991-4aae-bf73-7a092f4bb275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:02.032475 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521938c-5095-40d1-b24d-ad7a5c0e6ea9 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] PATH_INFO: `/v3/projects/991360b04db04dc5bfc75a6682a9bbf8` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:02.034235 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521938c-5095-40d1-b24d-ad7a5c0e6ea9 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] RBAC: Authorizing `identity:delete_project(project_id=991360b04db04dc5bfc75a6682a9bbf8)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:02.036816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521938c-5095-40d1-b24d-ad7a5c0e6ea9 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:02.042825 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d228a-6991-4aae-bf73-7a092f4bb275 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:02.056195 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 963/1915] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:55:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 05:55:02.057417 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d228a-6991-4aae-bf73-7a092f4bb275 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:02.068109 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d228a-6991-4aae-bf73-7a092f4bb275 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:02.073191 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b4d0c-305c-4e4d-9ed1-9dbcb1021c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:02.074128 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b4d0c-305c-4e4d-9ed1-9dbcb1021c60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:02.074438 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b4d0c-305c-4e4d-9ed1-9dbcb1021c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:02.074730 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b4d0c-305c-4e4d-9ed1-9dbcb1021c60 admin admin] PATH_INFO: `/v3/projects/844501d4e89a4662ac6bdfc8899bd4a9/users/d66f7f1ad96d4df798489f173655e09b/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:02.077886 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b4d0c-305c-4e4d-9ed1-9dbcb1021c60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=844501d4e89a4662ac6bdfc8899bd4a9, user_id=d66f7f1ad96d4df798489f173655e09b, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:02.080957 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b4d0c-305c-4e4d-9ed1-9dbcb1021c60 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:02.093581 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 964/1916] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:55:02 2022] PUT /identity/v3/projects/844501d4e89a4662ac6bdfc8899bd4a9/users/d66f7f1ad96d4df798489f173655e09b/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:02.102182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8521938c-5095-40d1-b24d-ad7a5c0e6ea9 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '991360b04db04dc5bfc75a6682a9bbf8', 'request_id': 'req-8521938c-5095-40d1-b24d-ad7a5c0e6ea9'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:02.109591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8f8d5-e558-4085-b0b5-9e41953979ad None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:02.110112 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8f8d5-e558-4085-b0b5-9e41953979ad None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:02.110302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8f8d5-e558-4085-b0b5-9e41953979ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:02.114131 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8521938c-5095-40d1-b24d-ad7a5c0e6ea9 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '991360b04db04dc5bfc75a6682a9bbf8', 'request_id': 'req-8521938c-5095-40d1-b24d-ad7a5c0e6ea9'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:02.122458 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8521938c-5095-40d1-b24d-ad7a5c0e6ea9 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '991360b04db04dc5bfc75a6682a9bbf8', 'request_id': 'req-8521938c-5095-40d1-b24d-ad7a5c0e6ea9'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:02.134699 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8521938c-5095-40d1-b24d-ad7a5c0e6ea9 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] The token cache is being invalidate because project 991360b04db04dc5bfc75a6682a9bbf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:55:02.135082 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8521938c-5095-40d1-b24d-ad7a5c0e6ea9 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:02.136016 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8521938c-5095-40d1-b24d-ad7a5c0e6ea9 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:02.138053 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 953/1917] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:55:01 2022] DELETE /identity/v3/projects/991360b04db04dc5bfc75a6682a9bbf8 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:02.144833 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-aae8f8d5-e558-4085-b0b5-9e41953979ad None None] MFA Rules not processed for user `d66f7f1ad96d4df798489f173655e09b`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:02.146145 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-aae8f8d5-e558-4085-b0b5-9e41953979ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:02.240130 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 965/1918] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:02.259005 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521938c-5095-40d1-b24d-ad7a5c0e6ea9 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:02.260879 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8521938c-5095-40d1-b24d-ad7a5c0e6ea9 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:02.371609 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521938c-5095-40d1-b24d-ad7a5c0e6ea9 tempest-VolumeQuotaClassesTest-1041957836 tempest-VolumeQuotaClassesTest-1041957836-project-admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:02.496825 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07be66d-1ab3-4200-8bb9-0cf9d80fb5d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:02.502859 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07be66d-1ab3-4200-8bb9-0cf9d80fb5d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:02.503277 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07be66d-1ab3-4200-8bb9-0cf9d80fb5d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:02.503505 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8f8d5-e558-4085-b0b5-9e41953979ad None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:02.503819 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07be66d-1ab3-4200-8bb9-0cf9d80fb5d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:02.505351 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-aae8f8d5-e558-4085-b0b5-9e41953979ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:02.530628 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07be66d-1ab3-4200-8bb9-0cf9d80fb5d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:02.536974 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07be66d-1ab3-4200-8bb9-0cf9d80fb5d3 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:02.542697 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:02.550558 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 954/1919] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:55:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 05:55:02.635444 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8f8d5-e558-4085-b0b5-9e41953979ad None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:02.656411 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06f131-7a3f-44b8-9477-bb29b8dd6e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:02.657322 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06f131-7a3f-44b8-9477-bb29b8dd6e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:02.657609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06f131-7a3f-44b8-9477-bb29b8dd6e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:02.657889 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06f131-7a3f-44b8-9477-bb29b8dd6e87 admin admin] PATH_INFO: `/v3/users/bc7f7785593c4af096e98a6033c7d889` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:02.659483 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06f131-7a3f-44b8-9477-bb29b8dd6e87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc7f7785593c4af096e98a6033c7d889)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:02.664391 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06f131-7a3f-44b8-9477-bb29b8dd6e87 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:02.794290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-dc06f131-7a3f-44b8-9477-bb29b8dd6e87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc7f7785593c4af096e98a6033c7d889'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:02.813358 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-dc06f131-7a3f-44b8-9477-bb29b8dd6e87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc7f7785593c4af096e98a6033c7d889'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:02.815135 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-dc06f131-7a3f-44b8-9477-bb29b8dd6e87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc7f7785593c4af096e98a6033c7d889'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:02.840133 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-dc06f131-7a3f-44b8-9477-bb29b8dd6e87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc7f7785593c4af096e98a6033c7d889'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:02.859740 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-dc06f131-7a3f-44b8-9477-bb29b8dd6e87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc7f7785593c4af096e98a6033c7d889'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:02.868817 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 966/1920] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:55:02 2022] DELETE /identity/v3/users/bc7f7785593c4af096e98a6033c7d889 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 05:55:02.873527 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073eaa3-6d5f-4eb9-9e49-0140638a14ff None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:02.873821 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073eaa3-6d5f-4eb9-9e49-0140638a14ff None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:02.874130 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073eaa3-6d5f-4eb9-9e49-0140638a14ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:02.894259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-e073eaa3-6d5f-4eb9-9e49-0140638a14ff None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:02.895618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e073eaa3-6d5f-4eb9-9e49-0140638a14ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:02.936113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:02.989585 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 955/1921] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:02.999747 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06f131-7a3f-44b8-9477-bb29b8dd6e87 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:03.001182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-dc06f131-7a3f-44b8-9477-bb29b8dd6e87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:03.074569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9facdf-26c2-4174-a83a-deb4e57c17e6 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:03.074859 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9facdf-26c2-4174-a83a-deb4e57c17e6 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:03.075144 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9facdf-26c2-4174-a83a-deb4e57c17e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:03.117103 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-ad9facdf-26c2-4174-a83a-deb4e57c17e6 None None] MFA Rules not processed for user `2decc2b4793f4b2297d6da0b32eb512e`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:03.118509 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ad9facdf-26c2-4174-a83a-deb4e57c17e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:03.163821 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06f131-7a3f-44b8-9477-bb29b8dd6e87 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:03.173120 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce8c0a-ea7e-4d54-96da-6c8d7b1393fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:03.173803 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce8c0a-ea7e-4d54-96da-6c8d7b1393fe service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:03.174122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce8c0a-ea7e-4d54-96da-6c8d7b1393fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:03.177083 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce8c0a-ea7e-4d54-96da-6c8d7b1393fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:03.206012 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce8c0a-ea7e-4d54-96da-6c8d7b1393fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:03.207462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce8c0a-ea7e-4d54-96da-6c8d7b1393fe service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:03.230185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 967/1922] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:55:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 05:55:03.267256 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 956/1923] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:03.284141 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce8c0a-ea7e-4d54-96da-6c8d7b1393fe service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:03.285897 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a7ce8c0a-ea7e-4d54-96da-6c8d7b1393fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:03.357261 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9facdf-26c2-4174-a83a-deb4e57c17e6 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:03.358728 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ad9facdf-26c2-4174-a83a-deb4e57c17e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:03.382476 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:03.400777 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce8c0a-ea7e-4d54-96da-6c8d7b1393fe service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:03.406351 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205ba5d-835a-4cd3-b5fd-8f0bdbac53c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:03.407292 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205ba5d-835a-4cd3-b5fd-8f0bdbac53c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:03.407907 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205ba5d-835a-4cd3-b5fd-8f0bdbac53c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:03.408591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205ba5d-835a-4cd3-b5fd-8f0bdbac53c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:03.426647 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205ba5d-835a-4cd3-b5fd-8f0bdbac53c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:03.428947 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205ba5d-835a-4cd3-b5fd-8f0bdbac53c1 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:03.447060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9facdf-26c2-4174-a83a-deb4e57c17e6 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:03.452111 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce7efa-e06e-456b-acaf-0cfa1f308c34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:03.452792 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce7efa-e06e-456b-acaf-0cfa1f308c34 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:03.453076 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce7efa-e06e-456b-acaf-0cfa1f308c34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:03.453416 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce7efa-e06e-456b-acaf-0cfa1f308c34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:03.455414 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-9dce7efa-e06e-456b-acaf-0cfa1f308c34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:03.460460 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 968/1924] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:55:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:55:03.536171 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce7efa-e06e-456b-acaf-0cfa1f308c34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:03.537769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce7efa-e06e-456b-acaf-0cfa1f308c34 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:03.580835 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 957/1925] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:55:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:55:03.868645 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205ba5d-835a-4cd3-b5fd-8f0bdbac53c1 service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:03.875692 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d205ba5d-835a-4cd3-b5fd-8f0bdbac53c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:03.915367 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205ba5d-835a-4cd3-b5fd-8f0bdbac53c1 service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:03.944078 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb425212-61ef-4d35-b0ed-8850df8e7dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:03.945215 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb425212-61ef-4d35-b0ed-8850df8e7dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:03.945483 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb425212-61ef-4d35-b0ed-8850df8e7dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:03.945855 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb425212-61ef-4d35-b0ed-8850df8e7dd5 admin admin] PATH_INFO: `/v3/projects/e6c54b977ef64f06942356a40e231dc9` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:03.949554 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb425212-61ef-4d35-b0ed-8850df8e7dd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6c54b977ef64f06942356a40e231dc9)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:03.967237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb425212-61ef-4d35-b0ed-8850df8e7dd5 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:04.163657 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-bb425212-61ef-4d35-b0ed-8850df8e7dd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6c54b977ef64f06942356a40e231dc9', 'request_id': 'req-bb425212-61ef-4d35-b0ed-8850df8e7dd5'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:04.178465 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-bb425212-61ef-4d35-b0ed-8850df8e7dd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6c54b977ef64f06942356a40e231dc9', 'request_id': 'req-bb425212-61ef-4d35-b0ed-8850df8e7dd5'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:04.194262 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-bb425212-61ef-4d35-b0ed-8850df8e7dd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6c54b977ef64f06942356a40e231dc9', 'request_id': 'req-bb425212-61ef-4d35-b0ed-8850df8e7dd5'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:04.218592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-bb425212-61ef-4d35-b0ed-8850df8e7dd5 admin admin] The token cache is being invalidate because project e6c54b977ef64f06942356a40e231dc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:55:04.219186 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-bb425212-61ef-4d35-b0ed-8850df8e7dd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:04.220070 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-bb425212-61ef-4d35-b0ed-8850df8e7dd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:04.228421 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce7efa-e06e-456b-acaf-0cfa1f308c34 service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:04.228762 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 969/1926] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:55:03 2022] DELETE /identity/v3/projects/e6c54b977ef64f06942356a40e231dc9 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:04.251058 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce7efa-e06e-456b-acaf-0cfa1f308c34 service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:04.283917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:04.414872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730217a-3b87-4f07-843e-eb4da9b4459d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:04.416605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730217a-3b87-4f07-843e-eb4da9b4459d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:04.416936 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730217a-3b87-4f07-843e-eb4da9b4459d admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:04.417224 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730217a-3b87-4f07-843e-eb4da9b4459d admin admin] PATH_INFO: `/v3/users/bcd1253988534c33b6022fef19ebb6a7` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:04.422982 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b730217a-3b87-4f07-843e-eb4da9b4459d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcd1253988534c33b6022fef19ebb6a7)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:04.425711 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b730217a-3b87-4f07-843e-eb4da9b4459d admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:04.519081 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b730217a-3b87-4f07-843e-eb4da9b4459d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcd1253988534c33b6022fef19ebb6a7'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:04.531339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b730217a-3b87-4f07-843e-eb4da9b4459d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcd1253988534c33b6022fef19ebb6a7'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:04.532336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b730217a-3b87-4f07-843e-eb4da9b4459d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcd1253988534c33b6022fef19ebb6a7'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:04.533286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b730217a-3b87-4f07-843e-eb4da9b4459d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcd1253988534c33b6022fef19ebb6a7'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:04.569653 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b730217a-3b87-4f07-843e-eb4da9b4459d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcd1253988534c33b6022fef19ebb6a7'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:04.602645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 958/1927] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:55:04 2022] DELETE /identity/v3/users/bcd1253988534c33b6022fef19ebb6a7 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:04.933088 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb425212-61ef-4d35-b0ed-8850df8e7dd5 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:04.938017 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-bb425212-61ef-4d35-b0ed-8850df8e7dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:04.954532 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb425212-61ef-4d35-b0ed-8850df8e7dd5 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:05.047475 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b09f9-8e29-4dd5-b406-32a8f9ab8aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:05.048907 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b09f9-8e29-4dd5-b406-32a8f9ab8aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:05.050061 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b09f9-8e29-4dd5-b406-32a8f9ab8aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:05.050432 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b09f9-8e29-4dd5-b406-32a8f9ab8aba admin admin] PATH_INFO: `/v3/projects/2b6bf0c1c0594938aa8f3af4cea010c3` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:05.054177 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b09f9-8e29-4dd5-b406-32a8f9ab8aba admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b6bf0c1c0594938aa8f3af4cea010c3)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:05.056164 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b09f9-8e29-4dd5-b406-32a8f9ab8aba admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:05.123312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f76b09f9-8e29-4dd5-b406-32a8f9ab8aba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b6bf0c1c0594938aa8f3af4cea010c3', 'request_id': 'req-f76b09f9-8e29-4dd5-b406-32a8f9ab8aba'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:05.130639 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f76b09f9-8e29-4dd5-b406-32a8f9ab8aba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b6bf0c1c0594938aa8f3af4cea010c3', 'request_id': 'req-f76b09f9-8e29-4dd5-b406-32a8f9ab8aba'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:05.140007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f76b09f9-8e29-4dd5-b406-32a8f9ab8aba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b6bf0c1c0594938aa8f3af4cea010c3', 'request_id': 'req-f76b09f9-8e29-4dd5-b406-32a8f9ab8aba'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:05.149058 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:05.154573 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f76b09f9-8e29-4dd5-b406-32a8f9ab8aba admin admin] The token cache is being invalidate because project 2b6bf0c1c0594938aa8f3af4cea010c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:55:05.154916 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f76b09f9-8e29-4dd5-b406-32a8f9ab8aba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:05.155951 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f76b09f9-8e29-4dd5-b406-32a8f9ab8aba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:05.157983 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 970/1928] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:55:04 2022] DELETE /identity/v3/projects/2b6bf0c1c0594938aa8f3af4cea010c3 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:05.163818 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c85517-1c3e-4f19-9b29-747b23b7a63a None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:05.164307 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c85517-1c3e-4f19-9b29-747b23b7a63a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:05.164807 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c85517-1c3e-4f19-9b29-747b23b7a63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:05.185707 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-e0c85517-1c3e-4f19-9b29-747b23b7a63a None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:05.186983 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e0c85517-1c3e-4f19-9b29-747b23b7a63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:05.253266 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 959/1929] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:05.261263 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4d33b-74fe-4644-9e62-aadfc08a804e None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:05.261796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4d33b-74fe-4644-9e62-aadfc08a804e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:05.261796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4d33b-74fe-4644-9e62-aadfc08a804e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:05.292791 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bd3de-d3e4-4105-a31c-a123cb45203f None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:05.298273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bd3de-d3e4-4105-a31c-a123cb45203f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:05.298562 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bd3de-d3e4-4105-a31c-a123cb45203f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:05.302246 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-e8e4d33b-74fe-4644-9e62-aadfc08a804e None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:05.303942 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e8e4d33b-74fe-4644-9e62-aadfc08a804e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:05.315758 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 971/1930] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:05.320047 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4d33b-74fe-4644-9e62-aadfc08a804e None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:05.320202 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-5b7bd3de-d3e4-4105-a31c-a123cb45203f None None] MFA Rules not processed for user `2decc2b4793f4b2297d6da0b32eb512e`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:05.321400 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5b7bd3de-d3e4-4105-a31c-a123cb45203f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:05.330304 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4d33b-74fe-4644-9e62-aadfc08a804e None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:05.338196 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cde18-3c14-4cac-812d-06226718bdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:05.338196 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cde18-3c14-4cac-812d-06226718bdb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:05.338630 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cde18-3c14-4cac-812d-06226718bdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:05.338630 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cde18-3c14-4cac-812d-06226718bdb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:05.339333 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662cde18-3c14-4cac-812d-06226718bdb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:55:05.339644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662cde18-3c14-4cac-812d-06226718bdb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:05.341238 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662cde18-3c14-4cac-812d-06226718bdb1 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:05.361218 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:05.363974 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 972/1931] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:55:05.368248 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cde18-3c14-4cac-812d-06226718bdb1 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:05.384460 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cde18-3c14-4cac-812d-06226718bdb1 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:05.389904 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381ded1-7671-4f2c-9d70-a0fa2b6b9e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:05.390740 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381ded1-7671-4f2c-9d70-a0fa2b6b9e4a admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:05.390740 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381ded1-7671-4f2c-9d70-a0fa2b6b9e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:05.390740 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381ded1-7671-4f2c-9d70-a0fa2b6b9e4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:05.392135 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381ded1-7671-4f2c-9d70-a0fa2b6b9e4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:05.395684 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381ded1-7671-4f2c-9d70-a0fa2b6b9e4a admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:05.413739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 960/1932] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:05.434334 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 973/1933] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:55:05 2022] POST /identity/v3/projects => generated 379 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:05.439490 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7bd3de-d3e4-4105-a31c-a123cb45203f None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:05.453702 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7bd3de-d3e4-4105-a31c-a123cb45203f None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:05.546525 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e96020-8575-4ffb-9622-6957aefa3739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:05.547083 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e96020-8575-4ffb-9622-6957aefa3739 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:05.547369 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e96020-8575-4ffb-9622-6957aefa3739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:05.547654 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e96020-8575-4ffb-9622-6957aefa3739 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:05.548834 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e96020-8575-4ffb-9622-6957aefa3739 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:05.550374 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e96020-8575-4ffb-9622-6957aefa3739 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:05.643457 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 961/1934] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:55:05 2022] POST /identity/v3/users => generated 290 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:05.647878 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381ded1-7671-4f2c-9d70-a0fa2b6b9e4a admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:05.673726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381ded1-7671-4f2c-9d70-a0fa2b6b9e4a admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:05.681429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfb54a-4bd9-4bc9-9e41-e81cfb689e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:05.682168 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfb54a-4bd9-4bc9-9e41-e81cfb689e9f admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:05.682458 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfb54a-4bd9-4bc9-9e41-e81cfb689e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:05.682745 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfb54a-4bd9-4bc9-9e41-e81cfb689e9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:05.684298 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abfb54a-4bd9-4bc9-9e41-e81cfb689e9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:05.698453 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abfb54a-4bd9-4bc9-9e41-e81cfb689e9f admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:05.712595 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 974/1935] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:55:05.718195 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e96020-8575-4ffb-9622-6957aefa3739 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:05.735877 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e96020-8575-4ffb-9622-6957aefa3739 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:05.745688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9577a07-9aa6-41ae-b35b-b6d82daa1248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:05.746431 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9577a07-9aa6-41ae-b35b-b6d82daa1248 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:05.746872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9577a07-9aa6-41ae-b35b-b6d82daa1248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:05.747167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9577a07-9aa6-41ae-b35b-b6d82daa1248 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:05.748126 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9577a07-9aa6-41ae-b35b-b6d82daa1248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:05.749982 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9577a07-9aa6-41ae-b35b-b6d82daa1248 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:05.775575 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 962/1936] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:55:05.788913 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfb54a-4bd9-4bc9-9e41-e81cfb689e9f admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:05.801160 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfb54a-4bd9-4bc9-9e41-e81cfb689e9f admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:05.815328 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efe8e0-52bc-4506-ba05-e2a1fbcf33ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:05.816876 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efe8e0-52bc-4506-ba05-e2a1fbcf33ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:05.817249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efe8e0-52bc-4506-ba05-e2a1fbcf33ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:05.817714 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efe8e0-52bc-4506-ba05-e2a1fbcf33ff admin admin] PATH_INFO: `/v3/projects/46279b69185b4c2daaedc11f427832eb/users/5197f550446943cfb203501e2d331a1a/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:05.842937 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51efe8e0-52bc-4506-ba05-e2a1fbcf33ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=46279b69185b4c2daaedc11f427832eb, user_id=5197f550446943cfb203501e2d331a1a, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:05.846479 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51efe8e0-52bc-4506-ba05-e2a1fbcf33ff admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:05.875556 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 975/1937] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:55:05 2022] PUT /identity/v3/projects/46279b69185b4c2daaedc11f427832eb/users/5197f550446943cfb203501e2d331a1a/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:05.886942 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c73fd2-23be-447e-b06d-a3a6920408c1 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:05.887871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c73fd2-23be-447e-b06d-a3a6920408c1 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:05.887871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c73fd2-23be-447e-b06d-a3a6920408c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:05.927124 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-14c73fd2-23be-447e-b06d-a3a6920408c1 None None] MFA Rules not processed for user `5197f550446943cfb203501e2d331a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:05.929035 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-14c73fd2-23be-447e-b06d-a3a6920408c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:06.024812 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 963/1938] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:06.034826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efe8e0-52bc-4506-ba05-e2a1fbcf33ff admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:06.037397 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-51efe8e0-52bc-4506-ba05-e2a1fbcf33ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:06.150561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efe8e0-52bc-4506-ba05-e2a1fbcf33ff admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:06.155943 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353dc33-324b-4686-ace9-e9482fed5eba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:06.157451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353dc33-324b-4686-ace9-e9482fed5eba service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:06.157918 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353dc33-324b-4686-ace9-e9482fed5eba service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:06.158390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353dc33-324b-4686-ace9-e9482fed5eba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:06.178880 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353dc33-324b-4686-ace9-e9482fed5eba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:06.181782 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353dc33-324b-4686-ace9-e9482fed5eba service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:06.206153 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 976/1939] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:55:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:55:06.236060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c73fd2-23be-447e-b06d-a3a6920408c1 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:06.353740 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:06.406386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c73fd2-23be-447e-b06d-a3a6920408c1 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:06.411943 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70291e14-01d1-4855-98ed-4c29e4b1822a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:06.412864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70291e14-01d1-4855-98ed-4c29e4b1822a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:06.413148 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70291e14-01d1-4855-98ed-4c29e4b1822a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:06.413428 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70291e14-01d1-4855-98ed-4c29e4b1822a admin admin] PATH_INFO: `/v3/users/5197f550446943cfb203501e2d331a1a` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:06.415730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70291e14-01d1-4855-98ed-4c29e4b1822a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5197f550446943cfb203501e2d331a1a)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:06.417728 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70291e14-01d1-4855-98ed-4c29e4b1822a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:06.513744 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-70291e14-01d1-4855-98ed-4c29e4b1822a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5197f550446943cfb203501e2d331a1a'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:06.531590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-70291e14-01d1-4855-98ed-4c29e4b1822a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5197f550446943cfb203501e2d331a1a'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:06.532432 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-70291e14-01d1-4855-98ed-4c29e4b1822a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5197f550446943cfb203501e2d331a1a'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:06.533331 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-70291e14-01d1-4855-98ed-4c29e4b1822a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5197f550446943cfb203501e2d331a1a'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:06.553484 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-70291e14-01d1-4855-98ed-4c29e4b1822a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5197f550446943cfb203501e2d331a1a'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:06.593373 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 964/1940] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:55:06 2022] DELETE /identity/v3/users/5197f550446943cfb203501e2d331a1a => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:06.598351 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fa3b4-552d-4137-8b0f-fd5705acb654 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:06.599774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fa3b4-552d-4137-8b0f-fd5705acb654 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:06.600222 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fa3b4-552d-4137-8b0f-fd5705acb654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:06.646936 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-0b6fa3b4-552d-4137-8b0f-fd5705acb654 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:06.649713 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0b6fa3b4-552d-4137-8b0f-fd5705acb654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:06.843952 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 977/1941] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:06.901902 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70291e14-01d1-4855-98ed-4c29e4b1822a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:06.904591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-70291e14-01d1-4855-98ed-4c29e4b1822a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:07.072982 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70291e14-01d1-4855-98ed-4c29e4b1822a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:07.081450 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca61a89-2ebb-4992-902c-276f5f6f93d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:07.082152 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca61a89-2ebb-4992-902c-276f5f6f93d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:07.082438 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca61a89-2ebb-4992-902c-276f5f6f93d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:07.082719 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca61a89-2ebb-4992-902c-276f5f6f93d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:07.108271 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca61a89-2ebb-4992-902c-276f5f6f93d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:07.110175 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca61a89-2ebb-4992-902c-276f5f6f93d8 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:07.131843 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 965/1942] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:55:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 05:55:08.051682 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fa3b4-552d-4137-8b0f-fd5705acb654 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:08.053237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0b6fa3b4-552d-4137-8b0f-fd5705acb654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:08.066219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fa3b4-552d-4137-8b0f-fd5705acb654 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:08.071681 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435223f6-3ea6-45ef-9903-33c4866545c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:08.072818 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435223f6-3ea6-45ef-9903-33c4866545c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:08.073284 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435223f6-3ea6-45ef-9903-33c4866545c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:08.073708 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435223f6-3ea6-45ef-9903-33c4866545c9 admin admin] PATH_INFO: `/v3/projects/46279b69185b4c2daaedc11f427832eb` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:08.075981 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435223f6-3ea6-45ef-9903-33c4866545c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46279b69185b4c2daaedc11f427832eb)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:08.078602 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435223f6-3ea6-45ef-9903-33c4866545c9 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:08.112784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:08.171134 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-435223f6-3ea6-45ef-9903-33c4866545c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46279b69185b4c2daaedc11f427832eb', 'request_id': 'req-435223f6-3ea6-45ef-9903-33c4866545c9'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:08.178419 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-435223f6-3ea6-45ef-9903-33c4866545c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46279b69185b4c2daaedc11f427832eb', 'request_id': 'req-435223f6-3ea6-45ef-9903-33c4866545c9'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:08.187201 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-435223f6-3ea6-45ef-9903-33c4866545c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46279b69185b4c2daaedc11f427832eb', 'request_id': 'req-435223f6-3ea6-45ef-9903-33c4866545c9'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:08.208802 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-435223f6-3ea6-45ef-9903-33c4866545c9 admin admin] The token cache is being invalidate because project 46279b69185b4c2daaedc11f427832eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:55:08.209102 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-435223f6-3ea6-45ef-9903-33c4866545c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:08.209846 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-435223f6-3ea6-45ef-9903-33c4866545c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:08.215814 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 978/1943] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:55:08 2022] DELETE /identity/v3/projects/46279b69185b4c2daaedc11f427832eb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:08.217570 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ca7d7-7e99-49a4-b087-aa43097e05f5 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:08.218052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ca7d7-7e99-49a4-b087-aa43097e05f5 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:08.218227 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ca7d7-7e99-49a4-b087-aa43097e05f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:08.246421 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-f56ca7d7-7e99-49a4-b087-aa43097e05f5 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:08.249371 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f56ca7d7-7e99-49a4-b087-aa43097e05f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:08.348983 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 966/1944] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:08.357892 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c42882-c50c-450d-aea4-1ca95f17988b None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:08.358215 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c42882-c50c-450d-aea4-1ca95f17988b None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:08.358515 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c42882-c50c-450d-aea4-1ca95f17988b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:08.391309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-97c42882-c50c-450d-aea4-1ca95f17988b None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:08.393472 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-97c42882-c50c-450d-aea4-1ca95f17988b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:08.405264 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 979/1945] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:08.409395 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ca7d7-7e99-49a4-b087-aa43097e05f5 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:08.419467 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ca7d7-7e99-49a4-b087-aa43097e05f5 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:08.424424 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc87ffb-3815-4e5f-ae33-d865f3a0a976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:08.425101 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc87ffb-3815-4e5f-ae33-d865f3a0a976 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:08.425431 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc87ffb-3815-4e5f-ae33-d865f3a0a976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:08.425712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc87ffb-3815-4e5f-ae33-d865f3a0a976 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:08.426490 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc87ffb-3815-4e5f-ae33-d865f3a0a976 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:55:08.426796 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc87ffb-3815-4e5f-ae33-d865f3a0a976 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:08.428477 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc87ffb-3815-4e5f-ae33-d865f3a0a976 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:08.431659 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:08.447590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 967/1946] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:55:08.449239 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c42882-c50c-450d-aea4-1ca95f17988b None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:08.469125 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c42882-c50c-450d-aea4-1ca95f17988b None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:08.485402 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8a059-ed73-41f8-b093-db7d3b6857b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:08.485402 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8a059-ed73-41f8-b093-db7d3b6857b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:08.485402 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8a059-ed73-41f8-b093-db7d3b6857b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:08.485402 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8a059-ed73-41f8-b093-db7d3b6857b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:08.485911 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8a059-ed73-41f8-b093-db7d3b6857b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:08.485911 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8a059-ed73-41f8-b093-db7d3b6857b3 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:08.527117 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 980/1947] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:55:08 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:08.532424 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc87ffb-3815-4e5f-ae33-d865f3a0a976 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:08.554641 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc87ffb-3815-4e5f-ae33-d865f3a0a976 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:08.631909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8a059-ed73-41f8-b093-db7d3b6857b3 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:08.634194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-83d8a059-ed73-41f8-b093-db7d3b6857b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:08.691441 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3fd9f-13a3-41a0-a71d-df014635d0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:08.692184 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3fd9f-13a3-41a0-a71d-df014635d0dc admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:08.692588 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3fd9f-13a3-41a0-a71d-df014635d0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:08.692885 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3fd9f-13a3-41a0-a71d-df014635d0dc admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:08.693708 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3fd9f-13a3-41a0-a71d-df014635d0dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:08.696438 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3fd9f-13a3-41a0-a71d-df014635d0dc admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:08.723670 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8a059-ed73-41f8-b093-db7d3b6857b3 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:08.730710 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4062d53-4ca1-48c0-b0e8-2bcac63a0d37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:08.732624 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4062d53-4ca1-48c0-b0e8-2bcac63a0d37 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:08.733168 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4062d53-4ca1-48c0-b0e8-2bcac63a0d37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:08.733558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4062d53-4ca1-48c0-b0e8-2bcac63a0d37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:08.736135 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d4062d53-4ca1-48c0-b0e8-2bcac63a0d37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:08.739447 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 968/1948] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:55:08 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:08.744889 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3fd9f-13a3-41a0-a71d-df014635d0dc admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:08.769621 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3fd9f-13a3-41a0-a71d-df014635d0dc admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:08.776672 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac9688-7d61-4d39-acf6-c460447b516a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:08.777812 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac9688-7d61-4d39-acf6-c460447b516a admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:08.778206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac9688-7d61-4d39-acf6-c460447b516a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:08.778638 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac9688-7d61-4d39-acf6-c460447b516a admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:08.779496 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac9688-7d61-4d39-acf6-c460447b516a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:08.781423 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac9688-7d61-4d39-acf6-c460447b516a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:08.804276 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 969/1949] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 05:55:08.809629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac9688-7d61-4d39-acf6-c460447b516a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:08.827192 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac9688-7d61-4d39-acf6-c460447b516a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:08.833751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc2c5c-77b6-4764-871e-545acee09ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:08.834506 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc2c5c-77b6-4764-871e-545acee09ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:08.834887 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc2c5c-77b6-4764-871e-545acee09ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:08.835175 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc2c5c-77b6-4764-871e-545acee09ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:08.837474 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc2c5c-77b6-4764-871e-545acee09ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:08.837731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4062d53-4ca1-48c0-b0e8-2bcac63a0d37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:08.839522 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc2c5c-77b6-4764-871e-545acee09ff9 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:08.843182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4062d53-4ca1-48c0-b0e8-2bcac63a0d37 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:08.862814 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 970/1950] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 05:55:08.863720 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 981/1951] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:55:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:55:08.867552 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc2c5c-77b6-4764-871e-545acee09ff9 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:08.882784 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc2c5c-77b6-4764-871e-545acee09ff9 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:08.889831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bb5b4-c642-47e0-b2ad-02385e5c772d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:08.890858 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bb5b4-c642-47e0-b2ad-02385e5c772d admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:08.891145 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bb5b4-c642-47e0-b2ad-02385e5c772d admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:08.891772 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bb5b4-c642-47e0-b2ad-02385e5c772d admin admin] PATH_INFO: `/v3/projects/8acb00e69a354a91a41fcd6d086221f9/users/57b7fcc4c39e4efeb06d4dcd4034e8c1/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:08.917237 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bb5b4-c642-47e0-b2ad-02385e5c772d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8acb00e69a354a91a41fcd6d086221f9, user_id=57b7fcc4c39e4efeb06d4dcd4034e8c1, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:08.922119 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bb5b4-c642-47e0-b2ad-02385e5c772d admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:08.945625 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 971/1952] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:55:08 2022] PUT /identity/v3/projects/8acb00e69a354a91a41fcd6d086221f9/users/57b7fcc4c39e4efeb06d4dcd4034e8c1/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 05:55:08.957230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8ab72-3455-4471-8772-8cb3f831b568 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:08.957737 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8ab72-3455-4471-8772-8cb3f831b568 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:08.958169 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8ab72-3455-4471-8772-8cb3f831b568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:09.016073 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-18a8ab72-3455-4471-8772-8cb3f831b568 None None] MFA Rules not processed for user `57b7fcc4c39e4efeb06d4dcd4034e8c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:09.017854 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-18a8ab72-3455-4471-8772-8cb3f831b568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:09.050888 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:09.135895 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 982/1953] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:09.151912 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bb5b4-c642-47e0-b2ad-02385e5c772d admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:09.156198 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a44bb5b4-c642-47e0-b2ad-02385e5c772d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:09.315160 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bb5b4-c642-47e0-b2ad-02385e5c772d admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:09.324827 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c93bba-2d8c-477a-92af-03b4ce1674fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:09.327533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c93bba-2d8c-477a-92af-03b4ce1674fa service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:09.327977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c93bba-2d8c-477a-92af-03b4ce1674fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:09.328561 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c93bba-2d8c-477a-92af-03b4ce1674fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:09.354535 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c93bba-2d8c-477a-92af-03b4ce1674fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:09.356320 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c93bba-2d8c-477a-92af-03b4ce1674fa service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:09.367856 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 972/1954] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:55:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:55:11.914537 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8ab72-3455-4471-8772-8cb3f831b568 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:11.916010 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-18a8ab72-3455-4471-8772-8cb3f831b568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:12.011760 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8ab72-3455-4471-8772-8cb3f831b568 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:12.022847 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bdd6d-4661-47c3-8bee-50ec284cc7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:12.025200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bdd6d-4661-47c3-8bee-50ec284cc7d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:12.026273 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bdd6d-4661-47c3-8bee-50ec284cc7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:12.026418 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bdd6d-4661-47c3-8bee-50ec284cc7d2 admin admin] PATH_INFO: `/v3/users/8a7c1bd202cd448f97eb4b32bdf4c321` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:12.028512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bdd6d-4661-47c3-8bee-50ec284cc7d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a7c1bd202cd448f97eb4b32bdf4c321)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:12.031754 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bdd6d-4661-47c3-8bee-50ec284cc7d2 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:12.144461 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-912bdd6d-4661-47c3-8bee-50ec284cc7d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a7c1bd202cd448f97eb4b32bdf4c321'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:12.155301 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-912bdd6d-4661-47c3-8bee-50ec284cc7d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a7c1bd202cd448f97eb4b32bdf4c321'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:12.156140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-912bdd6d-4661-47c3-8bee-50ec284cc7d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a7c1bd202cd448f97eb4b32bdf4c321'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:12.166982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-912bdd6d-4661-47c3-8bee-50ec284cc7d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a7c1bd202cd448f97eb4b32bdf4c321'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:12.186830 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-912bdd6d-4661-47c3-8bee-50ec284cc7d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a7c1bd202cd448f97eb4b32bdf4c321'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:12.198253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 983/1955] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:55:11 2022] DELETE /identity/v3/users/8a7c1bd202cd448f97eb4b32bdf4c321 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:12.203196 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7a196-3e5d-496b-9788-77337e2e9006 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:12.203997 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7a196-3e5d-496b-9788-77337e2e9006 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:12.203997 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7a196-3e5d-496b-9788-77337e2e9006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:12.224982 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-3ed7a196-3e5d-496b-9788-77337e2e9006 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:12.226963 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3ed7a196-3e5d-496b-9788-77337e2e9006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:12.281055 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:12.316501 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 973/1956] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:55:12.325889 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bdd6d-4661-47c3-8bee-50ec284cc7d2 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:12.327978 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-912bdd6d-4661-47c3-8bee-50ec284cc7d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:12.380990 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:12.396319 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bdd6d-4661-47c3-8bee-50ec284cc7d2 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:12.400624 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593fa18-cc32-4cd7-98fc-2050e1cbfec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:12.401277 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593fa18-cc32-4cd7-98fc-2050e1cbfec6 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:12.401557 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593fa18-cc32-4cd7-98fc-2050e1cbfec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:12.401835 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593fa18-cc32-4cd7-98fc-2050e1cbfec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:12.412052 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593fa18-cc32-4cd7-98fc-2050e1cbfec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:12.413489 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593fa18-cc32-4cd7-98fc-2050e1cbfec6 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:12.424069 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 984/1957] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:55:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:55:12.764057 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7a196-3e5d-496b-9788-77337e2e9006 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:12.766240 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3ed7a196-3e5d-496b-9788-77337e2e9006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:12.792300 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7a196-3e5d-496b-9788-77337e2e9006 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:12.799953 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d99f8e-0698-4a5e-a15f-7f3bf076caef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:12.800880 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d99f8e-0698-4a5e-a15f-7f3bf076caef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:12.801101 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d99f8e-0698-4a5e-a15f-7f3bf076caef admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:12.801386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d99f8e-0698-4a5e-a15f-7f3bf076caef admin admin] PATH_INFO: `/v3/projects/4bc66833f9f8412688d341f69681dee3` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:12.802653 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d99f8e-0698-4a5e-a15f-7f3bf076caef admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bc66833f9f8412688d341f69681dee3)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:12.804714 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d99f8e-0698-4a5e-a15f-7f3bf076caef admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:12.876874 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c8d99f8e-0698-4a5e-a15f-7f3bf076caef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bc66833f9f8412688d341f69681dee3', 'request_id': 'req-c8d99f8e-0698-4a5e-a15f-7f3bf076caef'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:12.892026 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c8d99f8e-0698-4a5e-a15f-7f3bf076caef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bc66833f9f8412688d341f69681dee3', 'request_id': 'req-c8d99f8e-0698-4a5e-a15f-7f3bf076caef'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:12.906718 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c8d99f8e-0698-4a5e-a15f-7f3bf076caef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bc66833f9f8412688d341f69681dee3', 'request_id': 'req-c8d99f8e-0698-4a5e-a15f-7f3bf076caef'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:12.927703 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c8d99f8e-0698-4a5e-a15f-7f3bf076caef admin admin] The token cache is being invalidate because project 4bc66833f9f8412688d341f69681dee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:55:12.927703 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c8d99f8e-0698-4a5e-a15f-7f3bf076caef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:12.931296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c8d99f8e-0698-4a5e-a15f-7f3bf076caef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:12.933262 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 974/1958] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:55:12 2022] DELETE /identity/v3/projects/4bc66833f9f8412688d341f69681dee3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:12.938045 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593fa18-cc32-4cd7-98fc-2050e1cbfec6 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:12.959407 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593fa18-cc32-4cd7-98fc-2050e1cbfec6 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:13.031818 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5986851-8fb5-4679-b80e-39ebe6e57fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:13.032283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5986851-8fb5-4679-b80e-39ebe6e57fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:13.032431 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5986851-8fb5-4679-b80e-39ebe6e57fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:13.033055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5986851-8fb5-4679-b80e-39ebe6e57fac admin admin] PATH_INFO: `/v3/users/48a9a8c804cd40a8a2af5e440781b824` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:13.034528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5986851-8fb5-4679-b80e-39ebe6e57fac admin admin] RBAC: Authorizing `identity:delete_user(user_id=48a9a8c804cd40a8a2af5e440781b824)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:13.036696 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5986851-8fb5-4679-b80e-39ebe6e57fac admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:13.109647 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b5986851-8fb5-4679-b80e-39ebe6e57fac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48a9a8c804cd40a8a2af5e440781b824'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:13.118732 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b5986851-8fb5-4679-b80e-39ebe6e57fac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48a9a8c804cd40a8a2af5e440781b824'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:13.119605 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b5986851-8fb5-4679-b80e-39ebe6e57fac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48a9a8c804cd40a8a2af5e440781b824'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:13.136527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b5986851-8fb5-4679-b80e-39ebe6e57fac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48a9a8c804cd40a8a2af5e440781b824'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:13.157971 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b5986851-8fb5-4679-b80e-39ebe6e57fac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48a9a8c804cd40a8a2af5e440781b824'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:13.164495 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 985/1959] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:55:12 2022] DELETE /identity/v3/users/48a9a8c804cd40a8a2af5e440781b824 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:13.491275 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d99f8e-0698-4a5e-a15f-7f3bf076caef admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:13.493183 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c8d99f8e-0698-4a5e-a15f-7f3bf076caef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:13.507964 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d99f8e-0698-4a5e-a15f-7f3bf076caef admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:13.579035 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99cdfe-eba0-4c7f-9562-ced9887e63e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:13.579818 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99cdfe-eba0-4c7f-9562-ced9887e63e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:13.580099 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99cdfe-eba0-4c7f-9562-ced9887e63e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:13.580377 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99cdfe-eba0-4c7f-9562-ced9887e63e9 admin admin] PATH_INFO: `/v3/projects/a24c1ffa39a74075bb5a8a9b731ef05a` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:13.581898 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99cdfe-eba0-4c7f-9562-ced9887e63e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a24c1ffa39a74075bb5a8a9b731ef05a)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:13.584537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99cdfe-eba0-4c7f-9562-ced9887e63e9 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:13.633592 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-2e99cdfe-eba0-4c7f-9562-ced9887e63e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a24c1ffa39a74075bb5a8a9b731ef05a', 'request_id': 'req-2e99cdfe-eba0-4c7f-9562-ced9887e63e9'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:13.643523 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-2e99cdfe-eba0-4c7f-9562-ced9887e63e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a24c1ffa39a74075bb5a8a9b731ef05a', 'request_id': 'req-2e99cdfe-eba0-4c7f-9562-ced9887e63e9'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:13.651393 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-2e99cdfe-eba0-4c7f-9562-ced9887e63e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a24c1ffa39a74075bb5a8a9b731ef05a', 'request_id': 'req-2e99cdfe-eba0-4c7f-9562-ced9887e63e9'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:13.657007 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:13.670092 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-2e99cdfe-eba0-4c7f-9562-ced9887e63e9 admin admin] The token cache is being invalidate because project a24c1ffa39a74075bb5a8a9b731ef05a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:55:13.670698 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-2e99cdfe-eba0-4c7f-9562-ced9887e63e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:13.673486 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-2e99cdfe-eba0-4c7f-9562-ced9887e63e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:13.683329 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 975/1960] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:55:13 2022] DELETE /identity/v3/projects/a24c1ffa39a74075bb5a8a9b731ef05a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:13.688778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5986851-8fb5-4679-b80e-39ebe6e57fac admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:13.691059 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b5986851-8fb5-4679-b80e-39ebe6e57fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:13.711362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5986851-8fb5-4679-b80e-39ebe6e57fac admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:13.774386 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85db9e-e0a0-4439-8c23-34602101b82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:13.775266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85db9e-e0a0-4439-8c23-34602101b82a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:13.775556 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85db9e-e0a0-4439-8c23-34602101b82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:13.775838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85db9e-e0a0-4439-8c23-34602101b82a admin admin] PATH_INFO: `/v3/users/d66f7f1ad96d4df798489f173655e09b` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:13.777083 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85db9e-e0a0-4439-8c23-34602101b82a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d66f7f1ad96d4df798489f173655e09b)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:13.779069 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85db9e-e0a0-4439-8c23-34602101b82a admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:13.783902 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:13.828885 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0e85db9e-e0a0-4439-8c23-34602101b82a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd66f7f1ad96d4df798489f173655e09b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:13.835839 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0e85db9e-e0a0-4439-8c23-34602101b82a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd66f7f1ad96d4df798489f173655e09b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:13.836459 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0e85db9e-e0a0-4439-8c23-34602101b82a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd66f7f1ad96d4df798489f173655e09b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:13.843748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0e85db9e-e0a0-4439-8c23-34602101b82a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd66f7f1ad96d4df798489f173655e09b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:13.858769 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0e85db9e-e0a0-4439-8c23-34602101b82a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd66f7f1ad96d4df798489f173655e09b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:13.866212 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 986/1961] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:55:13 2022] DELETE /identity/v3/users/d66f7f1ad96d4df798489f173655e09b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:14.182507 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99cdfe-eba0-4c7f-9562-ced9887e63e9 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:14.184660 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-2e99cdfe-eba0-4c7f-9562-ced9887e63e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:14.209320 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99cdfe-eba0-4c7f-9562-ced9887e63e9 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:14.270257 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a660ba9-12c9-4202-946b-55075e826c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:14.271123 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a660ba9-12c9-4202-946b-55075e826c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:14.271406 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a660ba9-12c9-4202-946b-55075e826c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:14.271687 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a660ba9-12c9-4202-946b-55075e826c60 admin admin] PATH_INFO: `/v3/projects/844501d4e89a4662ac6bdfc8899bd4a9` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:14.272919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a660ba9-12c9-4202-946b-55075e826c60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=844501d4e89a4662ac6bdfc8899bd4a9)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:14.274884 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a660ba9-12c9-4202-946b-55075e826c60 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:14.321859 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4a660ba9-12c9-4202-946b-55075e826c60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '844501d4e89a4662ac6bdfc8899bd4a9', 'request_id': 'req-4a660ba9-12c9-4202-946b-55075e826c60'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:14.329536 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4a660ba9-12c9-4202-946b-55075e826c60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '844501d4e89a4662ac6bdfc8899bd4a9', 'request_id': 'req-4a660ba9-12c9-4202-946b-55075e826c60'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:14.335765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4a660ba9-12c9-4202-946b-55075e826c60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '844501d4e89a4662ac6bdfc8899bd4a9', 'request_id': 'req-4a660ba9-12c9-4202-946b-55075e826c60'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:14.346747 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4a660ba9-12c9-4202-946b-55075e826c60 admin admin] The token cache is being invalidate because project 844501d4e89a4662ac6bdfc8899bd4a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:55:14.347020 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4a660ba9-12c9-4202-946b-55075e826c60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:14.347669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4a660ba9-12c9-4202-946b-55075e826c60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:14.349479 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 976/1962] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:55:14 2022] DELETE /identity/v3/projects/844501d4e89a4662ac6bdfc8899bd4a9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:14.355531 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabeb864-7b4b-4d16-a64a-917f4eff8763 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:14.356001 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabeb864-7b4b-4d16-a64a-917f4eff8763 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:14.356164 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabeb864-7b4b-4d16-a64a-917f4eff8763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:14.376636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-aabeb864-7b4b-4d16-a64a-917f4eff8763 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:14.377846 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-aabeb864-7b4b-4d16-a64a-917f4eff8763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:14.458116 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 987/1963] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:55:14.469788 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13589d4d-b353-42d1-8c4a-bf3e7221143c None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:14.469788 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13589d4d-b353-42d1-8c4a-bf3e7221143c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:14.469788 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13589d4d-b353-42d1-8c4a-bf3e7221143c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:14.492613 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-13589d4d-b353-42d1-8c4a-bf3e7221143c None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:14.494950 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-13589d4d-b353-42d1-8c4a-bf3e7221143c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:14.510952 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 977/1964] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:14.512231 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabeb864-7b4b-4d16-a64a-917f4eff8763 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:14.523498 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabeb864-7b4b-4d16-a64a-917f4eff8763 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:14.530398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c4ec7-32e8-4e4a-b71c-0ef7a38ba567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:14.531737 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c4ec7-32e8-4e4a-b71c-0ef7a38ba567 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:14.532086 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c4ec7-32e8-4e4a-b71c-0ef7a38ba567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:14.532330 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c4ec7-32e8-4e4a-b71c-0ef7a38ba567 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:14.533094 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c4ec7-32e8-4e4a-b71c-0ef7a38ba567 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:55:14.533400 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c4ec7-32e8-4e4a-b71c-0ef7a38ba567 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:14.535115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c4ec7-32e8-4e4a-b71c-0ef7a38ba567 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:14.550157 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 988/1965] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:55:14.555844 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13589d4d-b353-42d1-8c4a-bf3e7221143c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:14.567256 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13589d4d-b353-42d1-8c4a-bf3e7221143c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:14.572574 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fac45-b564-4427-9fb9-87b23c04735f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:14.573336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fac45-b564-4427-9fb9-87b23c04735f admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:14.573714 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fac45-b564-4427-9fb9-87b23c04735f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:14.574114 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fac45-b564-4427-9fb9-87b23c04735f admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:14.574978 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001fac45-b564-4427-9fb9-87b23c04735f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:14.577505 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001fac45-b564-4427-9fb9-87b23c04735f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:14.614003 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 978/1966] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:55:14 2022] POST /identity/v3/projects => generated 407 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:14.618531 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c4ec7-32e8-4e4a-b71c-0ef7a38ba567 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:14.629672 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c4ec7-32e8-4e4a-b71c-0ef7a38ba567 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:14.687389 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062dba29-9405-4c14-a0b9-470a13179567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:14.687977 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062dba29-9405-4c14-a0b9-470a13179567 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:14.688266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062dba29-9405-4c14-a0b9-470a13179567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:14.688548 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062dba29-9405-4c14-a0b9-470a13179567 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:14.689232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062dba29-9405-4c14-a0b9-470a13179567 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:14.691186 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062dba29-9405-4c14-a0b9-470a13179567 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:14.708468 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:14.716264 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 989/1967] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:55:14 2022] POST /identity/v3/users => generated 304 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:14.717984 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fac45-b564-4427-9fb9-87b23c04735f admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:14.728727 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fac45-b564-4427-9fb9-87b23c04735f admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:14.733454 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e0f01-87e6-484d-9d26-188c7a8b49f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:14.734154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e0f01-87e6-484d-9d26-188c7a8b49f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:14.734443 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e0f01-87e6-484d-9d26-188c7a8b49f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:14.734723 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e0f01-87e6-484d-9d26-188c7a8b49f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:14.735454 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e0f01-87e6-484d-9d26-188c7a8b49f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:14.737120 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e0f01-87e6-484d-9d26-188c7a8b49f3 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:14.748541 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 979/1968] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:55:14.752653 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062dba29-9405-4c14-a0b9-470a13179567 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:14.764304 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062dba29-9405-4c14-a0b9-470a13179567 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:14.769608 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02aecf-ebf6-498e-b5f4-f3e1902e8623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:14.770387 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02aecf-ebf6-498e-b5f4-f3e1902e8623 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:14.770670 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02aecf-ebf6-498e-b5f4-f3e1902e8623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:14.770966 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02aecf-ebf6-498e-b5f4-f3e1902e8623 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:14.771685 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02aecf-ebf6-498e-b5f4-f3e1902e8623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:14.773270 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02aecf-ebf6-498e-b5f4-f3e1902e8623 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:14.784004 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 990/1969] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:55:14.788360 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e0f01-87e6-484d-9d26-188c7a8b49f3 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:14.798426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e0f01-87e6-484d-9d26-188c7a8b49f3 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:14.802971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb2201-2678-478d-9267-ee047019ab85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:14.803839 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb2201-2678-478d-9267-ee047019ab85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:14.804119 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb2201-2678-478d-9267-ee047019ab85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:14.804392 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb2201-2678-478d-9267-ee047019ab85 admin admin] PATH_INFO: `/v3/projects/026f5908f2d14a8b88cf2bcef09fa36c/users/b40cc08cd92a42d18590a15443a88a02/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:14.819720 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb2201-2678-478d-9267-ee047019ab85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=026f5908f2d14a8b88cf2bcef09fa36c, user_id=b40cc08cd92a42d18590a15443a88a02, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:14.822500 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb2201-2678-478d-9267-ee047019ab85 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:14.836054 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 980/1970] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:55:14 2022] PUT /identity/v3/projects/026f5908f2d14a8b88cf2bcef09fa36c/users/b40cc08cd92a42d18590a15443a88a02/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:14.847281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f3906-b0a5-4df6-8687-5da406b2ca53 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:14.847576 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f3906-b0a5-4df6-8687-5da406b2ca53 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:14.847858 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f3906-b0a5-4df6-8687-5da406b2ca53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:14.881556 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-b22f3906-b0a5-4df6-8687-5da406b2ca53 None None] MFA Rules not processed for user `b40cc08cd92a42d18590a15443a88a02`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:14.882804 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b22f3906-b0a5-4df6-8687-5da406b2ca53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:14.984441 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 991/1971] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:14 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:14.985650 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb2201-2678-478d-9267-ee047019ab85 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:15.043117 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:15.133814 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb2201-2678-478d-9267-ee047019ab85 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:15.139438 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c78ac0-d39c-4e00-b76c-aa68638efe82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:15.140585 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c78ac0-d39c-4e00-b76c-aa68638efe82 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:15.142615 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c78ac0-d39c-4e00-b76c-aa68638efe82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:15.142615 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c78ac0-d39c-4e00-b76c-aa68638efe82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:15.142615 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c78ac0-d39c-4e00-b76c-aa68638efe82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:15.144409 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c78ac0-d39c-4e00-b76c-aa68638efe82 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:15.220902 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 981/1972] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:55:14 2022] POST /identity/v3/projects => generated 407 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:15.224615 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f3906-b0a5-4df6-8687-5da406b2ca53 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:15.242482 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f3906-b0a5-4df6-8687-5da406b2ca53 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:15.321136 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5e35f-93ab-4287-bf77-e66b496c8875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:15.321922 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5e35f-93ab-4287-bf77-e66b496c8875 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:15.322327 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5e35f-93ab-4287-bf77-e66b496c8875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:15.322683 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5e35f-93ab-4287-bf77-e66b496c8875 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:15.323490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5e35f-93ab-4287-bf77-e66b496c8875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:15.326011 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5e35f-93ab-4287-bf77-e66b496c8875 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:15.357460 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 992/1973] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:55:15 2022] POST /identity/v3/users => generated 310 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:15.358206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c78ac0-d39c-4e00-b76c-aa68638efe82 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:15.370823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c78ac0-d39c-4e00-b76c-aa68638efe82 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:15.376313 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46968151-0dfa-485c-a14b-b801b2781c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:15.377003 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46968151-0dfa-485c-a14b-b801b2781c12 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:15.377295 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46968151-0dfa-485c-a14b-b801b2781c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:15.377629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46968151-0dfa-485c-a14b-b801b2781c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:15.378413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46968151-0dfa-485c-a14b-b801b2781c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:15.380211 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46968151-0dfa-485c-a14b-b801b2781c12 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:15.393242 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 982/1974] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 05:55:15.399112 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5e35f-93ab-4287-bf77-e66b496c8875 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:15.411309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5e35f-93ab-4287-bf77-e66b496c8875 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:15.416219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add7ebe-7c32-4f46-bdb5-0144d312485d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:15.417269 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add7ebe-7c32-4f46-bdb5-0144d312485d admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:15.421113 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add7ebe-7c32-4f46-bdb5-0144d312485d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:15.421113 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add7ebe-7c32-4f46-bdb5-0144d312485d admin admin] PATH_INFO: `/v3/projects/bc6ceeafe547424f9746107e1b870d49/users/b683e2e217014e15addf11c7d91c8ce3/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:15.440073 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add7ebe-7c32-4f46-bdb5-0144d312485d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc6ceeafe547424f9746107e1b870d49, user_id=b683e2e217014e15addf11c7d91c8ce3, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:15.443021 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add7ebe-7c32-4f46-bdb5-0144d312485d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:15.474097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 993/1975] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:55:15 2022] PUT /identity/v3/projects/bc6ceeafe547424f9746107e1b870d49/users/b683e2e217014e15addf11c7d91c8ce3/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:15.484285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46968151-0dfa-485c-a14b-b801b2781c12 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:15.499570 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46968151-0dfa-485c-a14b-b801b2781c12 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:15.595552 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a97e3-704a-4237-9b64-6fd8ae110e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:15.596443 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a97e3-704a-4237-9b64-6fd8ae110e2f admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:15.596895 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a97e3-704a-4237-9b64-6fd8ae110e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:15.597289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a97e3-704a-4237-9b64-6fd8ae110e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:15.598674 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a97e3-704a-4237-9b64-6fd8ae110e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:15.600560 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a97e3-704a-4237-9b64-6fd8ae110e2f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:15.618971 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add7ebe-7c32-4f46-bdb5-0144d312485d admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:15.620088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 983/1976] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:55:15.634108 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add7ebe-7c32-4f46-bdb5-0144d312485d admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:15.640193 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5083e-ea63-4451-b43c-12c744bcb73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:15.641568 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5083e-ea63-4451-b43c-12c744bcb73d admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:15.642088 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5083e-ea63-4451-b43c-12c744bcb73d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:15.642525 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5083e-ea63-4451-b43c-12c744bcb73d admin admin] PATH_INFO: `/v3/projects/bc6ceeafe547424f9746107e1b870d49/users/b683e2e217014e15addf11c7d91c8ce3/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:15.644923 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5083e-ea63-4451-b43c-12c744bcb73d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc6ceeafe547424f9746107e1b870d49, user_id=b683e2e217014e15addf11c7d91c8ce3, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:15.647896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5083e-ea63-4451-b43c-12c744bcb73d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:15.677070 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 994/1977] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:55:15 2022] PUT /identity/v3/projects/bc6ceeafe547424f9746107e1b870d49/users/b683e2e217014e15addf11c7d91c8ce3/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:15.678003 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03f337-a581-44f3-9ee4-3e34591f34bc None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:15.678352 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03f337-a581-44f3-9ee4-3e34591f34bc None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:15.678605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03f337-a581-44f3-9ee4-3e34591f34bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:15.715212 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-cc03f337-a581-44f3-9ee4-3e34591f34bc None None] MFA Rules not processed for user `b683e2e217014e15addf11c7d91c8ce3`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:15.717403 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-cc03f337-a581-44f3-9ee4-3e34591f34bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:15.864826 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 984/1978] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:15 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:15.884237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5083e-ea63-4451-b43c-12c744bcb73d admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:15.886618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-60c5083e-ea63-4451-b43c-12c744bcb73d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:15.944236 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:15.983000 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5083e-ea63-4451-b43c-12c744bcb73d admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:15.987994 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea196fd-e3c9-4d6b-9143-3a1d6f40f182 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:15.990494 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea196fd-e3c9-4d6b-9143-3a1d6f40f182 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:15.990494 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea196fd-e3c9-4d6b-9143-3a1d6f40f182 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:15.990494 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea196fd-e3c9-4d6b-9143-3a1d6f40f182 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:16.000624 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea196fd-e3c9-4d6b-9143-3a1d6f40f182 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:16.002733 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea196fd-e3c9-4d6b-9143-3a1d6f40f182 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:16.020094 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 995/1979] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:55:15 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:55:16.193542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03f337-a581-44f3-9ee4-3e34591f34bc None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:16.204278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03f337-a581-44f3-9ee4-3e34591f34bc None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:16.208207 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b196c-a750-4690-96cc-5c106fdbf01b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:16.208921 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b196c-a750-4690-96cc-5c106fdbf01b service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:16.209216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b196c-a750-4690-96cc-5c106fdbf01b service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:16.209487 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b196c-a750-4690-96cc-5c106fdbf01b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:16.225124 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:16.273365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b196c-a750-4690-96cc-5c106fdbf01b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:16.274842 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b196c-a750-4690-96cc-5c106fdbf01b service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:16.284185 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 985/1980] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:55:16 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:55:26.011497 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=12 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:26.279971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=20 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:27.114793 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea196fd-e3c9-4d6b-9143-3a1d6f40f182 service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:27.178813 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea196fd-e3c9-4d6b-9143-3a1d6f40f182 service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:27.183553 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665312f-4b6a-4b52-9aa7-f7a205554197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:27.184434 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665312f-4b6a-4b52-9aa7-f7a205554197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:27.184716 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665312f-4b6a-4b52-9aa7-f7a205554197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:27.184989 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665312f-4b6a-4b52-9aa7-f7a205554197 admin admin] PATH_INFO: `/v3/users/b40cc08cd92a42d18590a15443a88a02` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:27.186221 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665312f-4b6a-4b52-9aa7-f7a205554197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b40cc08cd92a42d18590a15443a88a02)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:27.188258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665312f-4b6a-4b52-9aa7-f7a205554197 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:27.237290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-5665312f-4b6a-4b52-9aa7-f7a205554197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b40cc08cd92a42d18590a15443a88a02'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:27.245571 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-5665312f-4b6a-4b52-9aa7-f7a205554197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b40cc08cd92a42d18590a15443a88a02'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:27.246289 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-5665312f-4b6a-4b52-9aa7-f7a205554197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b40cc08cd92a42d18590a15443a88a02'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:27.255038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-5665312f-4b6a-4b52-9aa7-f7a205554197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b40cc08cd92a42d18590a15443a88a02'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:27.267829 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-5665312f-4b6a-4b52-9aa7-f7a205554197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b40cc08cd92a42d18590a15443a88a02'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:27.273980 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 996/1981] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:55:27 2022] DELETE /identity/v3/users/b40cc08cd92a42d18590a15443a88a02 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:27.279688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b2a77-42f2-44eb-84f5-0321ba6f0bc1 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:27.279688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b2a77-42f2-44eb-84f5-0321ba6f0bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:27.279688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b2a77-42f2-44eb-84f5-0321ba6f0bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:27.298638 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-0e3b2a77-42f2-44eb-84f5-0321ba6f0bc1 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:27.299864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-0e3b2a77-42f2-44eb-84f5-0321ba6f0bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:27.362835 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 986/1982] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:55:27.373582 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665312f-4b6a-4b52-9aa7-f7a205554197 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:27.375375 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-5665312f-4b6a-4b52-9aa7-f7a205554197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:27.445315 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665312f-4b6a-4b52-9aa7-f7a205554197 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:27.448988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adefa1-2208-4032-a9f5-6445600f2cc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:27.450323 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adefa1-2208-4032-a9f5-6445600f2cc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:27.450607 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adefa1-2208-4032-a9f5-6445600f2cc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:27.450888 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adefa1-2208-4032-a9f5-6445600f2cc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:27.461165 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4adefa1-2208-4032-a9f5-6445600f2cc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:27.462993 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4adefa1-2208-4032-a9f5-6445600f2cc0 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:27.473874 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 997/1983] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:55:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 05:55:27.797756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b2a77-42f2-44eb-84f5-0321ba6f0bc1 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:27.799567 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-0e3b2a77-42f2-44eb-84f5-0321ba6f0bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:27.814389 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b2a77-42f2-44eb-84f5-0321ba6f0bc1 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:27.820308 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f52b03-731c-45f8-85ad-2f8394a231db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:27.821894 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f52b03-731c-45f8-85ad-2f8394a231db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:27.822371 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f52b03-731c-45f8-85ad-2f8394a231db admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:27.822658 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f52b03-731c-45f8-85ad-2f8394a231db admin admin] PATH_INFO: `/v3/projects/026f5908f2d14a8b88cf2bcef09fa36c` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:27.824027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f52b03-731c-45f8-85ad-2f8394a231db admin admin] RBAC: Authorizing `identity:delete_project(project_id=026f5908f2d14a8b88cf2bcef09fa36c)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:27.826110 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f52b03-731c-45f8-85ad-2f8394a231db admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:27.880483 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-73f52b03-731c-45f8-85ad-2f8394a231db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '026f5908f2d14a8b88cf2bcef09fa36c', 'request_id': 'req-73f52b03-731c-45f8-85ad-2f8394a231db'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:27.888681 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-73f52b03-731c-45f8-85ad-2f8394a231db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '026f5908f2d14a8b88cf2bcef09fa36c', 'request_id': 'req-73f52b03-731c-45f8-85ad-2f8394a231db'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:27.895115 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-73f52b03-731c-45f8-85ad-2f8394a231db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '026f5908f2d14a8b88cf2bcef09fa36c', 'request_id': 'req-73f52b03-731c-45f8-85ad-2f8394a231db'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:27.905861 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-73f52b03-731c-45f8-85ad-2f8394a231db admin admin] The token cache is being invalidate because project 026f5908f2d14a8b88cf2bcef09fa36c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:55:27.906178 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-73f52b03-731c-45f8-85ad-2f8394a231db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:27.906829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-73f52b03-731c-45f8-85ad-2f8394a231db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:27.908465 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 987/1984] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:55:27 2022] DELETE /identity/v3/projects/026f5908f2d14a8b88cf2bcef09fa36c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:27.912447 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adefa1-2208-4032-a9f5-6445600f2cc0 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:27.922588 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adefa1-2208-4032-a9f5-6445600f2cc0 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:27.941106 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:27.982297 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a298a-4be2-4a26-ae59-0c54f25b1a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:27.983095 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a298a-4be2-4a26-ae59-0c54f25b1a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:27.983378 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a298a-4be2-4a26-ae59-0c54f25b1a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:27.983655 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a298a-4be2-4a26-ae59-0c54f25b1a7c admin admin] PATH_INFO: `/v3/users/b683e2e217014e15addf11c7d91c8ce3` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:27.984860 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a298a-4be2-4a26-ae59-0c54f25b1a7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b683e2e217014e15addf11c7d91c8ce3)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:27.986833 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a298a-4be2-4a26-ae59-0c54f25b1a7c admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:28.039179 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-339a298a-4be2-4a26-ae59-0c54f25b1a7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b683e2e217014e15addf11c7d91c8ce3'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:28.046520 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-339a298a-4be2-4a26-ae59-0c54f25b1a7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b683e2e217014e15addf11c7d91c8ce3'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:28.047179 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-339a298a-4be2-4a26-ae59-0c54f25b1a7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b683e2e217014e15addf11c7d91c8ce3'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:28.055004 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-339a298a-4be2-4a26-ae59-0c54f25b1a7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b683e2e217014e15addf11c7d91c8ce3'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:28.068216 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-339a298a-4be2-4a26-ae59-0c54f25b1a7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b683e2e217014e15addf11c7d91c8ce3'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:28.074179 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 998/1985] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:55:27 2022] DELETE /identity/v3/users/b683e2e217014e15addf11c7d91c8ce3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:28.375098 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f52b03-731c-45f8-85ad-2f8394a231db admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:28.376616 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-73f52b03-731c-45f8-85ad-2f8394a231db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:28.389714 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f52b03-731c-45f8-85ad-2f8394a231db admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:28.447092 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1940ca6-ecc8-4516-93e1-595cb1b65fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:28.447963 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1940ca6-ecc8-4516-93e1-595cb1b65fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:28.448276 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1940ca6-ecc8-4516-93e1-595cb1b65fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:28.448553 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1940ca6-ecc8-4516-93e1-595cb1b65fa6 admin admin] PATH_INFO: `/v3/projects/bc6ceeafe547424f9746107e1b870d49` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:28.449779 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1940ca6-ecc8-4516-93e1-595cb1b65fa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc6ceeafe547424f9746107e1b870d49)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:28.451757 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1940ca6-ecc8-4516-93e1-595cb1b65fa6 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:28.484099 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:28.501258 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e1940ca6-ecc8-4516-93e1-595cb1b65fa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc6ceeafe547424f9746107e1b870d49', 'request_id': 'req-e1940ca6-ecc8-4516-93e1-595cb1b65fa6'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:28.508599 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e1940ca6-ecc8-4516-93e1-595cb1b65fa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc6ceeafe547424f9746107e1b870d49', 'request_id': 'req-e1940ca6-ecc8-4516-93e1-595cb1b65fa6'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:28.515724 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e1940ca6-ecc8-4516-93e1-595cb1b65fa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc6ceeafe547424f9746107e1b870d49', 'request_id': 'req-e1940ca6-ecc8-4516-93e1-595cb1b65fa6'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:28.526316 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e1940ca6-ecc8-4516-93e1-595cb1b65fa6 admin admin] The token cache is being invalidate because project bc6ceeafe547424f9746107e1b870d49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:55:28.526606 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e1940ca6-ecc8-4516-93e1-595cb1b65fa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:28.527261 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-e1940ca6-ecc8-4516-93e1-595cb1b65fa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:28.529519 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 988/1986] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:55:28 2022] DELETE /identity/v3/projects/bc6ceeafe547424f9746107e1b870d49 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:28.536888 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f308f73-2e70-4c0d-9c24-b45182add37d None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:28.536888 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f308f73-2e70-4c0d-9c24-b45182add37d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:28.536888 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f308f73-2e70-4c0d-9c24-b45182add37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:28.554177 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-2f308f73-2e70-4c0d-9c24-b45182add37d None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:28.555412 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-2f308f73-2e70-4c0d-9c24-b45182add37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:28.617668 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 999/1987] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:28.625301 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7f6be-9476-431c-82c3-419b5c608fcd None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:28.625588 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7f6be-9476-431c-82c3-419b5c608fcd None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:28.625867 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7f6be-9476-431c-82c3-419b5c608fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:28.645360 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-c0c7f6be-9476-431c-82c3-419b5c608fcd None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:28.646659 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c0c7f6be-9476-431c-82c3-419b5c608fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:28.655724 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 989/1988] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:28.660155 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f308f73-2e70-4c0d-9c24-b45182add37d None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:28.671103 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f308f73-2e70-4c0d-9c24-b45182add37d None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:28.676501 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064db785-531c-47f0-808c-97fe5041c188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:28.677192 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064db785-531c-47f0-808c-97fe5041c188 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:28.677733 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064db785-531c-47f0-808c-97fe5041c188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:28.678045 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064db785-531c-47f0-808c-97fe5041c188 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:28.678796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064db785-531c-47f0-808c-97fe5041c188 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:55:28.679105 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064db785-531c-47f0-808c-97fe5041c188 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:28.680753 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064db785-531c-47f0-808c-97fe5041c188 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:28.693111 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1000/1989] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:55:28.697529 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7f6be-9476-431c-82c3-419b5c608fcd None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:28.707570 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7f6be-9476-431c-82c3-419b5c608fcd None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:28.712297 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d79e2-efff-4f45-98aa-6936377f264f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:28.712951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d79e2-efff-4f45-98aa-6936377f264f admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:28.713238 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d79e2-efff-4f45-98aa-6936377f264f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:28.713514 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d79e2-efff-4f45-98aa-6936377f264f admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:28.714251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d79e2-efff-4f45-98aa-6936377f264f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:28.716721 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d79e2-efff-4f45-98aa-6936377f264f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:28.742177 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 990/1990] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:55:28 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:28.746275 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064db785-531c-47f0-808c-97fe5041c188 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:28.756999 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064db785-531c-47f0-808c-97fe5041c188 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:28.784251 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:28.817195 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd36c41-1f77-4e4a-b189-304f9d73016b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:28.817883 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd36c41-1f77-4e4a-b189-304f9d73016b admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:28.818206 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd36c41-1f77-4e4a-b189-304f9d73016b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:28.818486 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd36c41-1f77-4e4a-b189-304f9d73016b admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:28.819195 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd36c41-1f77-4e4a-b189-304f9d73016b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:28.821246 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd36c41-1f77-4e4a-b189-304f9d73016b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:28.844888 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1001/1991] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:55:28 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:28.846094 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d79e2-efff-4f45-98aa-6936377f264f admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:28.857532 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d79e2-efff-4f45-98aa-6936377f264f admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:28.862820 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892799de-fa55-4dc0-b860-400c77f99835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:28.863593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892799de-fa55-4dc0-b860-400c77f99835 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:28.863938 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892799de-fa55-4dc0-b860-400c77f99835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:28.864279 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892799de-fa55-4dc0-b860-400c77f99835 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:28.865142 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892799de-fa55-4dc0-b860-400c77f99835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:28.867131 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892799de-fa55-4dc0-b860-400c77f99835 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:28.879849 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 991/1992] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 05:55:28.883939 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd36c41-1f77-4e4a-b189-304f9d73016b admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:28.894905 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd36c41-1f77-4e4a-b189-304f9d73016b admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:28.899533 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f6555-a999-4d16-b23b-4944e28dc643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:28.900199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f6555-a999-4d16-b23b-4944e28dc643 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:28.900481 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f6555-a999-4d16-b23b-4944e28dc643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:28.900757 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f6555-a999-4d16-b23b-4944e28dc643 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:28.901516 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f6555-a999-4d16-b23b-4944e28dc643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:28.903141 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f6555-a999-4d16-b23b-4944e28dc643 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:28.913523 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1002/1993] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:55:28.917622 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892799de-fa55-4dc0-b860-400c77f99835 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:28.928256 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892799de-fa55-4dc0-b860-400c77f99835 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:28.933024 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722c1bb-8b4d-4c16-b807-7d927e841db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:28.934390 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722c1bb-8b4d-4c16-b807-7d927e841db1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:28.934677 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722c1bb-8b4d-4c16-b807-7d927e841db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:28.934955 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722c1bb-8b4d-4c16-b807-7d927e841db1 admin admin] PATH_INFO: `/v3/projects/0193e11ba2e74cfb8994d8a0e7d94729/users/c60ceb7e9a8846f7a34bc3a161dd6f9b/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:28.950949 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722c1bb-8b4d-4c16-b807-7d927e841db1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0193e11ba2e74cfb8994d8a0e7d94729, user_id=c60ceb7e9a8846f7a34bc3a161dd6f9b, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:28.953758 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722c1bb-8b4d-4c16-b807-7d927e841db1 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:28.969450 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 992/1994] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:55:28 2022] PUT /identity/v3/projects/0193e11ba2e74cfb8994d8a0e7d94729/users/c60ceb7e9a8846f7a34bc3a161dd6f9b/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:28.980180 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d7eba-5d1d-4359-a4d9-0a8580605c34 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:28.980606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d7eba-5d1d-4359-a4d9-0a8580605c34 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:28.980953 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d7eba-5d1d-4359-a4d9-0a8580605c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:29.017714 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-042d7eba-5d1d-4359-a4d9-0a8580605c34 None None] MFA Rules not processed for user `c60ceb7e9a8846f7a34bc3a161dd6f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:29.018974 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-042d7eba-5d1d-4359-a4d9-0a8580605c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:29.083575 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1003/1995] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:55:29.088098 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722c1bb-8b4d-4c16-b807-7d927e841db1 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:29.152397 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722c1bb-8b4d-4c16-b807-7d927e841db1 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:29.157098 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221c4fc-e906-4ef4-949d-8418567b5b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:29.157762 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221c4fc-e906-4ef4-949d-8418567b5b5f admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:29.158079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221c4fc-e906-4ef4-949d-8418567b5b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:29.158362 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221c4fc-e906-4ef4-949d-8418567b5b5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:29.159065 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f221c4fc-e906-4ef4-949d-8418567b5b5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:29.160982 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f221c4fc-e906-4ef4-949d-8418567b5b5f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:29.186190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 993/1996] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:55:29 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:29.190361 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d7eba-5d1d-4359-a4d9-0a8580605c34 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:29.201855 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d7eba-5d1d-4359-a4d9-0a8580605c34 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:29.257356 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628b3f2-53b4-4925-aea4-a963100c3e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:29.258067 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628b3f2-53b4-4925-aea4-a963100c3e15 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:29.258357 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628b3f2-53b4-4925-aea4-a963100c3e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:29.258641 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628b3f2-53b4-4925-aea4-a963100c3e15 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:29.259333 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628b3f2-53b4-4925-aea4-a963100c3e15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:29.261244 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628b3f2-53b4-4925-aea4-a963100c3e15 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:29.280830 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1004/1997] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:55:29 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:29.284845 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221c4fc-e906-4ef4-949d-8418567b5b5f admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:29.296875 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221c4fc-e906-4ef4-949d-8418567b5b5f admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:29.304955 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ccdba7-9866-4288-853f-f84b272a7389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:29.305252 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccdba7-9866-4288-853f-f84b272a7389 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:29.305543 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccdba7-9866-4288-853f-f84b272a7389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:29.305823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccdba7-9866-4288-853f-f84b272a7389 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:29.306620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ccdba7-9866-4288-853f-f84b272a7389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:29.308230 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ccdba7-9866-4288-853f-f84b272a7389 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:29.321254 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 994/1998] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:55:29.325702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628b3f2-53b4-4925-aea4-a963100c3e15 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:29.336307 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628b3f2-53b4-4925-aea4-a963100c3e15 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:29.341790 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e313742-65d8-4780-8bbc-85fc05c9e24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:29.342782 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e313742-65d8-4780-8bbc-85fc05c9e24c admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:29.343068 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e313742-65d8-4780-8bbc-85fc05c9e24c admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:29.343357 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e313742-65d8-4780-8bbc-85fc05c9e24c admin admin] PATH_INFO: `/v3/projects/51758f5a4fa9480f82792288b8d83965/users/f7143556ac6042db8c2cb8098441bd34/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:29.361110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e313742-65d8-4780-8bbc-85fc05c9e24c admin admin] RBAC: Authorizing `identity:create_grant(project_id=51758f5a4fa9480f82792288b8d83965, user_id=f7143556ac6042db8c2cb8098441bd34, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:29.363977 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e313742-65d8-4780-8bbc-85fc05c9e24c admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:29.381386 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1005/1999] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:55:29 2022] PUT /identity/v3/projects/51758f5a4fa9480f82792288b8d83965/users/f7143556ac6042db8c2cb8098441bd34/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:29.385259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ccdba7-9866-4288-853f-f84b272a7389 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:29.395314 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ccdba7-9866-4288-853f-f84b272a7389 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:29.415291 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:29.455625 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b48dcd-5ee5-46cb-90f5-c39658305f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:29.456312 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b48dcd-5ee5-46cb-90f5-c39658305f6a admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:29.456605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b48dcd-5ee5-46cb-90f5-c39658305f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:29.456907 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b48dcd-5ee5-46cb-90f5-c39658305f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:29.457602 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b48dcd-5ee5-46cb-90f5-c39658305f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:29.459294 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b48dcd-5ee5-46cb-90f5-c39658305f6a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:29.470423 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 995/2000] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:55:29.474552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e313742-65d8-4780-8bbc-85fc05c9e24c admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:29.480310 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:29.487702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e313742-65d8-4780-8bbc-85fc05c9e24c admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:29.492839 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66497544-598a-4e80-87f5-fbc02395b11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:29.493728 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66497544-598a-4e80-87f5-fbc02395b11b admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:29.494167 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66497544-598a-4e80-87f5-fbc02395b11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:29.494450 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66497544-598a-4e80-87f5-fbc02395b11b admin admin] PATH_INFO: `/v3/projects/51758f5a4fa9480f82792288b8d83965/users/f7143556ac6042db8c2cb8098441bd34/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:29.496995 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66497544-598a-4e80-87f5-fbc02395b11b admin admin] RBAC: Authorizing `identity:create_grant(project_id=51758f5a4fa9480f82792288b8d83965, user_id=f7143556ac6042db8c2cb8098441bd34, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:29.499702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66497544-598a-4e80-87f5-fbc02395b11b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:29.510545 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1006/2001] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:55:29 2022] PUT /identity/v3/projects/51758f5a4fa9480f82792288b8d83965/users/f7143556ac6042db8c2cb8098441bd34/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 05:55:29.521537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da7310-abbc-4945-9d91-4734b27e7785 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:29.521830 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da7310-abbc-4945-9d91-4734b27e7785 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:29.522242 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da7310-abbc-4945-9d91-4734b27e7785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:29.553778 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-75da7310-abbc-4945-9d91-4734b27e7785 None None] MFA Rules not processed for user `f7143556ac6042db8c2cb8098441bd34`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:29.555267 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-75da7310-abbc-4945-9d91-4734b27e7785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:29.630937 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 996/2002] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:55:29.641823 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66497544-598a-4e80-87f5-fbc02395b11b admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:29.643569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-66497544-598a-4e80-87f5-fbc02395b11b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:29.706205 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66497544-598a-4e80-87f5-fbc02395b11b admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:29.709860 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5165cb-ab3e-49f0-930b-6f49b139c15e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:29.710545 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5165cb-ab3e-49f0-930b-6f49b139c15e service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:29.710826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5165cb-ab3e-49f0-930b-6f49b139c15e service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:29.711105 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5165cb-ab3e-49f0-930b-6f49b139c15e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:29.721545 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5165cb-ab3e-49f0-930b-6f49b139c15e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:29.723317 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5165cb-ab3e-49f0-930b-6f49b139c15e service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:29.734869 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1007/2003] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:55:29 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:55:30.165445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da7310-abbc-4945-9d91-4734b27e7785 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:30.235141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da7310-abbc-4945-9d91-4734b27e7785 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:30.240034 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f92d1d-1436-4bce-87d3-3389d0bf4127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:30.240909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f92d1d-1436-4bce-87d3-3389d0bf4127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:30.241192 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f92d1d-1436-4bce-87d3-3389d0bf4127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:30.241465 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f92d1d-1436-4bce-87d3-3389d0bf4127 admin admin] PATH_INFO: `/v3/users/c60ceb7e9a8846f7a34bc3a161dd6f9b` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:30.242688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f92d1d-1436-4bce-87d3-3389d0bf4127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c60ceb7e9a8846f7a34bc3a161dd6f9b)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:30.244612 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f92d1d-1436-4bce-87d3-3389d0bf4127 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:30.305839 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-23f92d1d-1436-4bce-87d3-3389d0bf4127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c60ceb7e9a8846f7a34bc3a161dd6f9b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:30.307768 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:30.316588 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-23f92d1d-1436-4bce-87d3-3389d0bf4127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c60ceb7e9a8846f7a34bc3a161dd6f9b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:30.317467 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-23f92d1d-1436-4bce-87d3-3389d0bf4127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c60ceb7e9a8846f7a34bc3a161dd6f9b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:30.318341 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-23f92d1d-1436-4bce-87d3-3389d0bf4127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c60ceb7e9a8846f7a34bc3a161dd6f9b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:30.338825 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-23f92d1d-1436-4bce-87d3-3389d0bf4127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c60ceb7e9a8846f7a34bc3a161dd6f9b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:30.353864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 997/2004] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:55:30 2022] DELETE /identity/v3/users/c60ceb7e9a8846f7a34bc3a161dd6f9b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:30.358572 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940247d-6b3f-4bad-86d1-d174ed9fe521 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:30.358772 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940247d-6b3f-4bad-86d1-d174ed9fe521 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:30.359054 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940247d-6b3f-4bad-86d1-d174ed9fe521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:30.378492 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-b940247d-6b3f-4bad-86d1-d174ed9fe521 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:30.379704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b940247d-6b3f-4bad-86d1-d174ed9fe521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:30.447007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1008/2005] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:30.457630 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f92d1d-1436-4bce-87d3-3389d0bf4127 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:30.459367 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-23f92d1d-1436-4bce-87d3-3389d0bf4127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:30.527261 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f92d1d-1436-4bce-87d3-3389d0bf4127 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:30.531877 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c02211-eb35-4fd5-8284-62ee8cc4271a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:30.532161 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c02211-eb35-4fd5-8284-62ee8cc4271a service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:30.532416 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c02211-eb35-4fd5-8284-62ee8cc4271a service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:30.532690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c02211-eb35-4fd5-8284-62ee8cc4271a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:30.551077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c02211-eb35-4fd5-8284-62ee8cc4271a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:30.551863 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c02211-eb35-4fd5-8284-62ee8cc4271a service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:30.586190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 998/2006] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:55:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:55:30.922753 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940247d-6b3f-4bad-86d1-d174ed9fe521 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:30.925186 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b940247d-6b3f-4bad-86d1-d174ed9fe521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:30.949249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940247d-6b3f-4bad-86d1-d174ed9fe521 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:30.955245 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea6a1d-83ba-47ea-abaa-d7bb761d97ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:30.956139 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea6a1d-83ba-47ea-abaa-d7bb761d97ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:30.956423 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea6a1d-83ba-47ea-abaa-d7bb761d97ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:30.956697 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea6a1d-83ba-47ea-abaa-d7bb761d97ce admin admin] PATH_INFO: `/v3/projects/0193e11ba2e74cfb8994d8a0e7d94729` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:30.957956 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea6a1d-83ba-47ea-abaa-d7bb761d97ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=0193e11ba2e74cfb8994d8a0e7d94729)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:30.960195 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea6a1d-83ba-47ea-abaa-d7bb761d97ce admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:31.010866 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-21ea6a1d-83ba-47ea-abaa-d7bb761d97ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0193e11ba2e74cfb8994d8a0e7d94729', 'request_id': 'req-21ea6a1d-83ba-47ea-abaa-d7bb761d97ce'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:31.017179 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-21ea6a1d-83ba-47ea-abaa-d7bb761d97ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0193e11ba2e74cfb8994d8a0e7d94729', 'request_id': 'req-21ea6a1d-83ba-47ea-abaa-d7bb761d97ce'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:31.023672 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-21ea6a1d-83ba-47ea-abaa-d7bb761d97ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0193e11ba2e74cfb8994d8a0e7d94729', 'request_id': 'req-21ea6a1d-83ba-47ea-abaa-d7bb761d97ce'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:31.037786 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-21ea6a1d-83ba-47ea-abaa-d7bb761d97ce admin admin] The token cache is being invalidate because project 0193e11ba2e74cfb8994d8a0e7d94729 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:55:31.038128 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-21ea6a1d-83ba-47ea-abaa-d7bb761d97ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:31.038786 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-21ea6a1d-83ba-47ea-abaa-d7bb761d97ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:31.040358 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1009/2007] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:55:30 2022] DELETE /identity/v3/projects/0193e11ba2e74cfb8994d8a0e7d94729 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:31.044892 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c02211-eb35-4fd5-8284-62ee8cc4271a service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:31.054914 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c02211-eb35-4fd5-8284-62ee8cc4271a service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:31.120856 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75596de2-435e-404d-9c31-6f8ec6dc2da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:31.122370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75596de2-435e-404d-9c31-6f8ec6dc2da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:31.122659 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75596de2-435e-404d-9c31-6f8ec6dc2da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:31.122933 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75596de2-435e-404d-9c31-6f8ec6dc2da4 admin admin] PATH_INFO: `/v3/users/f7143556ac6042db8c2cb8098441bd34` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:31.124149 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75596de2-435e-404d-9c31-6f8ec6dc2da4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7143556ac6042db8c2cb8098441bd34)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:31.126115 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75596de2-435e-404d-9c31-6f8ec6dc2da4 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:31.177826 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-75596de2-435e-404d-9c31-6f8ec6dc2da4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7143556ac6042db8c2cb8098441bd34'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:31.186587 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-75596de2-435e-404d-9c31-6f8ec6dc2da4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7143556ac6042db8c2cb8098441bd34'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:31.187209 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-75596de2-435e-404d-9c31-6f8ec6dc2da4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7143556ac6042db8c2cb8098441bd34'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:31.187897 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-75596de2-435e-404d-9c31-6f8ec6dc2da4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7143556ac6042db8c2cb8098441bd34'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:31.199993 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:31.206109 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-75596de2-435e-404d-9c31-6f8ec6dc2da4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7143556ac6042db8c2cb8098441bd34'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:31.223893 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 999/2008] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:55:31 2022] DELETE /identity/v3/users/f7143556ac6042db8c2cb8098441bd34 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:31.584895 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea6a1d-83ba-47ea-abaa-d7bb761d97ce admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:31.586479 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-21ea6a1d-83ba-47ea-abaa-d7bb761d97ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:31.615270 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea6a1d-83ba-47ea-abaa-d7bb761d97ce admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:31.635388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:31.700828 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370866da-c8fb-4980-910e-d7df67b48dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:31.701960 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370866da-c8fb-4980-910e-d7df67b48dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:31.702471 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370866da-c8fb-4980-910e-d7df67b48dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:31.702863 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370866da-c8fb-4980-910e-d7df67b48dae admin admin] PATH_INFO: `/v3/projects/51758f5a4fa9480f82792288b8d83965` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:31.704742 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370866da-c8fb-4980-910e-d7df67b48dae admin admin] RBAC: Authorizing `identity:delete_project(project_id=51758f5a4fa9480f82792288b8d83965)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:31.706829 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370866da-c8fb-4980-910e-d7df67b48dae admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:31.777979 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-370866da-c8fb-4980-910e-d7df67b48dae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51758f5a4fa9480f82792288b8d83965', 'request_id': 'req-370866da-c8fb-4980-910e-d7df67b48dae'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:31.786160 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-370866da-c8fb-4980-910e-d7df67b48dae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51758f5a4fa9480f82792288b8d83965', 'request_id': 'req-370866da-c8fb-4980-910e-d7df67b48dae'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:31.795516 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-370866da-c8fb-4980-910e-d7df67b48dae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51758f5a4fa9480f82792288b8d83965', 'request_id': 'req-370866da-c8fb-4980-910e-d7df67b48dae'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:31.816715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-370866da-c8fb-4980-910e-d7df67b48dae admin admin] The token cache is being invalidate because project 51758f5a4fa9480f82792288b8d83965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:55:31.818313 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-370866da-c8fb-4980-910e-d7df67b48dae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:31.818864 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-370866da-c8fb-4980-910e-d7df67b48dae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:31.825785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1010/2009] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:55:31 2022] DELETE /identity/v3/projects/51758f5a4fa9480f82792288b8d83965 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:31.828226 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55de959-c7db-491f-b1b5-78eb4b2b027d None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:31.829408 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55de959-c7db-491f-b1b5-78eb4b2b027d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:31.829870 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55de959-c7db-491f-b1b5-78eb4b2b027d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:31.859161 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-e55de959-c7db-491f-b1b5-78eb4b2b027d None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:31.860608 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e55de959-c7db-491f-b1b5-78eb4b2b027d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:31.943951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1000/2010] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:55:31.963056 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069badbe-a753-4e8f-b68b-9560ef3b7ba0 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:31.963056 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069badbe-a753-4e8f-b68b-9560ef3b7ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:31.963056 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069badbe-a753-4e8f-b68b-9560ef3b7ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:31.997244 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-069badbe-a753-4e8f-b68b-9560ef3b7ba0 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:31.998901 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-069badbe-a753-4e8f-b68b-9560ef3b7ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:32.009350 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1011/2011] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:32.016295 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55de959-c7db-491f-b1b5-78eb4b2b027d None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:32.039872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55de959-c7db-491f-b1b5-78eb4b2b027d None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:32.051030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db1494-0e2f-43ae-b19e-522a9137d468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:32.052404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db1494-0e2f-43ae-b19e-522a9137d468 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:32.053297 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db1494-0e2f-43ae-b19e-522a9137d468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:32.053907 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db1494-0e2f-43ae-b19e-522a9137d468 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:32.055722 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db1494-0e2f-43ae-b19e-522a9137d468 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:55:32.056713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db1494-0e2f-43ae-b19e-522a9137d468 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:32.060579 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db1494-0e2f-43ae-b19e-522a9137d468 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:32.104659 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1001/2012] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:55:32.111388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069badbe-a753-4e8f-b68b-9560ef3b7ba0 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:32.117411 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069badbe-a753-4e8f-b68b-9560ef3b7ba0 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:32.124370 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95b292-5747-4d7b-91b6-ceb05fba8352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:32.125747 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95b292-5747-4d7b-91b6-ceb05fba8352 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:32.126326 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95b292-5747-4d7b-91b6-ceb05fba8352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:32.126823 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95b292-5747-4d7b-91b6-ceb05fba8352 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:32.128551 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95b292-5747-4d7b-91b6-ceb05fba8352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:32.131586 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95b292-5747-4d7b-91b6-ceb05fba8352 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:32.175933 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1012/2013] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:55:32 2022] POST /identity/v3/projects => generated 375 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:32.181534 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db1494-0e2f-43ae-b19e-522a9137d468 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:32.199598 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db1494-0e2f-43ae-b19e-522a9137d468 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:32.302362 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559b58e-a5ae-4288-a555-94b366235f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:32.303555 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559b58e-a5ae-4288-a555-94b366235f36 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:32.304075 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559b58e-a5ae-4288-a555-94b366235f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:32.305180 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559b58e-a5ae-4288-a555-94b366235f36 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:32.306109 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559b58e-a5ae-4288-a555-94b366235f36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:32.311708 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559b58e-a5ae-4288-a555-94b366235f36 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:32.344271 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1002/2014] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:55:32 2022] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:32.350380 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95b292-5747-4d7b-91b6-ceb05fba8352 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:32.363353 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95b292-5747-4d7b-91b6-ceb05fba8352 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:32.369309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d6101-ad5f-4d5a-b4e8-c2eb3c2fca46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:32.370235 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d6101-ad5f-4d5a-b4e8-c2eb3c2fca46 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:32.370613 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d6101-ad5f-4d5a-b4e8-c2eb3c2fca46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:32.370886 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d6101-ad5f-4d5a-b4e8-c2eb3c2fca46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:32.371626 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d6101-ad5f-4d5a-b4e8-c2eb3c2fca46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:32.373308 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d6101-ad5f-4d5a-b4e8-c2eb3c2fca46 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:32.394468 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1013/2015] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:55:32.396064 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559b58e-a5ae-4288-a555-94b366235f36 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:32.410202 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559b58e-a5ae-4288-a555-94b366235f36 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:32.415925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60314cb6-ffaa-4d86-9761-f4e395c7f82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:32.416754 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60314cb6-ffaa-4d86-9761-f4e395c7f82c admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:32.417050 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60314cb6-ffaa-4d86-9761-f4e395c7f82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:32.417352 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60314cb6-ffaa-4d86-9761-f4e395c7f82c admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:32.418140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60314cb6-ffaa-4d86-9761-f4e395c7f82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:32.419782 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60314cb6-ffaa-4d86-9761-f4e395c7f82c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:32.432954 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1003/2016] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:55:32.439099 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d6101-ad5f-4d5a-b4e8-c2eb3c2fca46 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:32.450595 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d6101-ad5f-4d5a-b4e8-c2eb3c2fca46 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:32.455374 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe7f87-5b78-465b-9391-760acb0d9f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:32.456298 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe7f87-5b78-465b-9391-760acb0d9f33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:32.456587 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe7f87-5b78-465b-9391-760acb0d9f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:32.456873 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe7f87-5b78-465b-9391-760acb0d9f33 admin admin] PATH_INFO: `/v3/projects/39380d6e35d8425da2291e6944f9ac82/users/c22909aaa1fc4f9baf27c726c547dc92/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:32.477962 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe7f87-5b78-465b-9391-760acb0d9f33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39380d6e35d8425da2291e6944f9ac82, user_id=c22909aaa1fc4f9baf27c726c547dc92, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:32.481201 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe7f87-5b78-465b-9391-760acb0d9f33 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:32.502954 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1014/2017] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:55:32 2022] PUT /identity/v3/projects/39380d6e35d8425da2291e6944f9ac82/users/c22909aaa1fc4f9baf27c726c547dc92/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:32.520701 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410dfbad-7cc2-4a5b-a889-3ad1b749c3c8 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:32.520966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410dfbad-7cc2-4a5b-a889-3ad1b749c3c8 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:32.521183 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410dfbad-7cc2-4a5b-a889-3ad1b749c3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:32.560727 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-410dfbad-7cc2-4a5b-a889-3ad1b749c3c8 None None] MFA Rules not processed for user `c22909aaa1fc4f9baf27c726c547dc92`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:32.563404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-410dfbad-7cc2-4a5b-a889-3ad1b749c3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:32.638091 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:32.686812 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1004/2018] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:32.702458 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe7f87-5b78-465b-9391-760acb0d9f33 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:32.705547 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-5efe7f87-5b78-465b-9391-760acb0d9f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:32.764117 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:32.780004 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe7f87-5b78-465b-9391-760acb0d9f33 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:32.784165 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33da8aa-fee9-48e8-bd10-e221681657cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:32.784837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33da8aa-fee9-48e8-bd10-e221681657cc service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:32.785338 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33da8aa-fee9-48e8-bd10-e221681657cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:32.785453 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33da8aa-fee9-48e8-bd10-e221681657cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:32.795423 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33da8aa-fee9-48e8-bd10-e221681657cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:32.796898 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33da8aa-fee9-48e8-bd10-e221681657cc service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:32.807866 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1015/2019] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:55:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:55:34.672217 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410dfbad-7cc2-4a5b-a889-3ad1b749c3c8 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:34.673828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-410dfbad-7cc2-4a5b-a889-3ad1b749c3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:34.685127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4034dbe-da2b-4070-864f-443a2dc798a3 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:34.685682 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4034dbe-da2b-4070-864f-443a2dc798a3 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:34.685682 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4034dbe-da2b-4070-864f-443a2dc798a3 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:34.687368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1016/2020] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jun 21 05:55:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:55:34.695856 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791d1a3-183f-4f45-9743-3ee288892e66 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:34.696359 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791d1a3-183f-4f45-9743-3ee288892e66 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:34.696797 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791d1a3-183f-4f45-9743-3ee288892e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:34.736803 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-b791d1a3-183f-4f45-9743-3ee288892e66 None None] MFA Rules not processed for user `d17a40bea6ba41f19c88e16f9b15cf27`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:34.738095 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b791d1a3-183f-4f45-9743-3ee288892e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:34.758367 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410dfbad-7cc2-4a5b-a889-3ad1b749c3c8 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:34.767234 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6da3a3-33ee-4f9a-a225-d2f5f43128e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:34.768204 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6da3a3-33ee-4f9a-a225-d2f5f43128e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:34.768517 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6da3a3-33ee-4f9a-a225-d2f5f43128e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:34.768785 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6da3a3-33ee-4f9a-a225-d2f5f43128e3 admin admin] PATH_INFO: `/v3/users/57b7fcc4c39e4efeb06d4dcd4034e8c1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:34.774348 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6da3a3-33ee-4f9a-a225-d2f5f43128e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57b7fcc4c39e4efeb06d4dcd4034e8c1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:34.780735 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6da3a3-33ee-4f9a-a225-d2f5f43128e3 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:34.859303 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1017/2021] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jun 21 05:55:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:55:34.860503 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791d1a3-183f-4f45-9743-3ee288892e66 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:34.862858 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b791d1a3-183f-4f45-9743-3ee288892e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:34.873281 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8a6da3a3-33ee-4f9a-a225-d2f5f43128e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57b7fcc4c39e4efeb06d4dcd4034e8c1'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:34.897525 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8a6da3a3-33ee-4f9a-a225-d2f5f43128e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57b7fcc4c39e4efeb06d4dcd4034e8c1'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:34.898084 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791d1a3-183f-4f45-9743-3ee288892e66 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:34.898742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8a6da3a3-33ee-4f9a-a225-d2f5f43128e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57b7fcc4c39e4efeb06d4dcd4034e8c1'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:34.900103 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8a6da3a3-33ee-4f9a-a225-d2f5f43128e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57b7fcc4c39e4efeb06d4dcd4034e8c1'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:34.907763 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31b381-119d-43a3-816f-b3cc4b7c237b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:34.908778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31b381-119d-43a3-816f-b3cc4b7c237b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:34.909171 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31b381-119d-43a3-816f-b3cc4b7c237b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:34.909724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31b381-119d-43a3-816f-b3cc4b7c237b admin admin] PATH_INFO: `/v3/users/a6924b4015a7495885d168495a5bfbfc` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:34.911260 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31b381-119d-43a3-816f-b3cc4b7c237b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6924b4015a7495885d168495a5bfbfc)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:34.914160 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31b381-119d-43a3-816f-b3cc4b7c237b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:34.922187 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-8a6da3a3-33ee-4f9a-a225-d2f5f43128e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57b7fcc4c39e4efeb06d4dcd4034e8c1'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:34.942573 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1005/2022] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:55:34 2022] DELETE /identity/v3/users/57b7fcc4c39e4efeb06d4dcd4034e8c1 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 05:55:34.943480 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6da3a3-33ee-4f9a-a225-d2f5f43128e3 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:34.944927 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8a6da3a3-33ee-4f9a-a225-d2f5f43128e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:34.999318 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6c31b381-119d-43a3-816f-b3cc4b7c237b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6924b4015a7495885d168495a5bfbfc'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:35.009472 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6c31b381-119d-43a3-816f-b3cc4b7c237b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6924b4015a7495885d168495a5bfbfc'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:35.010548 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6c31b381-119d-43a3-816f-b3cc4b7c237b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6924b4015a7495885d168495a5bfbfc'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:35.027471 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6c31b381-119d-43a3-816f-b3cc4b7c237b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6924b4015a7495885d168495a5bfbfc'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:35.032934 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:35.038707 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6da3a3-33ee-4f9a-a225-d2f5f43128e3 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:35.049258 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b35840-e034-4a71-a588-e34070cb3e1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17a40bea6ba41f19c88e16f9b15cf27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:35.050584 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b35840-e034-4a71-a588-e34070cb3e1c service placement] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:35.051839 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b35840-e034-4a71-a588-e34070cb3e1c service placement] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:35.053363 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b35840-e034-4a71-a588-e34070cb3e1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:35.055972 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-58b35840-e034-4a71-a588-e34070cb3e1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:35.058892 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6c31b381-119d-43a3-816f-b3cc4b7c237b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6924b4015a7495885d168495a5bfbfc'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:35.078624 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b35840-e034-4a71-a588-e34070cb3e1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:35.078751 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1018/2023] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:55:34 2022] DELETE /identity/v3/users/a6924b4015a7495885d168495a5bfbfc => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:35.080776 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2e6db-0307-4f71-a314-b3e289b41a1f None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:35.081959 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2e6db-0307-4f71-a314-b3e289b41a1f None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:35.081959 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2e6db-0307-4f71-a314-b3e289b41a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:35.083199 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b35840-e034-4a71-a588-e34070cb3e1c service placement] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:35.095720 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1006/2024] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:55:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:55:35.159512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-80a2e6db-0307-4f71-a314-b3e289b41a1f None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:35.161517 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-80a2e6db-0307-4f71-a314-b3e289b41a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:35.230737 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:35.245558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1019/2025] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:35.255761 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b35840-e034-4a71-a588-e34070cb3e1c service placement] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:35.257228 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-58b35840-e034-4a71-a588-e34070cb3e1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:35.298880 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2e6db-0307-4f71-a314-b3e289b41a1f None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:35.302170 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-80a2e6db-0307-4f71-a314-b3e289b41a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:35.316177 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2e6db-0307-4f71-a314-b3e289b41a1f None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:35.321549 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fce3bd-123c-4359-8ec5-d75bd87ca97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:35.322470 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fce3bd-123c-4359-8ec5-d75bd87ca97c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:35.322785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fce3bd-123c-4359-8ec5-d75bd87ca97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:35.323110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fce3bd-123c-4359-8ec5-d75bd87ca97c admin admin] PATH_INFO: `/v3/projects/9c9925a32b094db69c8637996e9cafa1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:35.324383 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fce3bd-123c-4359-8ec5-d75bd87ca97c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c9925a32b094db69c8637996e9cafa1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:35.326358 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fce3bd-123c-4359-8ec5-d75bd87ca97c admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:35.331293 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b35840-e034-4a71-a588-e34070cb3e1c service placement] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:35.382752 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f1fce3bd-123c-4359-8ec5-d75bd87ca97c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c9925a32b094db69c8637996e9cafa1', 'request_id': 'req-f1fce3bd-123c-4359-8ec5-d75bd87ca97c'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:35.388927 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f1fce3bd-123c-4359-8ec5-d75bd87ca97c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c9925a32b094db69c8637996e9cafa1', 'request_id': 'req-f1fce3bd-123c-4359-8ec5-d75bd87ca97c'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:35.391611 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449fb5b-85b2-4e0d-a8b2-3b008bac0ffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:35.392301 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449fb5b-85b2-4e0d-a8b2-3b008bac0ffc service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:35.392569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449fb5b-85b2-4e0d-a8b2-3b008bac0ffc service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:35.392854 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449fb5b-85b2-4e0d-a8b2-3b008bac0ffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:35.396472 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f1fce3bd-123c-4359-8ec5-d75bd87ca97c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c9925a32b094db69c8637996e9cafa1', 'request_id': 'req-f1fce3bd-123c-4359-8ec5-d75bd87ca97c'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:35.407222 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449fb5b-85b2-4e0d-a8b2-3b008bac0ffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:35.408918 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449fb5b-85b2-4e0d-a8b2-3b008bac0ffc service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:35.418442 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f1fce3bd-123c-4359-8ec5-d75bd87ca97c admin admin] The token cache is being invalidate because project 9c9925a32b094db69c8637996e9cafa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:55:35.420683 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1007/2026] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:55:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:55:35.422155 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f1fce3bd-123c-4359-8ec5-d75bd87ca97c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:35.422958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f1fce3bd-123c-4359-8ec5-d75bd87ca97c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:35.425128 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1020/2027] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:55:35 2022] DELETE /identity/v3/projects/9c9925a32b094db69c8637996e9cafa1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:35.431122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4490f05-6691-4659-b2da-833438b6d7aa None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:35.431556 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4490f05-6691-4659-b2da-833438b6d7aa None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:35.432013 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4490f05-6691-4659-b2da-833438b6d7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:35.456781 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-c4490f05-6691-4659-b2da-833438b6d7aa None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:35.458167 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c4490f05-6691-4659-b2da-833438b6d7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:35.552934 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1021/2028] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:35.566489 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70ae5f-cc64-4279-8748-9334ca21b1c7 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:35.567000 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70ae5f-cc64-4279-8748-9334ca21b1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:35.567494 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70ae5f-cc64-4279-8748-9334ca21b1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:35.606590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-1c70ae5f-cc64-4279-8748-9334ca21b1c7 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:35.608788 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1c70ae5f-cc64-4279-8748-9334ca21b1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:35.642746 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1008/2029] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:35.648573 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4490f05-6691-4659-b2da-833438b6d7aa None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:35.662272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4490f05-6691-4659-b2da-833438b6d7aa None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:35.668955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2c621-66c9-4fcf-bd5b-68b7d450c294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:35.670164 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2c621-66c9-4fcf-bd5b-68b7d450c294 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:35.670639 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2c621-66c9-4fcf-bd5b-68b7d450c294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:35.671106 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2c621-66c9-4fcf-bd5b-68b7d450c294 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:35.671955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2c621-66c9-4fcf-bd5b-68b7d450c294 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:55:35.672326 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2c621-66c9-4fcf-bd5b-68b7d450c294 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:35.674250 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2c621-66c9-4fcf-bd5b-68b7d450c294 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:35.700473 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1022/2030] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:55:35.701465 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70ae5f-cc64-4279-8748-9334ca21b1c7 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:35.713789 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70ae5f-cc64-4279-8748-9334ca21b1c7 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:35.728179 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe8d02-7d29-45e8-9d61-085a044d80a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:35.728872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe8d02-7d29-45e8-9d61-085a044d80a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:35.731583 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe8d02-7d29-45e8-9d61-085a044d80a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:35.731583 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe8d02-7d29-45e8-9d61-085a044d80a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:35.732041 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe8d02-7d29-45e8-9d61-085a044d80a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:35.740736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe8d02-7d29-45e8-9d61-085a044d80a5 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:35.760677 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2c621-66c9-4fcf-bd5b-68b7d450c294 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:35.763687 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-31f2c621-66c9-4fcf-bd5b-68b7d450c294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:35.792688 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2c621-66c9-4fcf-bd5b-68b7d450c294 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:35.809124 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d458f7-e5c0-439e-aaba-5d312833843c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:35.811360 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d458f7-e5c0-439e-aaba-5d312833843c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:35.811665 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d458f7-e5c0-439e-aaba-5d312833843c admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:35.811988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d458f7-e5c0-439e-aaba-5d312833843c admin admin] PATH_INFO: `/v3/projects/8acb00e69a354a91a41fcd6d086221f9` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:35.813612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d458f7-e5c0-439e-aaba-5d312833843c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8acb00e69a354a91a41fcd6d086221f9)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:35.817345 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d458f7-e5c0-439e-aaba-5d312833843c admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:35.831145 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1009/2031] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:55:35 2022] POST /identity/v3/projects => generated 403 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:35.836973 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe8d02-7d29-45e8-9d61-085a044d80a5 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:35.907558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-20d458f7-e5c0-439e-aaba-5d312833843c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8acb00e69a354a91a41fcd6d086221f9', 'request_id': 'req-20d458f7-e5c0-439e-aaba-5d312833843c'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:35.920427 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-20d458f7-e5c0-439e-aaba-5d312833843c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8acb00e69a354a91a41fcd6d086221f9', 'request_id': 'req-20d458f7-e5c0-439e-aaba-5d312833843c'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:35.923075 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:35.936434 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-20d458f7-e5c0-439e-aaba-5d312833843c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8acb00e69a354a91a41fcd6d086221f9', 'request_id': 'req-20d458f7-e5c0-439e-aaba-5d312833843c'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:35.937891 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe8d02-7d29-45e8-9d61-085a044d80a5 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:35.980774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-20d458f7-e5c0-439e-aaba-5d312833843c admin admin] The token cache is being invalidate because project 8acb00e69a354a91a41fcd6d086221f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:55:35.981102 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-20d458f7-e5c0-439e-aaba-5d312833843c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:35.982490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-20d458f7-e5c0-439e-aaba-5d312833843c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:35.984555 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:35.989565 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1023/2032] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:55:35 2022] DELETE /identity/v3/projects/8acb00e69a354a91a41fcd6d086221f9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:35.991096 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700aed3-0f94-4076-b3a5-7d98ff309058 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:35.991392 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700aed3-0f94-4076-b3a5-7d98ff309058 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:35.991672 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700aed3-0f94-4076-b3a5-7d98ff309058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:36.009590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-0700aed3-0f94-4076-b3a5-7d98ff309058 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:36.011013 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0700aed3-0f94-4076-b3a5-7d98ff309058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:36.023922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbfac7-c7e7-4772-8a0d-5382d8ef273b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:36.024690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbfac7-c7e7-4772-8a0d-5382d8ef273b admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:36.025065 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbfac7-c7e7-4772-8a0d-5382d8ef273b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:36.025409 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbfac7-c7e7-4772-8a0d-5382d8ef273b admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:36.026212 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbfac7-c7e7-4772-8a0d-5382d8ef273b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:36.030653 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbfac7-c7e7-4772-8a0d-5382d8ef273b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:36.057502 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1010/2033] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:55:35 2022] POST /identity/v3/users => generated 302 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 05:55:36.061556 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbfac7-c7e7-4772-8a0d-5382d8ef273b admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:36.063355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-cdcbfac7-c7e7-4772-8a0d-5382d8ef273b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:36.076149 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbfac7-c7e7-4772-8a0d-5382d8ef273b admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:36.081845 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904033e5-6087-471e-9b14-f845dd82861a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:36.082477 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1024/2034] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:36.082865 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904033e5-6087-471e-9b14-f845dd82861a admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:36.083274 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904033e5-6087-471e-9b14-f845dd82861a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:36.083572 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904033e5-6087-471e-9b14-f845dd82861a admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:36.084303 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904033e5-6087-471e-9b14-f845dd82861a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:36.085925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904033e5-6087-471e-9b14-f845dd82861a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:36.093565 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f711fd-4c5a-42a1-8cf8-63f53b51887c None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:36.094088 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f711fd-4c5a-42a1-8cf8-63f53b51887c None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:36.094553 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f711fd-4c5a-42a1-8cf8-63f53b51887c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:36.104991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1011/2035] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 05:55:36.108872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904033e5-6087-471e-9b14-f845dd82861a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:36.118664 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-43f711fd-4c5a-42a1-8cf8-63f53b51887c None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:36.118874 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904033e5-6087-471e-9b14-f845dd82861a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:36.119882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-43f711fd-4c5a-42a1-8cf8-63f53b51887c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:36.123668 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c117cc-7f00-43a2-9ac1-2ff8b6ceee1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:36.124330 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c117cc-7f00-43a2-9ac1-2ff8b6ceee1e admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:36.124619 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c117cc-7f00-43a2-9ac1-2ff8b6ceee1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:36.124894 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c117cc-7f00-43a2-9ac1-2ff8b6ceee1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:36.125652 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c117cc-7f00-43a2-9ac1-2ff8b6ceee1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:36.127273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c117cc-7f00-43a2-9ac1-2ff8b6ceee1e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:36.128763 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1025/2036] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:55:36.133012 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f711fd-4c5a-42a1-8cf8-63f53b51887c None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:36.142422 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1012/2037] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:55:36.142964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f711fd-4c5a-42a1-8cf8-63f53b51887c None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:36.143573 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c117cc-7f00-43a2-9ac1-2ff8b6ceee1e admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:36.147703 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f8b63-b8e3-4f73-b20e-004a92d45aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:36.148366 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f8b63-b8e3-4f73-b20e-004a92d45aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:36.148658 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f8b63-b8e3-4f73-b20e-004a92d45aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:36.148939 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f8b63-b8e3-4f73-b20e-004a92d45aa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:36.149681 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f8b63-b8e3-4f73-b20e-004a92d45aa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:55:36.150020 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f8b63-b8e3-4f73-b20e-004a92d45aa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:36.151620 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f8b63-b8e3-4f73-b20e-004a92d45aa3 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:36.156669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c117cc-7f00-43a2-9ac1-2ff8b6ceee1e admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:36.162619 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b1d7a-cd18-4f68-946d-96a53c7ff0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:36.163715 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b1d7a-cd18-4f68-946d-96a53c7ff0e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:36.164131 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b1d7a-cd18-4f68-946d-96a53c7ff0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:36.164407 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b1d7a-cd18-4f68-946d-96a53c7ff0e1 admin admin] PATH_INFO: `/v3/projects/e5c7519667224bc9bb3b82721fbce228/users/39093b9aa5654eebac307901b7cfd0fd/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:36.165968 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1026/2038] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:55:36.170291 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f8b63-b8e3-4f73-b20e-004a92d45aa3 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:36.180603 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f8b63-b8e3-4f73-b20e-004a92d45aa3 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:36.182436 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b1d7a-cd18-4f68-946d-96a53c7ff0e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5c7519667224bc9bb3b82721fbce228, user_id=39093b9aa5654eebac307901b7cfd0fd, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:36.185211 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4547f-b7ed-43d1-91f0-597d60c1af99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:36.185879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4547f-b7ed-43d1-91f0-597d60c1af99 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:36.186043 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b1d7a-cd18-4f68-946d-96a53c7ff0e1 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:36.186192 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4547f-b7ed-43d1-91f0-597d60c1af99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:36.186472 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4547f-b7ed-43d1-91f0-597d60c1af99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:36.187195 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4547f-b7ed-43d1-91f0-597d60c1af99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:36.189092 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4547f-b7ed-43d1-91f0-597d60c1af99 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:36.204879 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1013/2039] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:55:36 2022] PUT /identity/v3/projects/e5c7519667224bc9bb3b82721fbce228/users/39093b9aa5654eebac307901b7cfd0fd/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:36.204879 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b1d7a-cd18-4f68-946d-96a53c7ff0e1 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:36.204879 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ef0b1d7a-cd18-4f68-946d-96a53c7ff0e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:36.224860 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1027/2040] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:55:36 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:36.224860 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6f4aa-7da5-48df-82ca-9c374873b09f None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:36.224860 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6f4aa-7da5-48df-82ca-9c374873b09f None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:36.224860 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6f4aa-7da5-48df-82ca-9c374873b09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:36.240729 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-c1e6f4aa-7da5-48df-82ca-9c374873b09f None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:36.242564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c1e6f4aa-7da5-48df-82ca-9c374873b09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:36.271696 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b1d7a-cd18-4f68-946d-96a53c7ff0e1 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:36.305860 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1028/2041] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:36.306842 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6f4aa-7da5-48df-82ca-9c374873b09f None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:36.317022 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6f4aa-7da5-48df-82ca-9c374873b09f None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:36.322015 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50335d7-1656-44b3-9275-97801594c724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:36.322691 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50335d7-1656-44b3-9275-97801594c724 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:36.322977 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50335d7-1656-44b3-9275-97801594c724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:36.323255 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50335d7-1656-44b3-9275-97801594c724 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:36.324512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50335d7-1656-44b3-9275-97801594c724 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:36.326523 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50335d7-1656-44b3-9275-97801594c724 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:36.334375 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a670c-4fb2-4ddc-95dd-65dc5d3f1e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:36.335016 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a670c-4fb2-4ddc-95dd-65dc5d3f1e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:36.335387 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a670c-4fb2-4ddc-95dd-65dc5d3f1e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:36.335634 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a670c-4fb2-4ddc-95dd-65dc5d3f1e5f admin admin] PATH_INFO: `/v3/users/c22909aaa1fc4f9baf27c726c547dc92` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:36.337339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a670c-4fb2-4ddc-95dd-65dc5d3f1e5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c22909aaa1fc4f9baf27c726c547dc92)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:36.339603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a670c-4fb2-4ddc-95dd-65dc5d3f1e5f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:36.347746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1029/2042] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:55:36 2022] POST /identity/v3/users => generated 285 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:36.348869 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50335d7-1656-44b3-9275-97801594c724 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:36.350696 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e50335d7-1656-44b3-9275-97801594c724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:36.363956 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:36.383319 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:36.394383 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5b5a670c-4fb2-4ddc-95dd-65dc5d3f1e5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c22909aaa1fc4f9baf27c726c547dc92'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:36.403982 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5b5a670c-4fb2-4ddc-95dd-65dc5d3f1e5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c22909aaa1fc4f9baf27c726c547dc92'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:36.404669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5b5a670c-4fb2-4ddc-95dd-65dc5d3f1e5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c22909aaa1fc4f9baf27c726c547dc92'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:36.405301 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5b5a670c-4fb2-4ddc-95dd-65dc5d3f1e5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c22909aaa1fc4f9baf27c726c547dc92'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:36.412194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50335d7-1656-44b3-9275-97801594c724 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:36.415925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda0477-ffb4-448f-bbcf-fb517a9fc74e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:36.416580 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda0477-ffb4-448f-bbcf-fb517a9fc74e service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:36.416856 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda0477-ffb4-448f-bbcf-fb517a9fc74e service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:36.417137 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda0477-ffb4-448f-bbcf-fb517a9fc74e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:36.418423 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5b5a670c-4fb2-4ddc-95dd-65dc5d3f1e5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c22909aaa1fc4f9baf27c726c547dc92'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:36.419126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9bda0477-ffb4-448f-bbcf-fb517a9fc74e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:36.431063 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1014/2043] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:55:36 2022] DELETE /identity/v3/users/c22909aaa1fc4f9baf27c726c547dc92 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:36.431915 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a670c-4fb2-4ddc-95dd-65dc5d3f1e5f admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:36.433785 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5b5a670c-4fb2-4ddc-95dd-65dc5d3f1e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:36.435747 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda0477-ffb4-448f-bbcf-fb517a9fc74e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:36.437268 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda0477-ffb4-448f-bbcf-fb517a9fc74e service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:36.447821 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1030/2044] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:55:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:55:36.449878 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f1088-81e1-44c0-a400-114f187b032d None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:36.450265 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f1088-81e1-44c0-a400-114f187b032d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:36.450681 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f1088-81e1-44c0-a400-114f187b032d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:36.468749 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-3e3f1088-81e1-44c0-a400-114f187b032d None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:36.470053 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3e3f1088-81e1-44c0-a400-114f187b032d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:36.529322 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a670c-4fb2-4ddc-95dd-65dc5d3f1e5f admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:36.534865 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365b115-bcac-4a6e-842f-ee19a5f90e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:36.535652 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365b115-bcac-4a6e-842f-ee19a5f90e8b admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:36.535945 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365b115-bcac-4a6e-842f-ee19a5f90e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:36.536396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365b115-bcac-4a6e-842f-ee19a5f90e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:36.537179 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365b115-bcac-4a6e-842f-ee19a5f90e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:36.538890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365b115-bcac-4a6e-842f-ee19a5f90e8b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:36.550285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1015/2045] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:55:36.554998 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365b115-bcac-4a6e-842f-ee19a5f90e8b admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:36.562831 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1031/2046] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:36.571816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365b115-bcac-4a6e-842f-ee19a5f90e8b admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:36.577427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b8ff7-53ea-4e00-83df-024eb535dd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:36.578259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b8ff7-53ea-4e00-83df-024eb535dd81 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:36.578611 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b8ff7-53ea-4e00-83df-024eb535dd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:36.579322 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b8ff7-53ea-4e00-83df-024eb535dd81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:36.580214 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b8ff7-53ea-4e00-83df-024eb535dd81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:36.581774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f1088-81e1-44c0-a400-114f187b032d None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:36.582075 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b8ff7-53ea-4e00-83df-024eb535dd81 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:36.583882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3e3f1088-81e1-44c0-a400-114f187b032d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:36.596341 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1016/2047] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 05:55:36.600281 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b8ff7-53ea-4e00-83df-024eb535dd81 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:36.614630 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b8ff7-53ea-4e00-83df-024eb535dd81 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:36.620366 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df3eb2-137c-4aff-afb5-f40b994a87cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:36.621836 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df3eb2-137c-4aff-afb5-f40b994a87cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:36.622155 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df3eb2-137c-4aff-afb5-f40b994a87cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:36.622452 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df3eb2-137c-4aff-afb5-f40b994a87cd admin admin] PATH_INFO: `/v3/projects/f1baa49a5cf04fe6823735b87199e6f5/users/bfc71cb464194712959a2ee7f8b90c26/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:36.640867 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df3eb2-137c-4aff-afb5-f40b994a87cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1baa49a5cf04fe6823735b87199e6f5, user_id=bfc71cb464194712959a2ee7f8b90c26, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:36.644344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df3eb2-137c-4aff-afb5-f40b994a87cd admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:36.661213 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1017/2048] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:55:36 2022] PUT /identity/v3/projects/f1baa49a5cf04fe6823735b87199e6f5/users/bfc71cb464194712959a2ee7f8b90c26/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:36.672111 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ec639-2838-4f7f-b4fa-ddf430d9f2d2 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:36.672756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ec639-2838-4f7f-b4fa-ddf430d9f2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:36.673441 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ec639-2838-4f7f-b4fa-ddf430d9f2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:36.673731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f1088-81e1-44c0-a400-114f187b032d None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:36.707769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-652ec639-2838-4f7f-b4fa-ddf430d9f2d2 None None] MFA Rules not processed for user `bfc71cb464194712959a2ee7f8b90c26`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:36.709411 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-652ec639-2838-4f7f-b4fa-ddf430d9f2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:36.735407 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133f813-65e9-415c-9d90-f0775a9b6a62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:36.736284 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133f813-65e9-415c-9d90-f0775a9b6a62 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:36.736569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133f813-65e9-415c-9d90-f0775a9b6a62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:36.736897 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133f813-65e9-415c-9d90-f0775a9b6a62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:36.768289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:36.785315 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:36.796319 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1018/2049] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:36.811702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133f813-65e9-415c-9d90-f0775a9b6a62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:36.813773 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ec639-2838-4f7f-b4fa-ddf430d9f2d2 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:36.814453 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133f813-65e9-415c-9d90-f0775a9b6a62 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:36.814941 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-652ec639-2838-4f7f-b4fa-ddf430d9f2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:36.827337 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1032/2050] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:55:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 05:55:36.926964 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ec639-2838-4f7f-b4fa-ddf430d9f2d2 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:36.937152 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c6253-b51b-4bbc-9362-51c411af6e05 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44776834b134ae98fa28d4741cc4ec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:36.939265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c6253-b51b-4bbc-9362-51c411af6e05 service glance] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:36.940055 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c6253-b51b-4bbc-9362-51c411af6e05 service glance] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:36.941143 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c6253-b51b-4bbc-9362-51c411af6e05 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:36.966154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c6253-b51b-4bbc-9362-51c411af6e05 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:36.969194 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c6253-b51b-4bbc-9362-51c411af6e05 service glance] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:37.004557 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1019/2051] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:55:36 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:55:37.285997 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133f813-65e9-415c-9d90-f0775a9b6a62 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:37.287981 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b133f813-65e9-415c-9d90-f0775a9b6a62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:37.325912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133f813-65e9-415c-9d90-f0775a9b6a62 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:37.332594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463b6e4-81f2-4fb9-a767-19a097106de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:37.334226 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463b6e4-81f2-4fb9-a767-19a097106de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:37.334638 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463b6e4-81f2-4fb9-a767-19a097106de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:37.335825 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463b6e4-81f2-4fb9-a767-19a097106de1 admin admin] PATH_INFO: `/v3/projects/39380d6e35d8425da2291e6944f9ac82` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:37.337256 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463b6e4-81f2-4fb9-a767-19a097106de1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39380d6e35d8425da2291e6944f9ac82)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:37.339992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463b6e4-81f2-4fb9-a767-19a097106de1 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:37.430933 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1463b6e4-81f2-4fb9-a767-19a097106de1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39380d6e35d8425da2291e6944f9ac82', 'request_id': 'req-1463b6e4-81f2-4fb9-a767-19a097106de1'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:37.431878 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ef492-a7ec-47f5-8259-6d686ef5bd3d None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:37.432167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ef492-a7ec-47f5-8259-6d686ef5bd3d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:37.432452 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ef492-a7ec-47f5-8259-6d686ef5bd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:37.440052 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1463b6e4-81f2-4fb9-a767-19a097106de1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39380d6e35d8425da2291e6944f9ac82', 'request_id': 'req-1463b6e4-81f2-4fb9-a767-19a097106de1'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:37.450956 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1463b6e4-81f2-4fb9-a767-19a097106de1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39380d6e35d8425da2291e6944f9ac82', 'request_id': 'req-1463b6e4-81f2-4fb9-a767-19a097106de1'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:37.466423 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-a11ef492-a7ec-47f5-8259-6d686ef5bd3d None None] MFA Rules not processed for user `39093b9aa5654eebac307901b7cfd0fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:37.468301 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a11ef492-a7ec-47f5-8259-6d686ef5bd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:37.471839 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1463b6e4-81f2-4fb9-a767-19a097106de1 admin admin] The token cache is being invalidate because project 39380d6e35d8425da2291e6944f9ac82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:55:37.472185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1463b6e4-81f2-4fb9-a767-19a097106de1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:37.473184 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1463b6e4-81f2-4fb9-a767-19a097106de1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:37.482069 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1033/2052] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:55:37 2022] DELETE /identity/v3/projects/39380d6e35d8425da2291e6944f9ac82 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:37.483911 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c237a-35e2-46d2-8630-46d5447b3c5c None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:37.484279 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c237a-35e2-46d2-8630-46d5447b3c5c None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:37.484881 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c237a-35e2-46d2-8630-46d5447b3c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:37.510837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-ab6c237a-35e2-46d2-8630-46d5447b3c5c None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:37.512808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ab6c237a-35e2-46d2-8630-46d5447b3c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:37.561538 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1020/2053] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:55:37.566599 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ef492-a7ec-47f5-8259-6d686ef5bd3d None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:37.568306 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a11ef492-a7ec-47f5-8259-6d686ef5bd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:37.615066 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1034/2054] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:37.626485 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add4e60-1932-40ee-9b67-6f8e020232ce None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:37.627620 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add4e60-1932-40ee-9b67-6f8e020232ce None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:37.628133 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add4e60-1932-40ee-9b67-6f8e020232ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:37.667771 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-9add4e60-1932-40ee-9b67-6f8e020232ce None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:37.669289 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9add4e60-1932-40ee-9b67-6f8e020232ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:37.670217 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ef492-a7ec-47f5-8259-6d686ef5bd3d None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:37.676673 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff4c30-6612-474a-84e6-851b8d90076c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:37.677344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff4c30-6612-474a-84e6-851b8d90076c admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:37.677627 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff4c30-6612-474a-84e6-851b8d90076c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:37.677902 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff4c30-6612-474a-84e6-851b8d90076c admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:37.678660 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff4c30-6612-474a-84e6-851b8d90076c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:37.678775 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1035/2055] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:37.682332 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff4c30-6612-474a-84e6-851b8d90076c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:37.683160 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add4e60-1932-40ee-9b67-6f8e020232ce None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:37.696945 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add4e60-1932-40ee-9b67-6f8e020232ce None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:37.702499 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0986c83-9f45-4df0-a55e-ddb98599bbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:37.703176 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0986c83-9f45-4df0-a55e-ddb98599bbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:37.704074 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0986c83-9f45-4df0-a55e-ddb98599bbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:37.704074 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0986c83-9f45-4df0-a55e-ddb98599bbb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:37.704637 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0986c83-9f45-4df0-a55e-ddb98599bbb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:55:37.704952 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0986c83-9f45-4df0-a55e-ddb98599bbb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:37.706613 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0986c83-9f45-4df0-a55e-ddb98599bbb7 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:37.720723 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1036/2056] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:55:37.726114 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0986c83-9f45-4df0-a55e-ddb98599bbb7 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:37.730185 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1021/2057] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:55:37 2022] POST /identity/v3/projects => generated 403 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 05:55:37.732970 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff4c30-6612-474a-84e6-851b8d90076c admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:37.739269 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0986c83-9f45-4df0-a55e-ddb98599bbb7 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:37.748113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:37.785857 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:37.804511 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215975f0-e4d0-4c8f-9e4a-ceed1f71f029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:37.805179 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215975f0-e4d0-4c8f-9e4a-ceed1f71f029 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:37.805463 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215975f0-e4d0-4c8f-9e4a-ceed1f71f029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:37.805746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215975f0-e4d0-4c8f-9e4a-ceed1f71f029 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:37.806494 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215975f0-e4d0-4c8f-9e4a-ceed1f71f029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:37.808455 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215975f0-e4d0-4c8f-9e4a-ceed1f71f029 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:37.809029 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff4c30-6612-474a-84e6-851b8d90076c admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:37.813795 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bf7a5-6a77-4f2a-acc6-14e80dff5447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:37.814500 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bf7a5-6a77-4f2a-acc6-14e80dff5447 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:37.814782 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bf7a5-6a77-4f2a-acc6-14e80dff5447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:37.815061 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bf7a5-6a77-4f2a-acc6-14e80dff5447 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:37.816462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1bf7a5-6a77-4f2a-acc6-14e80dff5447 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:37.818555 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1bf7a5-6a77-4f2a-acc6-14e80dff5447 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:37.844516 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1037/2058] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:55:37 2022] POST /identity/v3/projects => generated 361 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:37.844704 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1022/2059] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:55:37 2022] POST /identity/v3/users => generated 308 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:37.845847 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215975f0-e4d0-4c8f-9e4a-ceed1f71f029 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:37.847474 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bf7a5-6a77-4f2a-acc6-14e80dff5447 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:37.858260 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bf7a5-6a77-4f2a-acc6-14e80dff5447 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:37.929340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa50b46-9b92-4cb2-a491-b491057875a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:37.930051 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa50b46-9b92-4cb2-a491-b491057875a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:37.930335 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa50b46-9b92-4cb2-a491-b491057875a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:37.930611 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa50b46-9b92-4cb2-a491-b491057875a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:37.931349 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa50b46-9b92-4cb2-a491-b491057875a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:37.932971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa50b46-9b92-4cb2-a491-b491057875a0 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:37.939054 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215975f0-e4d0-4c8f-9e4a-ceed1f71f029 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:37.946233 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1023/2060] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:55:37.951028 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa50b46-9b92-4cb2-a491-b491057875a0 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:37.952620 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f07ef-c9fe-4a31-b2dc-5782e882ae61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:37.953319 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f07ef-c9fe-4a31-b2dc-5782e882ae61 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:37.953603 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f07ef-c9fe-4a31-b2dc-5782e882ae61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:37.953884 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f07ef-c9fe-4a31-b2dc-5782e882ae61 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:37.954625 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f07ef-c9fe-4a31-b2dc-5782e882ae61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:37.956555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f07ef-c9fe-4a31-b2dc-5782e882ae61 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:37.962370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa50b46-9b92-4cb2-a491-b491057875a0 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:37.973864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8d869-17f0-4a5d-aa51-a846ea8842de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:37.976389 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8d869-17f0-4a5d-aa51-a846ea8842de admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:37.976782 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8d869-17f0-4a5d-aa51-a846ea8842de admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:37.977158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8d869-17f0-4a5d-aa51-a846ea8842de admin admin] PATH_INFO: `/v3/projects/fb97c1a44ac24713b6cb6e31ac8ca0ff/users/835f2f01fe294f1b9a415b2da88b47f1/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:37.982397 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1038/2061] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:55:37 2022] POST /identity/v3/users => generated 281 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 05:55:37.986645 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f07ef-c9fe-4a31-b2dc-5782e882ae61 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:37.994323 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8d869-17f0-4a5d-aa51-a846ea8842de admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb97c1a44ac24713b6cb6e31ac8ca0ff, user_id=835f2f01fe294f1b9a415b2da88b47f1, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:37.997533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8d869-17f0-4a5d-aa51-a846ea8842de admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:37.999033 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f07ef-c9fe-4a31-b2dc-5782e882ae61 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:38.004730 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f41005-e5a1-4819-93fc-7844ada40b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:38.005466 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f41005-e5a1-4819-93fc-7844ada40b0d admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:38.005758 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f41005-e5a1-4819-93fc-7844ada40b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:38.006100 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f41005-e5a1-4819-93fc-7844ada40b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:38.006812 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f41005-e5a1-4819-93fc-7844ada40b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:38.009133 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f41005-e5a1-4819-93fc-7844ada40b0d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:38.017488 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1024/2062] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:55:37 2022] PUT /identity/v3/projects/fb97c1a44ac24713b6cb6e31ac8ca0ff/users/835f2f01fe294f1b9a415b2da88b47f1/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 05:55:38.018517 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8d869-17f0-4a5d-aa51-a846ea8842de admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:38.025008 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1039/2063] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 05:55:38.025912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f41005-e5a1-4819-93fc-7844ada40b0d admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:38.037772 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f41005-e5a1-4819-93fc-7844ada40b0d admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:38.110352 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8d869-17f0-4a5d-aa51-a846ea8842de admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:38.121917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd5383-8ba4-42a6-bafc-9f471ba42904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:38.122137 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc44870-d2c3-4422-ab4d-dd72f496c110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:38.122730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd5383-8ba4-42a6-bafc-9f471ba42904 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:38.122925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc44870-d2c3-4422-ab4d-dd72f496c110 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:38.123162 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd5383-8ba4-42a6-bafc-9f471ba42904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:38.123445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd5383-8ba4-42a6-bafc-9f471ba42904 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:38.123606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc44870-d2c3-4422-ab4d-dd72f496c110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:38.123920 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc44870-d2c3-4422-ab4d-dd72f496c110 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:38.125189 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd5383-8ba4-42a6-bafc-9f471ba42904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:38.125337 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc44870-d2c3-4422-ab4d-dd72f496c110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:38.126005 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd5383-8ba4-42a6-bafc-9f471ba42904 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:38.126352 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc44870-d2c3-4422-ab4d-dd72f496c110 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:38.137828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1025/2064] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:55:38.138102 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1040/2065] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 05:55:38.141656 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd5383-8ba4-42a6-bafc-9f471ba42904 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:38.141840 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc44870-d2c3-4422-ab4d-dd72f496c110 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:38.148330 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:38.152969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd5383-8ba4-42a6-bafc-9f471ba42904 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:38.153221 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc44870-d2c3-4422-ab4d-dd72f496c110 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:38.158405 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089946cb-24c2-4078-8d09-7d4743974377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:38.159356 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089946cb-24c2-4078-8d09-7d4743974377 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:38.159640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089946cb-24c2-4078-8d09-7d4743974377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:38.159934 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089946cb-24c2-4078-8d09-7d4743974377 admin admin] PATH_INFO: `/v3/projects/86139d6a7faf48cb821034f6af40e779/users/22515ecf442c41b4a17db0e3750a580a/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:38.164542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086d9c2-b4ed-4421-b100-1943739880ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:38.165909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086d9c2-b4ed-4421-b100-1943739880ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:38.166351 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086d9c2-b4ed-4421-b100-1943739880ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:38.166744 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086d9c2-b4ed-4421-b100-1943739880ee admin admin] PATH_INFO: `/v3/projects/fb97c1a44ac24713b6cb6e31ac8ca0ff/users/835f2f01fe294f1b9a415b2da88b47f1/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:38.169040 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086d9c2-b4ed-4421-b100-1943739880ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb97c1a44ac24713b6cb6e31ac8ca0ff, user_id=835f2f01fe294f1b9a415b2da88b47f1, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:38.171999 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086d9c2-b4ed-4421-b100-1943739880ee admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:38.192765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1026/2066] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:55:38 2022] PUT /identity/v3/projects/fb97c1a44ac24713b6cb6e31ac8ca0ff/users/835f2f01fe294f1b9a415b2da88b47f1/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 05:55:38.201389 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089946cb-24c2-4078-8d09-7d4743974377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86139d6a7faf48cb821034f6af40e779, user_id=22515ecf442c41b4a17db0e3750a580a, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:38.205477 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089946cb-24c2-4078-8d09-7d4743974377 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:38.234200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1041/2067] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:55:38 2022] PUT /identity/v3/projects/86139d6a7faf48cb821034f6af40e779/users/22515ecf442c41b4a17db0e3750a580a/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 05:55:38.236649 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65faf47c-3af2-4dad-99e8-f44c2b4be235 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:38.237075 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65faf47c-3af2-4dad-99e8-f44c2b4be235 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:38.237971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65faf47c-3af2-4dad-99e8-f44c2b4be235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:38.290664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-65faf47c-3af2-4dad-99e8-f44c2b4be235 None None] MFA Rules not processed for user `22515ecf442c41b4a17db0e3750a580a`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:38.293292 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-65faf47c-3af2-4dad-99e8-f44c2b4be235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:38.436426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1027/2068] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:38.455063 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089946cb-24c2-4078-8d09-7d4743974377 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:38.463116 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-089946cb-24c2-4078-8d09-7d4743974377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:38.523933 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:38.594202 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089946cb-24c2-4078-8d09-7d4743974377 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:38.599069 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fb954-b874-456d-ae50-d08284c98628 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:38.600120 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fb954-b874-456d-ae50-d08284c98628 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:38.600612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fb954-b874-456d-ae50-d08284c98628 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:38.601813 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fb954-b874-456d-ae50-d08284c98628 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:38.614465 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fb954-b874-456d-ae50-d08284c98628 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:38.616916 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fb954-b874-456d-ae50-d08284c98628 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:38.633784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1042/2069] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:55:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:55:39.398339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c3c6a-345e-42df-84bd-35e3c0d66384 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:39.398952 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c3c6a-345e-42df-84bd-35e3c0d66384 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:39.398952 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c3c6a-345e-42df-84bd-35e3c0d66384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:39.432255 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-a72c3c6a-345e-42df-84bd-35e3c0d66384 None None] MFA Rules not processed for user `835f2f01fe294f1b9a415b2da88b47f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:39.433513 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a72c3c6a-345e-42df-84bd-35e3c0d66384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:39.533406 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1028/2070] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:39 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:55:39.707445 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54b00b-866b-4162-8c04-473387a6df77 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:39.707981 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54b00b-866b-4162-8c04-473387a6df77 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:39.708156 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54b00b-866b-4162-8c04-473387a6df77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:39.726705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-cd54b00b-866b-4162-8c04-473387a6df77 None None] MFA Rules not processed for user `2decc2b4793f4b2297d6da0b32eb512e`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:39.728015 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-cd54b00b-866b-4162-8c04-473387a6df77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:39.805149 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1043/2071] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:40.422234 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5340b-5143-4045-b4b7-ff7c0f9015f8 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:40.423080 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5340b-5143-4045-b4b7-ff7c0f9015f8 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:40.423379 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5340b-5143-4045-b4b7-ff7c0f9015f8 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:40.424873 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1029/2072] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jun 21 05:55:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:55:40.432952 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37979281-cf1e-4734-8bef-ae949219e284 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:40.434620 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37979281-cf1e-4734-8bef-ae949219e284 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:40.434921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37979281-cf1e-4734-8bef-ae949219e284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:40.459421 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-37979281-cf1e-4734-8bef-ae949219e284 None None] MFA Rules not processed for user `d17a40bea6ba41f19c88e16f9b15cf27`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:40.460761 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-37979281-cf1e-4734-8bef-ae949219e284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:40.560151 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1044/2073] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jun 21 05:55:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:40.588673 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5340b-5143-4045-b4b7-ff7c0f9015f8 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:40.595805 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f2b5340b-5143-4045-b4b7-ff7c0f9015f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:40.631642 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5340b-5143-4045-b4b7-ff7c0f9015f8 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:40.638632 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef6c23-a4b2-4be4-84c4-98f2b47dc6f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17a40bea6ba41f19c88e16f9b15cf27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:40.639297 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef6c23-a4b2-4be4-84c4-98f2b47dc6f8 service placement] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:40.639580 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef6c23-a4b2-4be4-84c4-98f2b47dc6f8 service placement] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:40.639858 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef6c23-a4b2-4be4-84c4-98f2b47dc6f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:40.657509 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef6c23-a4b2-4be4-84c4-98f2b47dc6f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:40.662733 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef6c23-a4b2-4be4-84c4-98f2b47dc6f8 service placement] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:40.686125 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1030/2074] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:55:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:55:41.283231 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37979281-cf1e-4734-8bef-ae949219e284 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:41.396187 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37979281-cf1e-4734-8bef-ae949219e284 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:41.400884 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797ee9a-b1f4-4839-9c1b-5cba2322cce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:41.402082 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797ee9a-b1f4-4839-9c1b-5cba2322cce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:41.402373 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797ee9a-b1f4-4839-9c1b-5cba2322cce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:41.402659 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797ee9a-b1f4-4839-9c1b-5cba2322cce5 admin admin] PATH_INFO: `/v3/users/39093b9aa5654eebac307901b7cfd0fd` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:41.404024 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797ee9a-b1f4-4839-9c1b-5cba2322cce5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39093b9aa5654eebac307901b7cfd0fd)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:41.406011 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797ee9a-b1f4-4839-9c1b-5cba2322cce5 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:41.409680 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:41.493377 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e797ee9a-b1f4-4839-9c1b-5cba2322cce5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39093b9aa5654eebac307901b7cfd0fd'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:41.503945 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e797ee9a-b1f4-4839-9c1b-5cba2322cce5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39093b9aa5654eebac307901b7cfd0fd'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:41.505103 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e797ee9a-b1f4-4839-9c1b-5cba2322cce5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39093b9aa5654eebac307901b7cfd0fd'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:41.515741 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e797ee9a-b1f4-4839-9c1b-5cba2322cce5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39093b9aa5654eebac307901b7cfd0fd'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:41.531004 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e797ee9a-b1f4-4839-9c1b-5cba2322cce5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39093b9aa5654eebac307901b7cfd0fd'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:41.541732 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1045/2075] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:55:41 2022] DELETE /identity/v3/users/39093b9aa5654eebac307901b7cfd0fd => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:41.755764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef6c23-a4b2-4be4-84c4-98f2b47dc6f8 service placement] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:41.768552 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef6c23-a4b2-4be4-84c4-98f2b47dc6f8 service placement] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:41.826690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:41.838502 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef80294-3fdb-4c3f-bb80-cb16ba411a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:41.840324 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef80294-3fdb-4c3f-bb80-cb16ba411a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:41.840697 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef80294-3fdb-4c3f-bb80-cb16ba411a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:41.841347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef80294-3fdb-4c3f-bb80-cb16ba411a8d admin admin] PATH_INFO: `/v3/projects/e5c7519667224bc9bb3b82721fbce228` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:41.843134 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef80294-3fdb-4c3f-bb80-cb16ba411a8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5c7519667224bc9bb3b82721fbce228)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:41.845996 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef80294-3fdb-4c3f-bb80-cb16ba411a8d admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:41.918841 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6ef80294-3fdb-4c3f-bb80-cb16ba411a8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5c7519667224bc9bb3b82721fbce228', 'request_id': 'req-6ef80294-3fdb-4c3f-bb80-cb16ba411a8d'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:41.935154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6ef80294-3fdb-4c3f-bb80-cb16ba411a8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5c7519667224bc9bb3b82721fbce228', 'request_id': 'req-6ef80294-3fdb-4c3f-bb80-cb16ba411a8d'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:41.948917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6ef80294-3fdb-4c3f-bb80-cb16ba411a8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5c7519667224bc9bb3b82721fbce228', 'request_id': 'req-6ef80294-3fdb-4c3f-bb80-cb16ba411a8d'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:41.971414 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6ef80294-3fdb-4c3f-bb80-cb16ba411a8d admin admin] The token cache is being invalidate because project e5c7519667224bc9bb3b82721fbce228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:55:41.972342 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6ef80294-3fdb-4c3f-bb80-cb16ba411a8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:41.973736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6ef80294-3fdb-4c3f-bb80-cb16ba411a8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:41.976368 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1031/2076] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:55:41 2022] DELETE /identity/v3/projects/e5c7519667224bc9bb3b82721fbce228 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:41.983171 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797ee9a-b1f4-4839-9c1b-5cba2322cce5 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:41.984832 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e797ee9a-b1f4-4839-9c1b-5cba2322cce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:42.010982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797ee9a-b1f4-4839-9c1b-5cba2322cce5 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:42.169704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2698362-30f1-42b4-85e4-69bac2bb0ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:42.170691 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2698362-30f1-42b4-85e4-69bac2bb0ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:42.170955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2698362-30f1-42b4-85e4-69bac2bb0ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:42.171230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2698362-30f1-42b4-85e4-69bac2bb0ecf admin admin] PATH_INFO: `/v3/users/835f2f01fe294f1b9a415b2da88b47f1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:42.172694 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2698362-30f1-42b4-85e4-69bac2bb0ecf admin admin] RBAC: Authorizing `identity:delete_user(user_id=835f2f01fe294f1b9a415b2da88b47f1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:42.174769 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2698362-30f1-42b4-85e4-69bac2bb0ecf admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:42.266816 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-d2698362-30f1-42b4-85e4-69bac2bb0ecf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '835f2f01fe294f1b9a415b2da88b47f1'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:42.278538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-d2698362-30f1-42b4-85e4-69bac2bb0ecf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '835f2f01fe294f1b9a415b2da88b47f1'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:42.280497 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-d2698362-30f1-42b4-85e4-69bac2bb0ecf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '835f2f01fe294f1b9a415b2da88b47f1'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:42.292912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-d2698362-30f1-42b4-85e4-69bac2bb0ecf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '835f2f01fe294f1b9a415b2da88b47f1'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:42.327933 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-d2698362-30f1-42b4-85e4-69bac2bb0ecf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '835f2f01fe294f1b9a415b2da88b47f1'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:42.333111 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:42.342153 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1046/2077] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:55:41 2022] DELETE /identity/v3/users/835f2f01fe294f1b9a415b2da88b47f1 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:42.595141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef80294-3fdb-4c3f-bb80-cb16ba411a8d admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:42.597715 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-6ef80294-3fdb-4c3f-bb80-cb16ba411a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:42.632549 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef80294-3fdb-4c3f-bb80-cb16ba411a8d admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:42.744714 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2570e2-db7e-4374-b101-8daa7577403f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:42.744714 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2570e2-db7e-4374-b101-8daa7577403f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:42.745173 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2570e2-db7e-4374-b101-8daa7577403f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:42.746331 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2570e2-db7e-4374-b101-8daa7577403f admin admin] PATH_INFO: `/v3/projects/fb97c1a44ac24713b6cb6e31ac8ca0ff` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:42.748334 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2570e2-db7e-4374-b101-8daa7577403f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb97c1a44ac24713b6cb6e31ac8ca0ff)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:42.752584 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2570e2-db7e-4374-b101-8daa7577403f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:42.830819 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4c2570e2-db7e-4374-b101-8daa7577403f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb97c1a44ac24713b6cb6e31ac8ca0ff', 'request_id': 'req-4c2570e2-db7e-4374-b101-8daa7577403f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:42.844187 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4c2570e2-db7e-4374-b101-8daa7577403f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb97c1a44ac24713b6cb6e31ac8ca0ff', 'request_id': 'req-4c2570e2-db7e-4374-b101-8daa7577403f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:42.857451 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4c2570e2-db7e-4374-b101-8daa7577403f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb97c1a44ac24713b6cb6e31ac8ca0ff', 'request_id': 'req-4c2570e2-db7e-4374-b101-8daa7577403f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:42.877367 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4c2570e2-db7e-4374-b101-8daa7577403f admin admin] The token cache is being invalidate because project fb97c1a44ac24713b6cb6e31ac8ca0ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:55:42.877897 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4c2570e2-db7e-4374-b101-8daa7577403f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:42.879011 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4c2570e2-db7e-4374-b101-8daa7577403f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:42.881288 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1032/2078] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:55:42 2022] DELETE /identity/v3/projects/fb97c1a44ac24713b6cb6e31ac8ca0ff => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:42.887013 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4acc68-a57a-4925-b1f2-84871893d8f5 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:42.887397 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4acc68-a57a-4925-b1f2-84871893d8f5 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:42.887726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4acc68-a57a-4925-b1f2-84871893d8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:42.918808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-6a4acc68-a57a-4925-b1f2-84871893d8f5 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:42.920226 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6a4acc68-a57a-4925-b1f2-84871893d8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:43.008077 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1047/2079] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:55:43.018101 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56697467-f561-47a2-a0bc-32f5a3e97ce1 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:43.019014 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56697467-f561-47a2-a0bc-32f5a3e97ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:43.019950 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56697467-f561-47a2-a0bc-32f5a3e97ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:43.064448 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-56697467-f561-47a2-a0bc-32f5a3e97ce1 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:43.066183 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-56697467-f561-47a2-a0bc-32f5a3e97ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:43.113329 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1033/2080] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:43.119359 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4acc68-a57a-4925-b1f2-84871893d8f5 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:43.140224 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4acc68-a57a-4925-b1f2-84871893d8f5 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:43.148386 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251e926-dfff-48d0-baf2-697ee595e571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:43.149586 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251e926-dfff-48d0-baf2-697ee595e571 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:43.150183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251e926-dfff-48d0-baf2-697ee595e571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:43.150630 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251e926-dfff-48d0-baf2-697ee595e571 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:43.152996 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f251e926-dfff-48d0-baf2-697ee595e571 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:55:43.153529 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f251e926-dfff-48d0-baf2-697ee595e571 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:43.158242 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f251e926-dfff-48d0-baf2-697ee595e571 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:43.179031 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1048/2081] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:55:43.185318 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56697467-f561-47a2-a0bc-32f5a3e97ce1 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:43.199212 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56697467-f561-47a2-a0bc-32f5a3e97ce1 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:43.205216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e9c92-0d31-4dcf-a54b-2098412e4e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:43.205908 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e9c92-0d31-4dcf-a54b-2098412e4e3e admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:43.206228 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e9c92-0d31-4dcf-a54b-2098412e4e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:43.206504 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e9c92-0d31-4dcf-a54b-2098412e4e3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:43.207222 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e9c92-0d31-4dcf-a54b-2098412e4e3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:43.209266 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e9c92-0d31-4dcf-a54b-2098412e4e3e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:43.213844 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:43.263939 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251e926-dfff-48d0-baf2-697ee595e571 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:43.265632 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1034/2082] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:55:43 2022] POST /identity/v3/projects => generated 369 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:43.278332 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251e926-dfff-48d0-baf2-697ee595e571 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:43.369295 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262fa91-fafd-4a70-b6d5-519377ba6be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:43.370223 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262fa91-fafd-4a70-b6d5-519377ba6be5 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:43.370343 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262fa91-fafd-4a70-b6d5-519377ba6be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:43.370597 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262fa91-fafd-4a70-b6d5-519377ba6be5 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:43.373874 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262fa91-fafd-4a70-b6d5-519377ba6be5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:43.375943 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262fa91-fafd-4a70-b6d5-519377ba6be5 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:43.402261 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1049/2083] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:55:43 2022] POST /identity/v3/users => generated 285 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 05:55:43.406985 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e9c92-0d31-4dcf-a54b-2098412e4e3e admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:43.423402 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e9c92-0d31-4dcf-a54b-2098412e4e3e admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:43.428596 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bf1cc-e4d4-476c-b47d-6e48880244b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:43.429889 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bf1cc-e4d4-476c-b47d-6e48880244b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:43.429889 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bf1cc-e4d4-476c-b47d-6e48880244b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:43.429889 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bf1cc-e4d4-476c-b47d-6e48880244b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:43.430756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28bf1cc-e4d4-476c-b47d-6e48880244b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:43.432414 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28bf1cc-e4d4-476c-b47d-6e48880244b1 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:43.445087 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1035/2084] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 05:55:43.450776 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262fa91-fafd-4a70-b6d5-519377ba6be5 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:43.464813 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262fa91-fafd-4a70-b6d5-519377ba6be5 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:43.474977 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb602cba-19c0-41e9-a45a-6c3f7ed08503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:43.476159 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb602cba-19c0-41e9-a45a-6c3f7ed08503 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:43.476433 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb602cba-19c0-41e9-a45a-6c3f7ed08503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:43.476669 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb602cba-19c0-41e9-a45a-6c3f7ed08503 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:43.478052 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb602cba-19c0-41e9-a45a-6c3f7ed08503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:43.480499 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb602cba-19c0-41e9-a45a-6c3f7ed08503 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:43.494631 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1050/2085] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 05:55:43.499760 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bf1cc-e4d4-476c-b47d-6e48880244b1 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:43.513977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bf1cc-e4d4-476c-b47d-6e48880244b1 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:43.518654 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeda956-f463-444f-97e7-2f5c13f324e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:43.519637 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeda956-f463-444f-97e7-2f5c13f324e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:43.520010 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeda956-f463-444f-97e7-2f5c13f324e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:43.520324 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeda956-f463-444f-97e7-2f5c13f324e6 admin admin] PATH_INFO: `/v3/projects/1a6bc860c6674adca88814e0b95d7c53/users/8d88b76d8eb242248379671098b2cdf7/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:43.538700 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeda956-f463-444f-97e7-2f5c13f324e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a6bc860c6674adca88814e0b95d7c53, user_id=8d88b76d8eb242248379671098b2cdf7, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:43.541476 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeda956-f463-444f-97e7-2f5c13f324e6 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:43.556271 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1036/2086] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:55:43 2022] PUT /identity/v3/projects/1a6bc860c6674adca88814e0b95d7c53/users/8d88b76d8eb242248379671098b2cdf7/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:43.569346 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b1fab-781a-4961-b611-f7d22dbe087c None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:43.569644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b1fab-781a-4961-b611-f7d22dbe087c None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:43.570064 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b1fab-781a-4961-b611-f7d22dbe087c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:43.615646 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-659b1fab-781a-4961-b611-f7d22dbe087c None None] MFA Rules not processed for user `8d88b76d8eb242248379671098b2cdf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:43.616924 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-659b1fab-781a-4961-b611-f7d22dbe087c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:43.706194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:43.719135 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1051/2087] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:43.725000 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeda956-f463-444f-97e7-2f5c13f324e6 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:43.848698 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeda956-f463-444f-97e7-2f5c13f324e6 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:43.855808 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fb8ea-29dd-4548-9978-09224dcfa459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:43.856601 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fb8ea-29dd-4548-9978-09224dcfa459 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:43.856971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fb8ea-29dd-4548-9978-09224dcfa459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:43.857839 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fb8ea-29dd-4548-9978-09224dcfa459 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:43.858752 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fb8ea-29dd-4548-9978-09224dcfa459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:43.862248 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fb8ea-29dd-4548-9978-09224dcfa459 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:43.926576 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1037/2088] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:55:43 2022] POST /identity/v3/projects => generated 369 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:43.930142 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b1fab-781a-4961-b611-f7d22dbe087c None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:43.942908 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b1fab-781a-4961-b611-f7d22dbe087c None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:44.043839 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599593a-76e8-46e4-aba7-92a54cdf9c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:44.045105 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599593a-76e8-46e4-aba7-92a54cdf9c73 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:44.045381 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599593a-76e8-46e4-aba7-92a54cdf9c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:44.046308 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599593a-76e8-46e4-aba7-92a54cdf9c73 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:44.049700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5599593a-76e8-46e4-aba7-92a54cdf9c73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:44.053014 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5599593a-76e8-46e4-aba7-92a54cdf9c73 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:44.122013 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1052/2089] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:55:43 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:44.126658 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fb8ea-29dd-4548-9978-09224dcfa459 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:44.147463 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fb8ea-29dd-4548-9978-09224dcfa459 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:44.160293 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de01ff-e93a-4c47-82db-42811169255a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:44.161487 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de01ff-e93a-4c47-82db-42811169255a admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:44.162016 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de01ff-e93a-4c47-82db-42811169255a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:44.162503 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de01ff-e93a-4c47-82db-42811169255a admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:44.163877 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de01ff-e93a-4c47-82db-42811169255a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:44.167434 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de01ff-e93a-4c47-82db-42811169255a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:44.202515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1038/2090] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:55:44.208684 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599593a-76e8-46e4-aba7-92a54cdf9c73 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:44.232454 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599593a-76e8-46e4-aba7-92a54cdf9c73 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:44.238586 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef98b77-4172-4239-9ad3-0cae1e33484f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:44.239684 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef98b77-4172-4239-9ad3-0cae1e33484f admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:44.240071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef98b77-4172-4239-9ad3-0cae1e33484f admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:44.240508 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef98b77-4172-4239-9ad3-0cae1e33484f admin admin] PATH_INFO: `/v3/projects/e3254afe18194f6f9bb832a22a0db0a8/users/bb7b8e9c4d844ceda3492ea90b92a260/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:44.264495 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef98b77-4172-4239-9ad3-0cae1e33484f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3254afe18194f6f9bb832a22a0db0a8, user_id=bb7b8e9c4d844ceda3492ea90b92a260, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:44.270245 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef98b77-4172-4239-9ad3-0cae1e33484f admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:44.291705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1053/2091] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:55:44 2022] PUT /identity/v3/projects/e3254afe18194f6f9bb832a22a0db0a8/users/bb7b8e9c4d844ceda3492ea90b92a260/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:44.296925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de01ff-e93a-4c47-82db-42811169255a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:44.315910 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de01ff-e93a-4c47-82db-42811169255a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:44.462787 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca5a10-0fe7-4708-8881-0b15d9d29986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:44.466270 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca5a10-0fe7-4708-8881-0b15d9d29986 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:44.466783 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca5a10-0fe7-4708-8881-0b15d9d29986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:44.467229 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca5a10-0fe7-4708-8881-0b15d9d29986 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:44.469053 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca5a10-0fe7-4708-8881-0b15d9d29986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:44.471980 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca5a10-0fe7-4708-8881-0b15d9d29986 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:44.494066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1039/2092] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:55:44.497563 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef98b77-4172-4239-9ad3-0cae1e33484f admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:44.513163 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef98b77-4172-4239-9ad3-0cae1e33484f admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:44.519191 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452cd004-f668-4276-b7b2-ec2edcf5fed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:44.520571 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cd004-f668-4276-b7b2-ec2edcf5fed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:44.521170 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cd004-f668-4276-b7b2-ec2edcf5fed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:44.521770 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cd004-f668-4276-b7b2-ec2edcf5fed3 admin admin] PATH_INFO: `/v3/projects/e3254afe18194f6f9bb832a22a0db0a8/users/bb7b8e9c4d844ceda3492ea90b92a260/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:44.524872 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452cd004-f668-4276-b7b2-ec2edcf5fed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3254afe18194f6f9bb832a22a0db0a8, user_id=bb7b8e9c4d844ceda3492ea90b92a260, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:44.531291 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452cd004-f668-4276-b7b2-ec2edcf5fed3 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:44.541924 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1054/2093] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:55:44 2022] PUT /identity/v3/projects/e3254afe18194f6f9bb832a22a0db0a8/users/bb7b8e9c4d844ceda3492ea90b92a260/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 05:55:44.561266 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7c02f-fbc3-4696-99ed-02ecfa45b965 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:44.562093 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7c02f-fbc3-4696-99ed-02ecfa45b965 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:44.562599 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7c02f-fbc3-4696-99ed-02ecfa45b965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:44.602596 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-c4e7c02f-fbc3-4696-99ed-02ecfa45b965 None None] MFA Rules not processed for user `bb7b8e9c4d844ceda3492ea90b92a260`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:44.604603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c4e7c02f-fbc3-4696-99ed-02ecfa45b965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:44.623768 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:44.723796 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1040/2094] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:44 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:55:44.741110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452cd004-f668-4276-b7b2-ec2edcf5fed3 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:44.743502 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-452cd004-f668-4276-b7b2-ec2edcf5fed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:44.897326 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452cd004-f668-4276-b7b2-ec2edcf5fed3 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:44.904371 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90824e89-a97b-46d2-a179-e6fc1421c88a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:44.905051 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90824e89-a97b-46d2-a179-e6fc1421c88a service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:44.905333 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90824e89-a97b-46d2-a179-e6fc1421c88a service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:44.905609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90824e89-a97b-46d2-a179-e6fc1421c88a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:44.917957 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90824e89-a97b-46d2-a179-e6fc1421c88a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:44.919643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90824e89-a97b-46d2-a179-e6fc1421c88a service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:44.936251 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1055/2095] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:55:44 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:55:46.913866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7c02f-fbc3-4696-99ed-02ecfa45b965 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:46.993023 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7c02f-fbc3-4696-99ed-02ecfa45b965 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:46.999273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd5878-2ae8-4996-8603-7b546bdf6157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:47.000449 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd5878-2ae8-4996-8603-7b546bdf6157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:47.000836 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd5878-2ae8-4996-8603-7b546bdf6157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:47.001299 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd5878-2ae8-4996-8603-7b546bdf6157 admin admin] PATH_INFO: `/v3/users/8d88b76d8eb242248379671098b2cdf7` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:47.002759 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd5878-2ae8-4996-8603-7b546bdf6157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d88b76d8eb242248379671098b2cdf7)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:47.005553 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd5878-2ae8-4996-8603-7b546bdf6157 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:47.086468 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-a8bd5878-2ae8-4996-8603-7b546bdf6157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d88b76d8eb242248379671098b2cdf7'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:47.101666 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-a8bd5878-2ae8-4996-8603-7b546bdf6157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d88b76d8eb242248379671098b2cdf7'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:47.102668 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-a8bd5878-2ae8-4996-8603-7b546bdf6157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d88b76d8eb242248379671098b2cdf7'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:47.103453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-a8bd5878-2ae8-4996-8603-7b546bdf6157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d88b76d8eb242248379671098b2cdf7'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:47.124169 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-a8bd5878-2ae8-4996-8603-7b546bdf6157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d88b76d8eb242248379671098b2cdf7'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:47.153714 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1041/2096] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:55:46 2022] DELETE /identity/v3/users/8d88b76d8eb242248379671098b2cdf7 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:47.160283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78c6e6-bc6d-42c7-a66b-a7c4c6d03aca None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:47.161051 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78c6e6-bc6d-42c7-a66b-a7c4c6d03aca None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:47.161051 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78c6e6-bc6d-42c7-a66b-a7c4c6d03aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:47.182243 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-ce78c6e6-bc6d-42c7-a66b-a7c4c6d03aca None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:47.184315 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ce78c6e6-bc6d-42c7-a66b-a7c4c6d03aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:47.241412 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:47.260290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1056/2097] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:55:47.274255 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd5878-2ae8-4996-8603-7b546bdf6157 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:47.283894 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a8bd5878-2ae8-4996-8603-7b546bdf6157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:47.322326 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:47.359878 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd5878-2ae8-4996-8603-7b546bdf6157 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:47.363841 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdcb97a-f072-4ff2-9033-e3b25cf73659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:47.364502 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcb97a-f072-4ff2-9033-e3b25cf73659 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:47.364797 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcb97a-f072-4ff2-9033-e3b25cf73659 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:47.365080 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcb97a-f072-4ff2-9033-e3b25cf73659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:47.376489 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdcb97a-f072-4ff2-9033-e3b25cf73659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:47.377996 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdcb97a-f072-4ff2-9033-e3b25cf73659 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:47.389078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1042/2098] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:55:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 05:55:47.756922 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78c6e6-bc6d-42c7-a66b-a7c4c6d03aca None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:47.759889 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ce78c6e6-bc6d-42c7-a66b-a7c4c6d03aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:47.784657 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78c6e6-bc6d-42c7-a66b-a7c4c6d03aca None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:47.796090 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711b47b-c2f8-4c31-853e-9cfcc2431fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:47.797611 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711b47b-c2f8-4c31-853e-9cfcc2431fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:47.798043 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711b47b-c2f8-4c31-853e-9cfcc2431fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:47.800049 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711b47b-c2f8-4c31-853e-9cfcc2431fd2 admin admin] PATH_INFO: `/v3/projects/1a6bc860c6674adca88814e0b95d7c53` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:47.804179 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b711b47b-c2f8-4c31-853e-9cfcc2431fd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a6bc860c6674adca88814e0b95d7c53)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:47.807690 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b711b47b-c2f8-4c31-853e-9cfcc2431fd2 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:47.895536 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b711b47b-c2f8-4c31-853e-9cfcc2431fd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a6bc860c6674adca88814e0b95d7c53', 'request_id': 'req-b711b47b-c2f8-4c31-853e-9cfcc2431fd2'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:47.905525 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b711b47b-c2f8-4c31-853e-9cfcc2431fd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a6bc860c6674adca88814e0b95d7c53', 'request_id': 'req-b711b47b-c2f8-4c31-853e-9cfcc2431fd2'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:47.914729 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b711b47b-c2f8-4c31-853e-9cfcc2431fd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a6bc860c6674adca88814e0b95d7c53', 'request_id': 'req-b711b47b-c2f8-4c31-853e-9cfcc2431fd2'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:47.938341 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b711b47b-c2f8-4c31-853e-9cfcc2431fd2 admin admin] The token cache is being invalidate because project 1a6bc860c6674adca88814e0b95d7c53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:55:47.938863 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b711b47b-c2f8-4c31-853e-9cfcc2431fd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:47.940126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b711b47b-c2f8-4c31-853e-9cfcc2431fd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:47.942872 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1057/2099] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:55:47 2022] DELETE /identity/v3/projects/1a6bc860c6674adca88814e0b95d7c53 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:47.947469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdcb97a-f072-4ff2-9033-e3b25cf73659 service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:47.959176 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdcb97a-f072-4ff2-9033-e3b25cf73659 service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:48.041870 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923635a6-5057-468c-a743-35e31e682308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:48.043613 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923635a6-5057-468c-a743-35e31e682308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:48.044160 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923635a6-5057-468c-a743-35e31e682308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:48.044668 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923635a6-5057-468c-a743-35e31e682308 admin admin] PATH_INFO: `/v3/users/bb7b8e9c4d844ceda3492ea90b92a260` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:48.047171 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923635a6-5057-468c-a743-35e31e682308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb7b8e9c4d844ceda3492ea90b92a260)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:48.051466 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923635a6-5057-468c-a743-35e31e682308 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:48.155862 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-923635a6-5057-468c-a743-35e31e682308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb7b8e9c4d844ceda3492ea90b92a260'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:48.166292 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-923635a6-5057-468c-a743-35e31e682308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb7b8e9c4d844ceda3492ea90b92a260'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:48.167114 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-923635a6-5057-468c-a743-35e31e682308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb7b8e9c4d844ceda3492ea90b92a260'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:48.167900 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-923635a6-5057-468c-a743-35e31e682308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb7b8e9c4d844ceda3492ea90b92a260'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:48.192810 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-923635a6-5057-468c-a743-35e31e682308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb7b8e9c4d844ceda3492ea90b92a260'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:48.223206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1043/2100] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:55:47 2022] DELETE /identity/v3/users/bb7b8e9c4d844ceda3492ea90b92a260 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 05:55:48.631606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711b47b-c2f8-4c31-853e-9cfcc2431fd2 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:48.633570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b711b47b-c2f8-4c31-853e-9cfcc2431fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:48.655962 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711b47b-c2f8-4c31-853e-9cfcc2431fd2 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:48.752428 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6bf59-0938-46c4-9bc7-a932c033a3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:48.753541 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6bf59-0938-46c4-9bc7-a932c033a3da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:48.754015 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6bf59-0938-46c4-9bc7-a932c033a3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:48.754401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6bf59-0938-46c4-9bc7-a932c033a3da admin admin] PATH_INFO: `/v3/projects/e3254afe18194f6f9bb832a22a0db0a8` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:48.755840 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f6bf59-0938-46c4-9bc7-a932c033a3da admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3254afe18194f6f9bb832a22a0db0a8)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:48.759264 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f6bf59-0938-46c4-9bc7-a932c033a3da admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:48.818887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-75f6bf59-0938-46c4-9bc7-a932c033a3da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3254afe18194f6f9bb832a22a0db0a8', 'request_id': 'req-75f6bf59-0938-46c4-9bc7-a932c033a3da'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:48.830074 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-75f6bf59-0938-46c4-9bc7-a932c033a3da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3254afe18194f6f9bb832a22a0db0a8', 'request_id': 'req-75f6bf59-0938-46c4-9bc7-a932c033a3da'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:48.837302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-75f6bf59-0938-46c4-9bc7-a932c033a3da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3254afe18194f6f9bb832a22a0db0a8', 'request_id': 'req-75f6bf59-0938-46c4-9bc7-a932c033a3da'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:48.852752 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-75f6bf59-0938-46c4-9bc7-a932c033a3da admin admin] The token cache is being invalidate because project e3254afe18194f6f9bb832a22a0db0a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:55:48.853084 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-75f6bf59-0938-46c4-9bc7-a932c033a3da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:48.853690 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-75f6bf59-0938-46c4-9bc7-a932c033a3da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:48.855847 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1058/2101] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:55:48 2022] DELETE /identity/v3/projects/e3254afe18194f6f9bb832a22a0db0a8 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:48.863111 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a819c-5e44-48fd-bff5-233d684281f5 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:48.864026 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a819c-5e44-48fd-bff5-233d684281f5 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:48.864654 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a819c-5e44-48fd-bff5-233d684281f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:48.893705 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-183a819c-5e44-48fd-bff5-233d684281f5 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:48.895513 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-183a819c-5e44-48fd-bff5-233d684281f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:48.964785 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:48.994367 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1044/2102] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:49.007156 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74fc8f-53bd-4b5c-bdaf-15026abcfffe None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:49.007661 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74fc8f-53bd-4b5c-bdaf-15026abcfffe None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:49.008119 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74fc8f-53bd-4b5c-bdaf-15026abcfffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:49.020678 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:49.051356 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-9e74fc8f-53bd-4b5c-bdaf-15026abcfffe None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:49.054201 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9e74fc8f-53bd-4b5c-bdaf-15026abcfffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:49.079055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1059/2103] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:49.082261 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a819c-5e44-48fd-bff5-233d684281f5 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:49.103350 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a819c-5e44-48fd-bff5-233d684281f5 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:49.117859 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b153f-231e-45fb-9e12-846d0e6d6df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:49.122034 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b153f-231e-45fb-9e12-846d0e6d6df8 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:49.122547 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b153f-231e-45fb-9e12-846d0e6d6df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:49.123158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b153f-231e-45fb-9e12-846d0e6d6df8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:49.124646 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b153f-231e-45fb-9e12-846d0e6d6df8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:55:49.127448 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b153f-231e-45fb-9e12-846d0e6d6df8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:49.130907 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b153f-231e-45fb-9e12-846d0e6d6df8 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:49.160423 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1045/2104] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:55:49.169538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74fc8f-53bd-4b5c-bdaf-15026abcfffe None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:49.190591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74fc8f-53bd-4b5c-bdaf-15026abcfffe None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:49.200025 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afaa4f8-8019-49ca-8c36-a09370c18ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:49.200725 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afaa4f8-8019-49ca-8c36-a09370c18ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:49.201017 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afaa4f8-8019-49ca-8c36-a09370c18ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:49.201303 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afaa4f8-8019-49ca-8c36-a09370c18ef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:49.202154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afaa4f8-8019-49ca-8c36-a09370c18ef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:49.204222 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afaa4f8-8019-49ca-8c36-a09370c18ef6 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:49.255250 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1060/2105] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:55:49 2022] POST /identity/v3/projects => generated 387 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:49.260820 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b153f-231e-45fb-9e12-846d0e6d6df8 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:49.275671 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b153f-231e-45fb-9e12-846d0e6d6df8 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:49.402711 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45eb3e3-04fd-465b-9f8c-4a559f5ee5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:49.403813 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45eb3e3-04fd-465b-9f8c-4a559f5ee5ed admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:49.404304 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45eb3e3-04fd-465b-9f8c-4a559f5ee5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:49.404787 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45eb3e3-04fd-465b-9f8c-4a559f5ee5ed admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:49.406062 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45eb3e3-04fd-465b-9f8c-4a559f5ee5ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:49.410209 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45eb3e3-04fd-465b-9f8c-4a559f5ee5ed admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:49.454012 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1046/2106] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:55:49 2022] POST /identity/v3/users => generated 294 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:49.456054 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afaa4f8-8019-49ca-8c36-a09370c18ef6 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:49.476488 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afaa4f8-8019-49ca-8c36-a09370c18ef6 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:49.485484 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1747dc-cc68-448c-bccd-9b54dad8f523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:49.486551 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1747dc-cc68-448c-bccd-9b54dad8f523 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:49.487290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1747dc-cc68-448c-bccd-9b54dad8f523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:49.487964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1747dc-cc68-448c-bccd-9b54dad8f523 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:49.489144 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1747dc-cc68-448c-bccd-9b54dad8f523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:49.491322 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1747dc-cc68-448c-bccd-9b54dad8f523 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:49.506230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1061/2107] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 05:55:49.510497 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45eb3e3-04fd-465b-9f8c-4a559f5ee5ed admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:49.522889 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45eb3e3-04fd-465b-9f8c-4a559f5ee5ed admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:49.529686 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b65057-506d-4f7c-9557-cebb49a2ab5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:49.529998 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b65057-506d-4f7c-9557-cebb49a2ab5c admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:49.530252 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b65057-506d-4f7c-9557-cebb49a2ab5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:49.530737 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b65057-506d-4f7c-9557-cebb49a2ab5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:49.531620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b65057-506d-4f7c-9557-cebb49a2ab5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:49.533457 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b65057-506d-4f7c-9557-cebb49a2ab5c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:49.545344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1047/2108] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:55:49.549729 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1747dc-cc68-448c-bccd-9b54dad8f523 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:49.564701 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1747dc-cc68-448c-bccd-9b54dad8f523 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:49.570138 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449d23e-1695-4b82-9b56-14d415670f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:49.571379 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449d23e-1695-4b82-9b56-14d415670f8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:49.571926 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449d23e-1695-4b82-9b56-14d415670f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:49.572302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449d23e-1695-4b82-9b56-14d415670f8f admin admin] PATH_INFO: `/v3/projects/143803ca57c1475694b421bf8351b4cd/users/fd405a443fa945c18410b777b48c3f4f/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:49.606871 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449d23e-1695-4b82-9b56-14d415670f8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=143803ca57c1475694b421bf8351b4cd, user_id=fd405a443fa945c18410b777b48c3f4f, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:49.610943 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449d23e-1695-4b82-9b56-14d415670f8f admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:49.641113 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1062/2109] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:55:49 2022] PUT /identity/v3/projects/143803ca57c1475694b421bf8351b4cd/users/fd405a443fa945c18410b777b48c3f4f/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:49.656175 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549dd126-f85f-49fc-aacb-b8260d0e136f None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:49.656609 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549dd126-f85f-49fc-aacb-b8260d0e136f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:49.656985 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549dd126-f85f-49fc-aacb-b8260d0e136f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:49.688696 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-549dd126-f85f-49fc-aacb-b8260d0e136f None None] MFA Rules not processed for user `fd405a443fa945c18410b777b48c3f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:49.690023 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-549dd126-f85f-49fc-aacb-b8260d0e136f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:49.774221 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1048/2110] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:49.780679 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449d23e-1695-4b82-9b56-14d415670f8f admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:49.896544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449d23e-1695-4b82-9b56-14d415670f8f admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:49.904802 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d19c2-1b10-47ad-ae28-a4fe81a46289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:49.905998 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d19c2-1b10-47ad-ae28-a4fe81a46289 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:49.906497 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d19c2-1b10-47ad-ae28-a4fe81a46289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:49.907004 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d19c2-1b10-47ad-ae28-a4fe81a46289 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:49.908305 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d19c2-1b10-47ad-ae28-a4fe81a46289 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:49.912133 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d19c2-1b10-47ad-ae28-a4fe81a46289 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:49.952539 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1063/2111] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:55:49 2022] POST /identity/v3/projects => generated 387 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:49.958357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549dd126-f85f-49fc-aacb-b8260d0e136f None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:49.969762 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549dd126-f85f-49fc-aacb-b8260d0e136f None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:50.028590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:50.047026 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08580613-8b8b-46e5-82fd-d913352192c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:50.047945 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08580613-8b8b-46e5-82fd-d913352192c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:50.048272 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08580613-8b8b-46e5-82fd-d913352192c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:50.048594 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08580613-8b8b-46e5-82fd-d913352192c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:50.049354 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08580613-8b8b-46e5-82fd-d913352192c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:50.051568 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08580613-8b8b-46e5-82fd-d913352192c6 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:50.075630 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1049/2112] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:55:49 2022] POST /identity/v3/users => generated 300 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:50.080440 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d19c2-1b10-47ad-ae28-a4fe81a46289 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:50.092626 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d19c2-1b10-47ad-ae28-a4fe81a46289 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:50.098142 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5477f53-6b45-419e-98d3-67ced437abcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:50.098840 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5477f53-6b45-419e-98d3-67ced437abcb admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:50.099137 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5477f53-6b45-419e-98d3-67ced437abcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:50.099418 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5477f53-6b45-419e-98d3-67ced437abcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:50.100168 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5477f53-6b45-419e-98d3-67ced437abcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:50.101823 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5477f53-6b45-419e-98d3-67ced437abcb admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:50.121628 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1064/2113] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 05:55:50.126467 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08580613-8b8b-46e5-82fd-d913352192c6 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:50.137127 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08580613-8b8b-46e5-82fd-d913352192c6 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:50.142045 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa1740-ac49-4adf-8ace-b8879c309d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:50.143071 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa1740-ac49-4adf-8ace-b8879c309d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:50.143409 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa1740-ac49-4adf-8ace-b8879c309d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:50.143729 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa1740-ac49-4adf-8ace-b8879c309d71 admin admin] PATH_INFO: `/v3/projects/74994277985c4a8a88a5e36580ec47f8/users/f1da86057e90478b8d5a9a0341e0cacc/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:50.161333 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa1740-ac49-4adf-8ace-b8879c309d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74994277985c4a8a88a5e36580ec47f8, user_id=f1da86057e90478b8d5a9a0341e0cacc, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:50.164231 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa1740-ac49-4adf-8ace-b8879c309d71 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:50.182968 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1050/2114] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:55:50 2022] PUT /identity/v3/projects/74994277985c4a8a88a5e36580ec47f8/users/f1da86057e90478b8d5a9a0341e0cacc/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:50.187178 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5477f53-6b45-419e-98d3-67ced437abcb admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:50.199195 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5477f53-6b45-419e-98d3-67ced437abcb admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:50.282476 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55fbb5-33fa-49cf-b1ec-e5b2ac65b844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:50.283584 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55fbb5-33fa-49cf-b1ec-e5b2ac65b844 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:50.284038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55fbb5-33fa-49cf-b1ec-e5b2ac65b844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:50.284542 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55fbb5-33fa-49cf-b1ec-e5b2ac65b844 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:50.286178 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55fbb5-33fa-49cf-b1ec-e5b2ac65b844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:50.288783 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55fbb5-33fa-49cf-b1ec-e5b2ac65b844 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:50.311344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1065/2115] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:55:50.312322 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa1740-ac49-4adf-8ace-b8879c309d71 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:50.326365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa1740-ac49-4adf-8ace-b8879c309d71 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:50.331196 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cc068-9e3a-4ecf-bff1-cbff06cd1682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:50.332098 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cc068-9e3a-4ecf-bff1-cbff06cd1682 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:50.332382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cc068-9e3a-4ecf-bff1-cbff06cd1682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:50.332657 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cc068-9e3a-4ecf-bff1-cbff06cd1682 admin admin] PATH_INFO: `/v3/projects/74994277985c4a8a88a5e36580ec47f8/users/f1da86057e90478b8d5a9a0341e0cacc/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:50.334750 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cc068-9e3a-4ecf-bff1-cbff06cd1682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74994277985c4a8a88a5e36580ec47f8, user_id=f1da86057e90478b8d5a9a0341e0cacc, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:50.339603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cc068-9e3a-4ecf-bff1-cbff06cd1682 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:50.357185 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1051/2116] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:55:50 2022] PUT /identity/v3/projects/74994277985c4a8a88a5e36580ec47f8/users/f1da86057e90478b8d5a9a0341e0cacc/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 05:55:50.369622 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdd789-a343-4665-8baa-ea66a83861cd None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:50.369914 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdd789-a343-4665-8baa-ea66a83861cd None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:50.370233 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdd789-a343-4665-8baa-ea66a83861cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:50.395024 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:50.410028 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-a7fdd789-a343-4665-8baa-ea66a83861cd None None] MFA Rules not processed for user `f1da86057e90478b8d5a9a0341e0cacc`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:50.412193 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a7fdd789-a343-4665-8baa-ea66a83861cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:50.505631 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1066/2117] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:50.529288 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cc068-9e3a-4ecf-bff1-cbff06cd1682 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:50.534410 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-2e3cc068-9e3a-4ecf-bff1-cbff06cd1682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:50.612550 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cc068-9e3a-4ecf-bff1-cbff06cd1682 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:50.616586 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16ac06-e164-411c-94f8-44f65ff1ff44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:50.617257 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16ac06-e164-411c-94f8-44f65ff1ff44 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:50.617548 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16ac06-e164-411c-94f8-44f65ff1ff44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:50.617824 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16ac06-e164-411c-94f8-44f65ff1ff44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:50.628808 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16ac06-e164-411c-94f8-44f65ff1ff44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:50.630357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16ac06-e164-411c-94f8-44f65ff1ff44 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:50.648038 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1052/2118] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:55:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 05:55:50.822272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fdd789-a343-4665-8baa-ea66a83861cd None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:50.916901 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fdd789-a343-4665-8baa-ea66a83861cd None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:50.924955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629b1a3-ab09-44f4-9daf-f74b2e8906c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:50.926038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629b1a3-ab09-44f4-9daf-f74b2e8906c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:50.926578 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629b1a3-ab09-44f4-9daf-f74b2e8906c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:50.927085 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629b1a3-ab09-44f4-9daf-f74b2e8906c3 admin admin] PATH_INFO: `/v3/users/fd405a443fa945c18410b777b48c3f4f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:50.929844 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629b1a3-ab09-44f4-9daf-f74b2e8906c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd405a443fa945c18410b777b48c3f4f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:50.934032 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629b1a3-ab09-44f4-9daf-f74b2e8906c3 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:51.011928 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-d629b1a3-ab09-44f4-9daf-f74b2e8906c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd405a443fa945c18410b777b48c3f4f'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:51.026154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-d629b1a3-ab09-44f4-9daf-f74b2e8906c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd405a443fa945c18410b777b48c3f4f'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:51.027443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-d629b1a3-ab09-44f4-9daf-f74b2e8906c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd405a443fa945c18410b777b48c3f4f'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:51.046874 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-d629b1a3-ab09-44f4-9daf-f74b2e8906c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd405a443fa945c18410b777b48c3f4f'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:51.068570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-d629b1a3-ab09-44f4-9daf-f74b2e8906c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd405a443fa945c18410b777b48c3f4f'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:51.075976 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1067/2119] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:55:50 2022] DELETE /identity/v3/users/fd405a443fa945c18410b777b48c3f4f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:51.082708 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5ad64-048d-4fed-9d9f-32e8a943dbf4 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:51.083508 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5ad64-048d-4fed-9d9f-32e8a943dbf4 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:51.083983 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5ad64-048d-4fed-9d9f-32e8a943dbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:51.110129 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-55d5ad64-048d-4fed-9d9f-32e8a943dbf4 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:51.112217 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-55d5ad64-048d-4fed-9d9f-32e8a943dbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:51.205072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1053/2120] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:55:51.217166 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629b1a3-ab09-44f4-9daf-f74b2e8906c3 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:51.218969 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d629b1a3-ab09-44f4-9daf-f74b2e8906c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:51.240125 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:51.301302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629b1a3-ab09-44f4-9daf-f74b2e8906c3 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:51.307654 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6a4b2-d6f1-437b-93c3-da50de8485f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:51.308360 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6a4b2-d6f1-437b-93c3-da50de8485f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:51.308648 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6a4b2-d6f1-437b-93c3-da50de8485f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:51.308928 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6a4b2-d6f1-437b-93c3-da50de8485f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:51.319969 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6a4b2-d6f1-437b-93c3-da50de8485f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:51.323051 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6a4b2-d6f1-437b-93c3-da50de8485f1 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:51.343871 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1068/2121] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:55:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:55:51.758859 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5ad64-048d-4fed-9d9f-32e8a943dbf4 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:51.761370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-55d5ad64-048d-4fed-9d9f-32e8a943dbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:51.775527 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5ad64-048d-4fed-9d9f-32e8a943dbf4 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:51.781610 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72c847-c3f1-4269-9062-d5fa88157086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:51.782516 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72c847-c3f1-4269-9062-d5fa88157086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:51.782805 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72c847-c3f1-4269-9062-d5fa88157086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:51.783115 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72c847-c3f1-4269-9062-d5fa88157086 admin admin] PATH_INFO: `/v3/projects/143803ca57c1475694b421bf8351b4cd` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:51.784323 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72c847-c3f1-4269-9062-d5fa88157086 admin admin] RBAC: Authorizing `identity:delete_project(project_id=143803ca57c1475694b421bf8351b4cd)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:51.786314 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72c847-c3f1-4269-9062-d5fa88157086 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:51.828119 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:51.842501 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1d72c847-c3f1-4269-9062-d5fa88157086 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '143803ca57c1475694b421bf8351b4cd', 'request_id': 'req-1d72c847-c3f1-4269-9062-d5fa88157086'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:51.850269 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1d72c847-c3f1-4269-9062-d5fa88157086 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '143803ca57c1475694b421bf8351b4cd', 'request_id': 'req-1d72c847-c3f1-4269-9062-d5fa88157086'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:51.856869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1d72c847-c3f1-4269-9062-d5fa88157086 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '143803ca57c1475694b421bf8351b4cd', 'request_id': 'req-1d72c847-c3f1-4269-9062-d5fa88157086'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:51.870617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1d72c847-c3f1-4269-9062-d5fa88157086 admin admin] The token cache is being invalidate because project 143803ca57c1475694b421bf8351b4cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:55:51.871061 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1d72c847-c3f1-4269-9062-d5fa88157086 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:51.872233 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1d72c847-c3f1-4269-9062-d5fa88157086 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:51.874474 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1054/2122] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:55:51 2022] DELETE /identity/v3/projects/143803ca57c1475694b421bf8351b4cd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 05:55:51.878206 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6a4b2-d6f1-437b-93c3-da50de8485f1 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:51.889480 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6a4b2-d6f1-437b-93c3-da50de8485f1 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:51.957053 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ccd28-6fd6-4695-906c-7f0226e59dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:51.957958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ccd28-6fd6-4695-906c-7f0226e59dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:51.958258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ccd28-6fd6-4695-906c-7f0226e59dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:51.958542 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ccd28-6fd6-4695-906c-7f0226e59dd8 admin admin] PATH_INFO: `/v3/users/f1da86057e90478b8d5a9a0341e0cacc` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:51.959777 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ccd28-6fd6-4695-906c-7f0226e59dd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1da86057e90478b8d5a9a0341e0cacc)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:51.961765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ccd28-6fd6-4695-906c-7f0226e59dd8 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:52.019577 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-156ccd28-6fd6-4695-906c-7f0226e59dd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1da86057e90478b8d5a9a0341e0cacc'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:52.029112 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-156ccd28-6fd6-4695-906c-7f0226e59dd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1da86057e90478b8d5a9a0341e0cacc'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:52.030126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-156ccd28-6fd6-4695-906c-7f0226e59dd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1da86057e90478b8d5a9a0341e0cacc'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:52.044149 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-156ccd28-6fd6-4695-906c-7f0226e59dd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1da86057e90478b8d5a9a0341e0cacc'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:52.058910 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-156ccd28-6fd6-4695-906c-7f0226e59dd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1da86057e90478b8d5a9a0341e0cacc'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:52.065647 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1069/2123] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:55:51 2022] DELETE /identity/v3/users/f1da86057e90478b8d5a9a0341e0cacc => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:52.414260 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72c847-c3f1-4269-9062-d5fa88157086 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:52.416088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1d72c847-c3f1-4269-9062-d5fa88157086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:52.432203 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72c847-c3f1-4269-9062-d5fa88157086 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:52.507907 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50449a28-0c04-4ab9-acf1-d4e5e3144cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:52.508800 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50449a28-0c04-4ab9-acf1-d4e5e3144cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:52.509081 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50449a28-0c04-4ab9-acf1-d4e5e3144cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:52.509359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50449a28-0c04-4ab9-acf1-d4e5e3144cb4 admin admin] PATH_INFO: `/v3/projects/74994277985c4a8a88a5e36580ec47f8` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:52.510743 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50449a28-0c04-4ab9-acf1-d4e5e3144cb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74994277985c4a8a88a5e36580ec47f8)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:52.512731 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50449a28-0c04-4ab9-acf1-d4e5e3144cb4 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:52.573011 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-50449a28-0c04-4ab9-acf1-d4e5e3144cb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74994277985c4a8a88a5e36580ec47f8', 'request_id': 'req-50449a28-0c04-4ab9-acf1-d4e5e3144cb4'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:52.583088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-50449a28-0c04-4ab9-acf1-d4e5e3144cb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74994277985c4a8a88a5e36580ec47f8', 'request_id': 'req-50449a28-0c04-4ab9-acf1-d4e5e3144cb4'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:52.591356 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-50449a28-0c04-4ab9-acf1-d4e5e3144cb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74994277985c4a8a88a5e36580ec47f8', 'request_id': 'req-50449a28-0c04-4ab9-acf1-d4e5e3144cb4'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:52.603672 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-50449a28-0c04-4ab9-acf1-d4e5e3144cb4 admin admin] The token cache is being invalidate because project 74994277985c4a8a88a5e36580ec47f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:55:52.603969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-50449a28-0c04-4ab9-acf1-d4e5e3144cb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:52.605471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-50449a28-0c04-4ab9-acf1-d4e5e3144cb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:55:52.607114 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1055/2124] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:55:52 2022] DELETE /identity/v3/projects/74994277985c4a8a88a5e36580ec47f8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:52.612185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b372991-33cd-4052-83c6-56b563468446 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:52.612484 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b372991-33cd-4052-83c6-56b563468446 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:52.612773 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b372991-33cd-4052-83c6-56b563468446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:52.634606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-7b372991-33cd-4052-83c6-56b563468446 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:52.635870 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-7b372991-33cd-4052-83c6-56b563468446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:52.674591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:52.710630 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1070/2125] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:52.718063 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77538699-e929-4a1f-8437-61a945e97af1 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:52.718338 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77538699-e929-4a1f-8437-61a945e97af1 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:52.718604 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77538699-e929-4a1f-8437-61a945e97af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:52.738945 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-77538699-e929-4a1f-8437-61a945e97af1 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:52.743174 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-77538699-e929-4a1f-8437-61a945e97af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:52.759353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1056/2126] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:52.760881 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b372991-33cd-4052-83c6-56b563468446 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:52.771612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b372991-33cd-4052-83c6-56b563468446 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:52.780381 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84247c90-57e8-4601-bf7a-035815db240d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:52.781349 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84247c90-57e8-4601-bf7a-035815db240d admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:52.781811 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84247c90-57e8-4601-bf7a-035815db240d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:52.782094 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84247c90-57e8-4601-bf7a-035815db240d admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:52.783046 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84247c90-57e8-4601-bf7a-035815db240d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:55:52.783609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84247c90-57e8-4601-bf7a-035815db240d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:52.786608 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84247c90-57e8-4601-bf7a-035815db240d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:52.805140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1071/2127] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:55:52.811548 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77538699-e929-4a1f-8437-61a945e97af1 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:52.821177 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77538699-e929-4a1f-8437-61a945e97af1 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:52.830140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc38bca-5585-45b4-ac5f-6aa86136dbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:52.830140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc38bca-5585-45b4-ac5f-6aa86136dbd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:52.830140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc38bca-5585-45b4-ac5f-6aa86136dbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:52.830140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc38bca-5585-45b4-ac5f-6aa86136dbd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:52.830622 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc38bca-5585-45b4-ac5f-6aa86136dbd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:52.830622 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc38bca-5585-45b4-ac5f-6aa86136dbd8 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:52.858982 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1057/2128] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:55:52 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:52.863404 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84247c90-57e8-4601-bf7a-035815db240d admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:52.876942 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84247c90-57e8-4601-bf7a-035815db240d admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:52.939260 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0d8c8-f1ff-4aa4-904b-a2e06eb9588b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:52.939977 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0d8c8-f1ff-4aa4-904b-a2e06eb9588b admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:52.940190 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0d8c8-f1ff-4aa4-904b-a2e06eb9588b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:52.940505 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0d8c8-f1ff-4aa4-904b-a2e06eb9588b admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:52.941267 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0d8c8-f1ff-4aa4-904b-a2e06eb9588b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:52.943613 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0d8c8-f1ff-4aa4-904b-a2e06eb9588b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:52.965243 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1072/2129] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:55:52 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:55:52.969661 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc38bca-5585-45b4-ac5f-6aa86136dbd8 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:52.982679 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc38bca-5585-45b4-ac5f-6aa86136dbd8 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:52.987480 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2979f62-2871-447d-bb7a-f0136f5028e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:52.988153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2979f62-2871-447d-bb7a-f0136f5028e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:52.988445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2979f62-2871-447d-bb7a-f0136f5028e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:52.988729 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2979f62-2871-447d-bb7a-f0136f5028e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:52.989476 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2979f62-2871-447d-bb7a-f0136f5028e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:52.991160 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2979f62-2871-447d-bb7a-f0136f5028e8 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:53.002977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1058/2130] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:55:53.007072 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0d8c8-f1ff-4aa4-904b-a2e06eb9588b admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:53.017172 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0d8c8-f1ff-4aa4-904b-a2e06eb9588b admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:53.022770 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39ce8a-61b2-404c-86ca-3e2d5f8138cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:53.023432 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39ce8a-61b2-404c-86ca-3e2d5f8138cd admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:53.023720 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39ce8a-61b2-404c-86ca-3e2d5f8138cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:53.024009 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39ce8a-61b2-404c-86ca-3e2d5f8138cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:53.024857 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39ce8a-61b2-404c-86ca-3e2d5f8138cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:53.027181 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39ce8a-61b2-404c-86ca-3e2d5f8138cd admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:53.037250 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1073/2131] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 05:55:53.041767 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2979f62-2871-447d-bb7a-f0136f5028e8 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:53.054772 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2979f62-2871-447d-bb7a-f0136f5028e8 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:53.060443 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67678651-1a92-405c-a56e-f87d9fad59e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:53.061353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67678651-1a92-405c-a56e-f87d9fad59e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:53.061645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67678651-1a92-405c-a56e-f87d9fad59e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:53.061922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67678651-1a92-405c-a56e-f87d9fad59e4 admin admin] PATH_INFO: `/v3/projects/b2d88877d4d94ac6aed14a0a8085cf7b/users/63ccdf86f4c04d62a12da7b6407adbe6/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:53.070850 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:53.081105 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67678651-1a92-405c-a56e-f87d9fad59e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2d88877d4d94ac6aed14a0a8085cf7b, user_id=63ccdf86f4c04d62a12da7b6407adbe6, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:53.085664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67678651-1a92-405c-a56e-f87d9fad59e4 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:53.102152 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1059/2132] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:55:53 2022] PUT /identity/v3/projects/b2d88877d4d94ac6aed14a0a8085cf7b/users/63ccdf86f4c04d62a12da7b6407adbe6/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:55:53.113084 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b0848-7815-4896-a13c-8b373381d5e3 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:53.113385 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b0848-7815-4896-a13c-8b373381d5e3 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:53.113747 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b0848-7815-4896-a13c-8b373381d5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:53.141953 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-f05b0848-7815-4896-a13c-8b373381d5e3 None None] MFA Rules not processed for user `63ccdf86f4c04d62a12da7b6407adbe6`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:55:53.143320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f05b0848-7815-4896-a13c-8b373381d5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:53.211958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1074/2133] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:55:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:55:53.224492 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67678651-1a92-405c-a56e-f87d9fad59e4 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:55:53.226263 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-67678651-1a92-405c-a56e-f87d9fad59e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:55:53.293220 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67678651-1a92-405c-a56e-f87d9fad59e4 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:55:53.299173 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec1e04-77ca-4d79-a00b-45d5bc1222df service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44776834b134ae98fa28d4741cc4ec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:55:53.300282 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec1e04-77ca-4d79-a00b-45d5bc1222df service glance] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:55:53.300825 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec1e04-77ca-4d79-a00b-45d5bc1222df service glance] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:55:53.301302 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec1e04-77ca-4d79-a00b-45d5bc1222df service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:55:53.320328 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec1e04-77ca-4d79-a00b-45d5bc1222df service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:55:53.323595 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec1e04-77ca-4d79-a00b-45d5bc1222df service glance] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:55:53.340715 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1060/2134] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:55:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:56:03.209111 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=82,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:03.332529 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=31,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:15.356061 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b0848-7815-4896-a13c-8b373381d5e3 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:15.357856 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f05b0848-7815-4896-a13c-8b373381d5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:15.442761 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b0848-7815-4896-a13c-8b373381d5e3 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:15.451756 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257232c-a498-40c0-81e8-a4e499f79cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:15.453213 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257232c-a498-40c0-81e8-a4e499f79cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:15.453634 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257232c-a498-40c0-81e8-a4e499f79cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:15.454099 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257232c-a498-40c0-81e8-a4e499f79cf9 admin admin] PATH_INFO: `/v3/users/bfc71cb464194712959a2ee7f8b90c26` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:15.456511 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257232c-a498-40c0-81e8-a4e499f79cf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfc71cb464194712959a2ee7f8b90c26)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:15.470989 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257232c-a498-40c0-81e8-a4e499f79cf9 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:15.548868 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e257232c-a498-40c0-81e8-a4e499f79cf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfc71cb464194712959a2ee7f8b90c26'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:15.557049 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e257232c-a498-40c0-81e8-a4e499f79cf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfc71cb464194712959a2ee7f8b90c26'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:15.557913 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e257232c-a498-40c0-81e8-a4e499f79cf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfc71cb464194712959a2ee7f8b90c26'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:15.566906 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e257232c-a498-40c0-81e8-a4e499f79cf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfc71cb464194712959a2ee7f8b90c26'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:15.581384 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e257232c-a498-40c0-81e8-a4e499f79cf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfc71cb464194712959a2ee7f8b90c26'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:15.588961 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1075/2135] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:56:15 2022] DELETE /identity/v3/users/bfc71cb464194712959a2ee7f8b90c26 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:56:15.593792 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ba11b-23fa-4922-9e22-f648177dd58a None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:15.594493 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ba11b-23fa-4922-9e22-f648177dd58a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:15.594493 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ba11b-23fa-4922-9e22-f648177dd58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:15.612647 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-434ba11b-23fa-4922-9e22-f648177dd58a None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:15.613891 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-434ba11b-23fa-4922-9e22-f648177dd58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:15.676750 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1061/2136] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:56:15.687131 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257232c-a498-40c0-81e8-a4e499f79cf9 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:15.688530 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e257232c-a498-40c0-81e8-a4e499f79cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:15.749325 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257232c-a498-40c0-81e8-a4e499f79cf9 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:15.753059 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fd3cf-5e03-4fe1-8e03-23105b03f461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:15.753775 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fd3cf-5e03-4fe1-8e03-23105b03f461 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:15.754079 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fd3cf-5e03-4fe1-8e03-23105b03f461 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:15.754404 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fd3cf-5e03-4fe1-8e03-23105b03f461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:15.763897 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904fd3cf-5e03-4fe1-8e03-23105b03f461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:15.765341 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904fd3cf-5e03-4fe1-8e03-23105b03f461 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:15.775910 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1076/2137] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 05:56:16.110351 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ba11b-23fa-4922-9e22-f648177dd58a None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:16.114872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-434ba11b-23fa-4922-9e22-f648177dd58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:16.129527 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ba11b-23fa-4922-9e22-f648177dd58a None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:16.135711 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d95a23-f7ca-4e90-b260-35669293166a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:16.136579 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d95a23-f7ca-4e90-b260-35669293166a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:16.136858 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d95a23-f7ca-4e90-b260-35669293166a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:16.137133 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d95a23-f7ca-4e90-b260-35669293166a admin admin] PATH_INFO: `/v3/projects/f1baa49a5cf04fe6823735b87199e6f5` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:16.138396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d95a23-f7ca-4e90-b260-35669293166a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1baa49a5cf04fe6823735b87199e6f5)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:16.140315 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d95a23-f7ca-4e90-b260-35669293166a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:16.188739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-48d95a23-f7ca-4e90-b260-35669293166a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1baa49a5cf04fe6823735b87199e6f5', 'request_id': 'req-48d95a23-f7ca-4e90-b260-35669293166a'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:16.196147 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-48d95a23-f7ca-4e90-b260-35669293166a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1baa49a5cf04fe6823735b87199e6f5', 'request_id': 'req-48d95a23-f7ca-4e90-b260-35669293166a'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:16.203407 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-48d95a23-f7ca-4e90-b260-35669293166a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1baa49a5cf04fe6823735b87199e6f5', 'request_id': 'req-48d95a23-f7ca-4e90-b260-35669293166a'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:16.214538 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-48d95a23-f7ca-4e90-b260-35669293166a admin admin] The token cache is being invalidate because project f1baa49a5cf04fe6823735b87199e6f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:56:16.214823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-48d95a23-f7ca-4e90-b260-35669293166a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:16.215491 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-48d95a23-f7ca-4e90-b260-35669293166a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:16.217023 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1062/2138] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:56:16 2022] DELETE /identity/v3/projects/f1baa49a5cf04fe6823735b87199e6f5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:56:16.221855 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba07dd-a7b8-4c06-b471-f8b366defe32 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:16.222431 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba07dd-a7b8-4c06-b471-f8b366defe32 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:16.222736 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba07dd-a7b8-4c06-b471-f8b366defe32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:16.240619 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-2cba07dd-a7b8-4c06-b471-f8b366defe32 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:16.241829 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-2cba07dd-a7b8-4c06-b471-f8b366defe32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:16.260185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:16.304123 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1077/2139] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:56:16.312392 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a002e96-d6e0-4d73-b931-e708a0f48eb5 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:16.312684 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a002e96-d6e0-4d73-b931-e708a0f48eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:16.312969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a002e96-d6e0-4d73-b931-e708a0f48eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:16.331143 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-6a002e96-d6e0-4d73-b931-e708a0f48eb5 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:16.332350 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-6a002e96-d6e0-4d73-b931-e708a0f48eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:16.340347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1063/2140] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:56:16.344487 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba07dd-a7b8-4c06-b471-f8b366defe32 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:16.354862 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba07dd-a7b8-4c06-b471-f8b366defe32 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:16.359389 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6254c6c-f2db-4fc1-b474-425a4bd33dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:16.360042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6254c6c-f2db-4fc1-b474-425a4bd33dfb admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:16.360327 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6254c6c-f2db-4fc1-b474-425a4bd33dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:16.360608 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6254c6c-f2db-4fc1-b474-425a4bd33dfb admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:16.361326 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6254c6c-f2db-4fc1-b474-425a4bd33dfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:56:16.361635 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6254c6c-f2db-4fc1-b474-425a4bd33dfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:16.363268 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6254c6c-f2db-4fc1-b474-425a4bd33dfb admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:16.376196 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1078/2141] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:56:16.380500 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a002e96-d6e0-4d73-b931-e708a0f48eb5 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:16.389781 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a002e96-d6e0-4d73-b931-e708a0f48eb5 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:16.394535 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93555dc-4127-41e0-96e4-a5bb48d847f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:16.395178 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93555dc-4127-41e0-96e4-a5bb48d847f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:16.395458 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93555dc-4127-41e0-96e4-a5bb48d847f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:16.395731 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93555dc-4127-41e0-96e4-a5bb48d847f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:16.396461 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93555dc-4127-41e0-96e4-a5bb48d847f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:16.398393 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93555dc-4127-41e0-96e4-a5bb48d847f1 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:16.427109 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1064/2142] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:56:16 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:56:16.431144 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6254c6c-f2db-4fc1-b474-425a4bd33dfb admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:16.441778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6254c6c-f2db-4fc1-b474-425a4bd33dfb admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:16.500610 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aaf3c9-be61-481c-adae-2e044b0f591e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:16.501184 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aaf3c9-be61-481c-adae-2e044b0f591e admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:16.501496 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aaf3c9-be61-481c-adae-2e044b0f591e admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:16.501771 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aaf3c9-be61-481c-adae-2e044b0f591e admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:16.502517 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aaf3c9-be61-481c-adae-2e044b0f591e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:16.504435 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aaf3c9-be61-481c-adae-2e044b0f591e admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:16.530422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1079/2143] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:56:16 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:56:16.539073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93555dc-4127-41e0-96e4-a5bb48d847f1 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:16.547155 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93555dc-4127-41e0-96e4-a5bb48d847f1 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:16.551912 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e5ef8-a7a6-4c91-9c0f-a1532e64cc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:16.552590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e5ef8-a7a6-4c91-9c0f-a1532e64cc6b admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:16.552875 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e5ef8-a7a6-4c91-9c0f-a1532e64cc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:16.553152 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e5ef8-a7a6-4c91-9c0f-a1532e64cc6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:16.553897 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e5ef8-a7a6-4c91-9c0f-a1532e64cc6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:16.555914 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e5ef8-a7a6-4c91-9c0f-a1532e64cc6b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:16.567116 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1065/2144] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 05:56:16.571634 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aaf3c9-be61-481c-adae-2e044b0f591e admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:16.582435 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aaf3c9-be61-481c-adae-2e044b0f591e admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:16.587353 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419985e7-3bdd-461c-a4c6-a1f29f211fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:16.588831 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419985e7-3bdd-461c-a4c6-a1f29f211fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:16.589249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419985e7-3bdd-461c-a4c6-a1f29f211fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:16.589461 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419985e7-3bdd-461c-a4c6-a1f29f211fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:16.590258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419985e7-3bdd-461c-a4c6-a1f29f211fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:16.591861 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419985e7-3bdd-461c-a4c6-a1f29f211fc3 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:16.604530 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1080/2145] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:56:16.608573 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e5ef8-a7a6-4c91-9c0f-a1532e64cc6b admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:16.619596 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e5ef8-a7a6-4c91-9c0f-a1532e64cc6b admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:16.626105 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe5912-bcee-4d05-859d-3769bfaaddce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:16.627166 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe5912-bcee-4d05-859d-3769bfaaddce admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:16.627553 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe5912-bcee-4d05-859d-3769bfaaddce admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:16.627936 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe5912-bcee-4d05-859d-3769bfaaddce admin admin] PATH_INFO: `/v3/projects/88247de6a0dc4a1089749816533eabd2/users/81262a5bbc824136ba8d940442dfae66/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:16.643924 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe5912-bcee-4d05-859d-3769bfaaddce admin admin] RBAC: Authorizing `identity:create_grant(project_id=88247de6a0dc4a1089749816533eabd2, user_id=81262a5bbc824136ba8d940442dfae66, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:16.646723 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe5912-bcee-4d05-859d-3769bfaaddce admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:16.662342 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1066/2146] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:56:16 2022] PUT /identity/v3/projects/88247de6a0dc4a1089749816533eabd2/users/81262a5bbc824136ba8d940442dfae66/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:56:16.673392 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f20553-35b9-40e4-acfe-23105445bf2e None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:16.673784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f20553-35b9-40e4-acfe-23105445bf2e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:16.673994 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f20553-35b9-40e4-acfe-23105445bf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:16.700853 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-c6f20553-35b9-40e4-acfe-23105445bf2e None None] MFA Rules not processed for user `81262a5bbc824136ba8d940442dfae66`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:16.702268 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c6f20553-35b9-40e4-acfe-23105445bf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:16.765527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1081/2147] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:56:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:56:16.776698 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe5912-bcee-4d05-859d-3769bfaaddce admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:16.778411 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-93fe5912-bcee-4d05-859d-3769bfaaddce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:16.800376 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:16.835503 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe5912-bcee-4d05-859d-3769bfaaddce admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:16.839607 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7369cbc-e816-48e6-80c5-62da26288bf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:16.840240 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7369cbc-e816-48e6-80c5-62da26288bf7 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:16.840520 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7369cbc-e816-48e6-80c5-62da26288bf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:16.840795 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7369cbc-e816-48e6-80c5-62da26288bf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:16.849357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7369cbc-e816-48e6-80c5-62da26288bf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:16.850907 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7369cbc-e816-48e6-80c5-62da26288bf7 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:16.860547 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1067/2148] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:56:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:56:19.297996 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bff7a3-db07-4748-a499-a6c0e3952e80 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:19.297996 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bff7a3-db07-4748-a499-a6c0e3952e80 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:19.297996 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bff7a3-db07-4748-a499-a6c0e3952e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:19.309197 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d5f60-0092-4d25-a653-414d647d7bb5 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:19.309755 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d5f60-0092-4d25-a653-414d647d7bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:19.309842 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d5f60-0092-4d25-a653-414d647d7bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:19.319024 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-d4bff7a3-db07-4748-a499-a6c0e3952e80 None None] MFA Rules not processed for user `af8e0eb5ff8c40ae848929780d99e72d`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:19.320248 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d4bff7a3-db07-4748-a499-a6c0e3952e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:19.336178 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:19.341202 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-124d5f60-0092-4d25-a653-414d647d7bb5 None None] MFA Rules not processed for user `81262a5bbc824136ba8d940442dfae66`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:19.342547 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-124d5f60-0092-4d25-a653-414d647d7bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:19.354630 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1068/2149] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:56:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:56:19.409837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1082/2150] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jun 21 05:56:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:56:19.473251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d5f60-0092-4d25-a653-414d647d7bb5 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:19.475491 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-124d5f60-0092-4d25-a653-414d647d7bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:19.564105 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d5f60-0092-4d25-a653-414d647d7bb5 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:19.572933 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7bcd5-1b7e-4e56-9b0e-b01673b05108 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac485a336d8b4360bce4f495bd02dbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:19.574283 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7bcd5-1b7e-4e56-9b0e-b01673b05108 service swift] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:19.574856 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7bcd5-1b7e-4e56-9b0e-b01673b05108 service swift] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:19.575453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7bcd5-1b7e-4e56-9b0e-b01673b05108 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:19.594986 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7bcd5-1b7e-4e56-9b0e-b01673b05108 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:19.594986 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7bcd5-1b7e-4e56-9b0e-b01673b05108 service swift] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:19.613015 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1069/2151] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 21 05:56:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 05:56:25.176344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bff7a3-db07-4748-a499-a6c0e3952e80 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:25.179605 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d4bff7a3-db07-4748-a499-a6c0e3952e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:25.482134 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bff7a3-db07-4748-a499-a6c0e3952e80 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:25.487226 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416f4b6-7f99-4daf-87bf-648b88317bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:25.488120 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416f4b6-7f99-4daf-87bf-648b88317bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:25.488406 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416f4b6-7f99-4daf-87bf-648b88317bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:25.488711 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416f4b6-7f99-4daf-87bf-648b88317bb7 admin admin] PATH_INFO: `/v3/users/63ccdf86f4c04d62a12da7b6407adbe6` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:25.490443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416f4b6-7f99-4daf-87bf-648b88317bb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63ccdf86f4c04d62a12da7b6407adbe6)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:25.493967 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416f4b6-7f99-4daf-87bf-648b88317bb7 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:25.593042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-d416f4b6-7f99-4daf-87bf-648b88317bb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63ccdf86f4c04d62a12da7b6407adbe6'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:25.608792 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-d416f4b6-7f99-4daf-87bf-648b88317bb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63ccdf86f4c04d62a12da7b6407adbe6'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:25.610662 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-d416f4b6-7f99-4daf-87bf-648b88317bb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63ccdf86f4c04d62a12da7b6407adbe6'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:25.626715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-d416f4b6-7f99-4daf-87bf-648b88317bb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63ccdf86f4c04d62a12da7b6407adbe6'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:25.628887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:25.679775 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-d416f4b6-7f99-4daf-87bf-648b88317bb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63ccdf86f4c04d62a12da7b6407adbe6'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:25.706497 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1083/2152] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:56:25 2022] DELETE /identity/v3/users/63ccdf86f4c04d62a12da7b6407adbe6 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:56:25.711520 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14c278-a233-48ff-b741-172481948c1e None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:25.712857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14c278-a233-48ff-b741-172481948c1e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:25.712857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14c278-a233-48ff-b741-172481948c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:25.757863 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-9a14c278-a233-48ff-b741-172481948c1e None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:25.759546 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-9a14c278-a233-48ff-b741-172481948c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:25.838315 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1070/2153] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:56:25.848202 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416f4b6-7f99-4daf-87bf-648b88317bb7 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:25.851045 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d416f4b6-7f99-4daf-87bf-648b88317bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:26.074749 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416f4b6-7f99-4daf-87bf-648b88317bb7 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:26.081102 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46768d8e-9c4b-4f17-9f25-0bca1abab212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:26.082724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46768d8e-9c4b-4f17-9f25-0bca1abab212 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:26.083282 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46768d8e-9c4b-4f17-9f25-0bca1abab212 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:26.083816 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46768d8e-9c4b-4f17-9f25-0bca1abab212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:26.100398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46768d8e-9c4b-4f17-9f25-0bca1abab212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:26.102189 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46768d8e-9c4b-4f17-9f25-0bca1abab212 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:26.122704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1084/2154] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:56:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 05:56:27.239729 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14c278-a233-48ff-b741-172481948c1e None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:27.242731 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-9a14c278-a233-48ff-b741-172481948c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:27.293558 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14c278-a233-48ff-b741-172481948c1e None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:27.311358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00971b25-3227-4ba7-893c-0165ce9c0d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:27.312372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00971b25-3227-4ba7-893c-0165ce9c0d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:27.312546 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00971b25-3227-4ba7-893c-0165ce9c0d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:27.312833 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00971b25-3227-4ba7-893c-0165ce9c0d4a admin admin] PATH_INFO: `/v3/projects/b2d88877d4d94ac6aed14a0a8085cf7b` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:27.318782 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00971b25-3227-4ba7-893c-0165ce9c0d4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2d88877d4d94ac6aed14a0a8085cf7b)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:27.320952 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00971b25-3227-4ba7-893c-0165ce9c0d4a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:27.446959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:27.477604 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-00971b25-3227-4ba7-893c-0165ce9c0d4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2d88877d4d94ac6aed14a0a8085cf7b', 'request_id': 'req-00971b25-3227-4ba7-893c-0165ce9c0d4a'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:27.513300 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-00971b25-3227-4ba7-893c-0165ce9c0d4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2d88877d4d94ac6aed14a0a8085cf7b', 'request_id': 'req-00971b25-3227-4ba7-893c-0165ce9c0d4a'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:27.524052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-00971b25-3227-4ba7-893c-0165ce9c0d4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2d88877d4d94ac6aed14a0a8085cf7b', 'request_id': 'req-00971b25-3227-4ba7-893c-0165ce9c0d4a'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:27.588642 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-00971b25-3227-4ba7-893c-0165ce9c0d4a admin admin] The token cache is being invalidate because project b2d88877d4d94ac6aed14a0a8085cf7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:56:27.589199 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-00971b25-3227-4ba7-893c-0165ce9c0d4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:27.595843 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-00971b25-3227-4ba7-893c-0165ce9c0d4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:27.603835 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1071/2155] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:56:27 2022] DELETE /identity/v3/projects/b2d88877d4d94ac6aed14a0a8085cf7b => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:56:27.606702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277102d-4334-44b5-97ab-c75b819d1c78 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:27.607197 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277102d-4334-44b5-97ab-c75b819d1c78 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:27.607318 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277102d-4334-44b5-97ab-c75b819d1c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:27.690115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-c277102d-4334-44b5-97ab-c75b819d1c78 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:27.692586 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c277102d-4334-44b5-97ab-c75b819d1c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:27.905901 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1085/2156] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:56:27.914226 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c0973-6f9b-49d9-a450-e73f35bf471e None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:27.914846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c0973-6f9b-49d9-a450-e73f35bf471e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:27.915993 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c0973-6f9b-49d9-a450-e73f35bf471e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:27.953191 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-d56c0973-6f9b-49d9-a450-e73f35bf471e None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:27.956491 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d56c0973-6f9b-49d9-a450-e73f35bf471e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:27.988935 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277102d-4334-44b5-97ab-c75b819d1c78 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:27.999584 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1072/2157] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:56:28.002004 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277102d-4334-44b5-97ab-c75b819d1c78 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:28.007597 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0581a-ff0c-4de8-9856-b2fdd314d506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:28.008505 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0581a-ff0c-4de8-9856-b2fdd314d506 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:28.008830 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0581a-ff0c-4de8-9856-b2fdd314d506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:28.009114 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0581a-ff0c-4de8-9856-b2fdd314d506 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:28.009959 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0581a-ff0c-4de8-9856-b2fdd314d506 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:56:28.010329 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0581a-ff0c-4de8-9856-b2fdd314d506 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:28.012069 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0581a-ff0c-4de8-9856-b2fdd314d506 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:28.032405 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c0973-6f9b-49d9-a450-e73f35bf471e None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:28.037438 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1086/2158] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:56:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 05:56:28.042544 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c0973-6f9b-49d9-a450-e73f35bf471e None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:28.048811 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42e6c6-0339-4144-88a3-a5fa29ee9ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:28.049487 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42e6c6-0339-4144-88a3-a5fa29ee9ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:28.049776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42e6c6-0339-4144-88a3-a5fa29ee9ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:28.050159 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42e6c6-0339-4144-88a3-a5fa29ee9ea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:28.050871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42e6c6-0339-4144-88a3-a5fa29ee9ea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:28.052832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42e6c6-0339-4144-88a3-a5fa29ee9ea0 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:28.088946 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1073/2159] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:56:28 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:56:28.097793 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0581a-ff0c-4de8-9856-b2fdd314d506 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:28.125650 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0581a-ff0c-4de8-9856-b2fdd314d506 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:28.154105 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:28.206923 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d55599-eb92-408e-94a0-b94ff332000b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:28.207937 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d55599-eb92-408e-94a0-b94ff332000b admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:28.208430 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d55599-eb92-408e-94a0-b94ff332000b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:28.208876 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d55599-eb92-408e-94a0-b94ff332000b admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:28.209754 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d55599-eb92-408e-94a0-b94ff332000b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:28.213564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d55599-eb92-408e-94a0-b94ff332000b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:28.249234 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1087/2160] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:56:28 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:56:28.249778 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42e6c6-0339-4144-88a3-a5fa29ee9ea0 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:28.263647 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42e6c6-0339-4144-88a3-a5fa29ee9ea0 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:28.271161 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d225a-2721-421b-9bdc-6382dbd7c8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:28.271873 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d225a-2721-421b-9bdc-6382dbd7c8bf admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:28.272276 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d225a-2721-421b-9bdc-6382dbd7c8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:28.272444 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d225a-2721-421b-9bdc-6382dbd7c8bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:28.273384 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d225a-2721-421b-9bdc-6382dbd7c8bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:28.275425 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d225a-2721-421b-9bdc-6382dbd7c8bf admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:28.288557 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1074/2161] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 05:56:28.293588 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d55599-eb92-408e-94a0-b94ff332000b admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:28.305036 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d55599-eb92-408e-94a0-b94ff332000b admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:28.315280 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86c916-2f28-4020-9897-d802c82f3fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:28.316972 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86c916-2f28-4020-9897-d802c82f3fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:28.317505 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86c916-2f28-4020-9897-d802c82f3fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:28.321306 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86c916-2f28-4020-9897-d802c82f3fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:28.323533 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86c916-2f28-4020-9897-d802c82f3fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:28.326184 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86c916-2f28-4020-9897-d802c82f3fa3 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:28.344723 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1088/2162] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:56:28.349551 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d225a-2721-421b-9bdc-6382dbd7c8bf admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:28.361574 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d225a-2721-421b-9bdc-6382dbd7c8bf admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:28.367890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602165e-153d-4a98-ba51-61216dfa3f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:28.369447 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602165e-153d-4a98-ba51-61216dfa3f14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:28.369760 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602165e-153d-4a98-ba51-61216dfa3f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:28.370315 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602165e-153d-4a98-ba51-61216dfa3f14 admin admin] PATH_INFO: `/v3/projects/18f7d461eaae4497b9d19120cbfe30d3/users/e87b8f2935ce40a1b45a46eac8f4c406/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:28.394100 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602165e-153d-4a98-ba51-61216dfa3f14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18f7d461eaae4497b9d19120cbfe30d3, user_id=e87b8f2935ce40a1b45a46eac8f4c406, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:28.401271 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602165e-153d-4a98-ba51-61216dfa3f14 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:28.423743 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1075/2163] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:56:28 2022] PUT /identity/v3/projects/18f7d461eaae4497b9d19120cbfe30d3/users/e87b8f2935ce40a1b45a46eac8f4c406/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:56:28.439173 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba2c1d-5083-47e2-b9b1-7ffc21ac4359 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:28.439508 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba2c1d-5083-47e2-b9b1-7ffc21ac4359 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:28.440320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba2c1d-5083-47e2-b9b1-7ffc21ac4359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:28.517312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-53ba2c1d-5083-47e2-b9b1-7ffc21ac4359 None None] MFA Rules not processed for user `e87b8f2935ce40a1b45a46eac8f4c406`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:28.519117 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-53ba2c1d-5083-47e2-b9b1-7ffc21ac4359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:28.697180 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1089/2164] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:56:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:56:28.712752 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602165e-153d-4a98-ba51-61216dfa3f14 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:28.716403 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-4602165e-153d-4a98-ba51-61216dfa3f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:28.904868 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602165e-153d-4a98-ba51-61216dfa3f14 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:28.915013 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfc334-c072-4223-aaa4-39274739c308 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:28.915996 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfc334-c072-4223-aaa4-39274739c308 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:28.916409 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfc334-c072-4223-aaa4-39274739c308 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:28.917060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfc334-c072-4223-aaa4-39274739c308 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:28.928932 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfc334-c072-4223-aaa4-39274739c308 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:28.930859 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfc334-c072-4223-aaa4-39274739c308 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:28.965104 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1076/2165] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:56:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:56:29.033836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba2c1d-5083-47e2-b9b1-7ffc21ac4359 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:29.205399 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba2c1d-5083-47e2-b9b1-7ffc21ac4359 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:29.211210 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d5ec1-5fad-4e2d-bbd5-52835f8ea5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:29.213478 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d5ec1-5fad-4e2d-bbd5-52835f8ea5c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:29.213782 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d5ec1-5fad-4e2d-bbd5-52835f8ea5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:29.214195 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d5ec1-5fad-4e2d-bbd5-52835f8ea5c9 admin admin] PATH_INFO: `/v3/users/e87b8f2935ce40a1b45a46eac8f4c406` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:29.215706 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d5ec1-5fad-4e2d-bbd5-52835f8ea5c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e87b8f2935ce40a1b45a46eac8f4c406)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:29.217820 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d5ec1-5fad-4e2d-bbd5-52835f8ea5c9 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:29.289985 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:29.307258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-631d5ec1-5fad-4e2d-bbd5-52835f8ea5c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e87b8f2935ce40a1b45a46eac8f4c406'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:29.319230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-631d5ec1-5fad-4e2d-bbd5-52835f8ea5c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e87b8f2935ce40a1b45a46eac8f4c406'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:29.320138 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-631d5ec1-5fad-4e2d-bbd5-52835f8ea5c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e87b8f2935ce40a1b45a46eac8f4c406'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:29.365129 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-631d5ec1-5fad-4e2d-bbd5-52835f8ea5c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e87b8f2935ce40a1b45a46eac8f4c406'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:29.382237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-631d5ec1-5fad-4e2d-bbd5-52835f8ea5c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e87b8f2935ce40a1b45a46eac8f4c406'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:29.389724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1090/2166] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:56:29 2022] DELETE /identity/v3/users/e87b8f2935ce40a1b45a46eac8f4c406 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:56:29.394875 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bb50e-20b1-4c80-b825-252ee5a2b60d None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:29.395474 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bb50e-20b1-4c80-b825-252ee5a2b60d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:29.395960 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bb50e-20b1-4c80-b825-252ee5a2b60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:29.415256 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-f62bb50e-20b1-4c80-b825-252ee5a2b60d None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:29.417089 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f62bb50e-20b1-4c80-b825-252ee5a2b60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:29.501518 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1077/2167] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:56:29.512321 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d5ec1-5fad-4e2d-bbd5-52835f8ea5c9 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:29.514266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-631d5ec1-5fad-4e2d-bbd5-52835f8ea5c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:29.624632 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d5ec1-5fad-4e2d-bbd5-52835f8ea5c9 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:29.628820 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36654aed-e604-4b83-a012-b13844d14926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:29.629510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36654aed-e604-4b83-a012-b13844d14926 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:29.629805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36654aed-e604-4b83-a012-b13844d14926 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:29.630128 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36654aed-e604-4b83-a012-b13844d14926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:29.640940 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36654aed-e604-4b83-a012-b13844d14926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:29.642420 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36654aed-e604-4b83-a012-b13844d14926 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:29.653623 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1091/2168] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:56:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:56:30.404317 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bb50e-20b1-4c80-b825-252ee5a2b60d None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:30.408074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f62bb50e-20b1-4c80-b825-252ee5a2b60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:30.456227 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:30.474755 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bb50e-20b1-4c80-b825-252ee5a2b60d None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:30.486139 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc55c8-4968-4a62-a04b-7ae9099bec28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:30.488276 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc55c8-4968-4a62-a04b-7ae9099bec28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:30.488746 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc55c8-4968-4a62-a04b-7ae9099bec28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:30.489196 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc55c8-4968-4a62-a04b-7ae9099bec28 admin admin] PATH_INFO: `/v3/projects/18f7d461eaae4497b9d19120cbfe30d3` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:30.493206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc55c8-4968-4a62-a04b-7ae9099bec28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18f7d461eaae4497b9d19120cbfe30d3)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:30.495503 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc55c8-4968-4a62-a04b-7ae9099bec28 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:30.582742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-69dc55c8-4968-4a62-a04b-7ae9099bec28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18f7d461eaae4497b9d19120cbfe30d3', 'request_id': 'req-69dc55c8-4968-4a62-a04b-7ae9099bec28'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:30.597762 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-69dc55c8-4968-4a62-a04b-7ae9099bec28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18f7d461eaae4497b9d19120cbfe30d3', 'request_id': 'req-69dc55c8-4968-4a62-a04b-7ae9099bec28'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:30.606700 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-69dc55c8-4968-4a62-a04b-7ae9099bec28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18f7d461eaae4497b9d19120cbfe30d3', 'request_id': 'req-69dc55c8-4968-4a62-a04b-7ae9099bec28'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:30.625659 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-69dc55c8-4968-4a62-a04b-7ae9099bec28 admin admin] The token cache is being invalidate because project 18f7d461eaae4497b9d19120cbfe30d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:56:30.626416 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-69dc55c8-4968-4a62-a04b-7ae9099bec28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:30.630476 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-69dc55c8-4968-4a62-a04b-7ae9099bec28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:30.637997 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1078/2169] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:56:30 2022] DELETE /identity/v3/projects/18f7d461eaae4497b9d19120cbfe30d3 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:56:30.640214 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a7390-8788-4e40-b463-4a105870222e None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:30.640925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a7390-8788-4e40-b463-4a105870222e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:30.641147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a7390-8788-4e40-b463-4a105870222e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:30.679251 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-407a7390-8788-4e40-b463-4a105870222e None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:30.680991 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-407a7390-8788-4e40-b463-4a105870222e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:30.776078 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1092/2170] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:56:30.783656 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b76ff2-c19c-40b1-bba7-373b2f846cb8 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:30.784230 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b76ff2-c19c-40b1-bba7-373b2f846cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:30.784795 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b76ff2-c19c-40b1-bba7-373b2f846cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:30.808112 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-a4b76ff2-c19c-40b1-bba7-373b2f846cb8 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:30.809370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a4b76ff2-c19c-40b1-bba7-373b2f846cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:30.827231 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1079/2171] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:56:30.827359 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a7390-8788-4e40-b463-4a105870222e None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:30.840253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a7390-8788-4e40-b463-4a105870222e None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:30.845906 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44a45d-35c9-4201-992a-823b2ab8c1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:30.847143 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44a45d-35c9-4201-992a-823b2ab8c1cb admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:30.847922 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44a45d-35c9-4201-992a-823b2ab8c1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:30.848882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44a45d-35c9-4201-992a-823b2ab8c1cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:30.851196 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44a45d-35c9-4201-992a-823b2ab8c1cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:56:30.851922 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44a45d-35c9-4201-992a-823b2ab8c1cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:30.854094 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44a45d-35c9-4201-992a-823b2ab8c1cb admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:30.874012 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1093/2172] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:56:30.876159 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b76ff2-c19c-40b1-bba7-373b2f846cb8 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:30.890057 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b76ff2-c19c-40b1-bba7-373b2f846cb8 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:30.898986 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a2c45-10d4-48f4-bdf9-6e6eec72170b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:30.899628 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a2c45-10d4-48f4-bdf9-6e6eec72170b admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:30.899911 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a2c45-10d4-48f4-bdf9-6e6eec72170b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:30.900574 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a2c45-10d4-48f4-bdf9-6e6eec72170b admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:30.902677 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a2c45-10d4-48f4-bdf9-6e6eec72170b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:30.905833 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a2c45-10d4-48f4-bdf9-6e6eec72170b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:30.950778 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1080/2173] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:56:30 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:56:30.956431 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44a45d-35c9-4201-992a-823b2ab8c1cb admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:30.972686 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44a45d-35c9-4201-992a-823b2ab8c1cb admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:31.029743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:31.076807 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2942ce-2629-4ac6-9bf7-c108e720dcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:31.078925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2942ce-2629-4ac6-9bf7-c108e720dcb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:31.080486 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2942ce-2629-4ac6-9bf7-c108e720dcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:31.083305 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2942ce-2629-4ac6-9bf7-c108e720dcb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:31.084391 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2942ce-2629-4ac6-9bf7-c108e720dcb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:31.086561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2942ce-2629-4ac6-9bf7-c108e720dcb5 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:31.125994 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1094/2174] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:56:30 2022] POST /identity/v3/users => generated 287 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:56:31.129795 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a2c45-10d4-48f4-bdf9-6e6eec72170b admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:31.144757 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a2c45-10d4-48f4-bdf9-6e6eec72170b admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:31.150679 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b208a-47cc-4d33-9b0a-2b52eca4f760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:31.151939 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b208a-47cc-4d33-9b0a-2b52eca4f760 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:31.152224 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b208a-47cc-4d33-9b0a-2b52eca4f760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:31.152560 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b208a-47cc-4d33-9b0a-2b52eca4f760 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:31.153331 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b208a-47cc-4d33-9b0a-2b52eca4f760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:31.155147 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b208a-47cc-4d33-9b0a-2b52eca4f760 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:31.169652 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1081/2175] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:56:31.173796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2942ce-2629-4ac6-9bf7-c108e720dcb5 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:31.195166 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2942ce-2629-4ac6-9bf7-c108e720dcb5 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:31.202116 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e96f40-fcfc-44ca-bb0e-0435580dacbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:31.203198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e96f40-fcfc-44ca-bb0e-0435580dacbc admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:31.203704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e96f40-fcfc-44ca-bb0e-0435580dacbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:31.204192 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e96f40-fcfc-44ca-bb0e-0435580dacbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:31.219756 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e96f40-fcfc-44ca-bb0e-0435580dacbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:31.223836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e96f40-fcfc-44ca-bb0e-0435580dacbc admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:31.250362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1095/2176] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:56:31.255952 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b208a-47cc-4d33-9b0a-2b52eca4f760 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:31.285560 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b208a-47cc-4d33-9b0a-2b52eca4f760 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:31.293227 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4c273-0141-43a3-a9c7-20980673211e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:31.294609 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4c273-0141-43a3-a9c7-20980673211e admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:31.295006 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4c273-0141-43a3-a9c7-20980673211e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:31.295437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4c273-0141-43a3-a9c7-20980673211e admin admin] PATH_INFO: `/v3/projects/47b0d3dbb14f4fd981beef2c015869d1/users/99e74fdd66eb4c50abc19709ceef636f/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:31.315921 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4c273-0141-43a3-a9c7-20980673211e admin admin] RBAC: Authorizing `identity:create_grant(project_id=47b0d3dbb14f4fd981beef2c015869d1, user_id=99e74fdd66eb4c50abc19709ceef636f, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:31.319172 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4c273-0141-43a3-a9c7-20980673211e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:31.361143 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1082/2177] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:56:31 2022] PUT /identity/v3/projects/47b0d3dbb14f4fd981beef2c015869d1/users/99e74fdd66eb4c50abc19709ceef636f/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:56:31.382660 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc4032-edb6-4591-b981-f5e2c7282a9f None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:31.383682 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc4032-edb6-4591-b981-f5e2c7282a9f None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:31.384476 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc4032-edb6-4591-b981-f5e2c7282a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:31.458526 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-afcc4032-edb6-4591-b981-f5e2c7282a9f None None] MFA Rules not processed for user `99e74fdd66eb4c50abc19709ceef636f`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:31.460239 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-afcc4032-edb6-4591-b981-f5e2c7282a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:31.624827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1096/2178] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:56:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:56:31.635818 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4c273-0141-43a3-a9c7-20980673211e admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:31.639059 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-26f4c273-0141-43a3-a9c7-20980673211e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:31.768930 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4c273-0141-43a3-a9c7-20980673211e admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:31.773310 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebc3c8-63b8-41ee-8bb9-b6faf66c50ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:31.774280 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebc3c8-63b8-41ee-8bb9-b6faf66c50ec service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:31.774749 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebc3c8-63b8-41ee-8bb9-b6faf66c50ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:31.775191 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebc3c8-63b8-41ee-8bb9-b6faf66c50ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:31.787480 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebc3c8-63b8-41ee-8bb9-b6faf66c50ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:31.789239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebc3c8-63b8-41ee-8bb9-b6faf66c50ec service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:31.801259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1083/2179] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:56:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:56:32.374836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc4032-edb6-4591-b981-f5e2c7282a9f None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:32.377213 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-afcc4032-edb6-4591-b981-f5e2c7282a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:32.580684 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc4032-edb6-4591-b981-f5e2c7282a9f None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:32.586031 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb7e84-f087-40fc-a842-2fc1a2935939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:32.587516 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb7e84-f087-40fc-a842-2fc1a2935939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:32.587778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb7e84-f087-40fc-a842-2fc1a2935939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:32.588059 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb7e84-f087-40fc-a842-2fc1a2935939 admin admin] PATH_INFO: `/v3/users/22515ecf442c41b4a17db0e3750a580a` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:32.589335 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb7e84-f087-40fc-a842-2fc1a2935939 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22515ecf442c41b4a17db0e3750a580a)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:32.591387 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb7e84-f087-40fc-a842-2fc1a2935939 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:32.658367 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-adeb7e84-f087-40fc-a842-2fc1a2935939 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22515ecf442c41b4a17db0e3750a580a'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:32.660826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:32.668887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-adeb7e84-f087-40fc-a842-2fc1a2935939 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22515ecf442c41b4a17db0e3750a580a'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:32.670574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-adeb7e84-f087-40fc-a842-2fc1a2935939 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22515ecf442c41b4a17db0e3750a580a'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:32.685478 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-adeb7e84-f087-40fc-a842-2fc1a2935939 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22515ecf442c41b4a17db0e3750a580a'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:32.713666 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-adeb7e84-f087-40fc-a842-2fc1a2935939 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22515ecf442c41b4a17db0e3750a580a'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:32.730055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1097/2180] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:56:32 2022] DELETE /identity/v3/users/22515ecf442c41b4a17db0e3750a580a => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:56:32.748264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c984c7-14a8-482a-bdb7-f2f7cd4c35fd None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:32.751513 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c984c7-14a8-482a-bdb7-f2f7cd4c35fd None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:32.758217 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c984c7-14a8-482a-bdb7-f2f7cd4c35fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:32.818948 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-76c984c7-14a8-482a-bdb7-f2f7cd4c35fd None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:32.820668 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-76c984c7-14a8-482a-bdb7-f2f7cd4c35fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:32.847915 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:32.950446 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1084/2181] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:56:32.963548 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb7e84-f087-40fc-a842-2fc1a2935939 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:32.965757 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-adeb7e84-f087-40fc-a842-2fc1a2935939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:33.165784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb7e84-f087-40fc-a842-2fc1a2935939 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:33.176907 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6084bb-c329-48a3-ab25-8a40e12c5281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:33.177875 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6084bb-c329-48a3-ab25-8a40e12c5281 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:33.178474 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6084bb-c329-48a3-ab25-8a40e12c5281 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:33.179074 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6084bb-c329-48a3-ab25-8a40e12c5281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:33.204563 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6084bb-c329-48a3-ab25-8a40e12c5281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:33.206436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6084bb-c329-48a3-ab25-8a40e12c5281 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:33.251500 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1098/2182] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:56:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:56:33.966448 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c984c7-14a8-482a-bdb7-f2f7cd4c35fd None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:33.968174 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-76c984c7-14a8-482a-bdb7-f2f7cd4c35fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:33.984179 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c984c7-14a8-482a-bdb7-f2f7cd4c35fd None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:34.003794 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50caa3-254d-4845-a694-360a4d77fae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:34.006367 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50caa3-254d-4845-a694-360a4d77fae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:34.006890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50caa3-254d-4845-a694-360a4d77fae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:34.007616 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50caa3-254d-4845-a694-360a4d77fae0 admin admin] PATH_INFO: `/v3/projects/86139d6a7faf48cb821034f6af40e779` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:34.009706 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50caa3-254d-4845-a694-360a4d77fae0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86139d6a7faf48cb821034f6af40e779)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:34.013991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50caa3-254d-4845-a694-360a4d77fae0 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:34.202591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-ed50caa3-254d-4845-a694-360a4d77fae0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86139d6a7faf48cb821034f6af40e779', 'request_id': 'req-ed50caa3-254d-4845-a694-360a4d77fae0'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:34.225261 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-ed50caa3-254d-4845-a694-360a4d77fae0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86139d6a7faf48cb821034f6af40e779', 'request_id': 'req-ed50caa3-254d-4845-a694-360a4d77fae0'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:34.238036 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-ed50caa3-254d-4845-a694-360a4d77fae0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86139d6a7faf48cb821034f6af40e779', 'request_id': 'req-ed50caa3-254d-4845-a694-360a4d77fae0'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:34.288582 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-ed50caa3-254d-4845-a694-360a4d77fae0 admin admin] The token cache is being invalidate because project 86139d6a7faf48cb821034f6af40e779 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:56:34.288845 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-ed50caa3-254d-4845-a694-360a4d77fae0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:34.293077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-ed50caa3-254d-4845-a694-360a4d77fae0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:34.302656 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3ab54-0019-4881-8a08-88c1906300a9 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:34.303212 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3ab54-0019-4881-8a08-88c1906300a9 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:34.303468 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3ab54-0019-4881-8a08-88c1906300a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:34.306498 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1085/2183] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:56:33 2022] DELETE /identity/v3/projects/86139d6a7faf48cb821034f6af40e779 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:56:34.377171 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-efb3ab54-0019-4881-8a08-88c1906300a9 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:34.380936 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-efb3ab54-0019-4881-8a08-88c1906300a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:34.559186 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1099/2184] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:56:34.575425 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f7c20-762b-481e-9777-80db6ab126d3 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:34.576538 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f7c20-762b-481e-9777-80db6ab126d3 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:34.577025 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f7c20-762b-481e-9777-80db6ab126d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:34.628968 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-7f3f7c20-762b-481e-9777-80db6ab126d3 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:34.630389 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-7f3f7c20-762b-481e-9777-80db6ab126d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:34.650503 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1086/2185] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:56:34.655449 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3ab54-0019-4881-8a08-88c1906300a9 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:34.667256 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3ab54-0019-4881-8a08-88c1906300a9 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:34.674067 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d957438-40ff-4bb9-8799-ef20693382fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:34.675401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d957438-40ff-4bb9-8799-ef20693382fa admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:34.675854 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d957438-40ff-4bb9-8799-ef20693382fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:34.676218 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d957438-40ff-4bb9-8799-ef20693382fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:34.677188 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d957438-40ff-4bb9-8799-ef20693382fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:56:34.677643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d957438-40ff-4bb9-8799-ef20693382fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:34.679842 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d957438-40ff-4bb9-8799-ef20693382fa admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:34.701781 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1100/2186] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:56:34.706693 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f7c20-762b-481e-9777-80db6ab126d3 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:34.732287 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f7c20-762b-481e-9777-80db6ab126d3 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:34.742861 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a780e6-fb4e-44f1-9293-c0ddf75fdc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:34.743870 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a780e6-fb4e-44f1-9293-c0ddf75fdc9f admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:34.744308 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a780e6-fb4e-44f1-9293-c0ddf75fdc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:34.744855 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a780e6-fb4e-44f1-9293-c0ddf75fdc9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:34.745719 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a780e6-fb4e-44f1-9293-c0ddf75fdc9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:34.748115 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a780e6-fb4e-44f1-9293-c0ddf75fdc9f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:34.791838 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1087/2187] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:56:34 2022] POST /identity/v3/projects => generated 383 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:56:34.794271 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d957438-40ff-4bb9-8799-ef20693382fa admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:34.812024 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d957438-40ff-4bb9-8799-ef20693382fa admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:34.912190 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:34.939261 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de400d2c-c7a5-4bab-9dee-d6dfae8e6308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:34.942736 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de400d2c-c7a5-4bab-9dee-d6dfae8e6308 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:34.942736 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de400d2c-c7a5-4bab-9dee-d6dfae8e6308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:34.942736 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de400d2c-c7a5-4bab-9dee-d6dfae8e6308 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:34.942736 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de400d2c-c7a5-4bab-9dee-d6dfae8e6308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:34.943745 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de400d2c-c7a5-4bab-9dee-d6dfae8e6308 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:34.979348 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1101/2188] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:56:34 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:56:34.980104 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a780e6-fb4e-44f1-9293-c0ddf75fdc9f admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:34.992190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a780e6-fb4e-44f1-9293-c0ddf75fdc9f admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:35.000596 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee82e6-82af-4b09-99d1-5d51911d6423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:35.002373 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee82e6-82af-4b09-99d1-5d51911d6423 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:35.002981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee82e6-82af-4b09-99d1-5d51911d6423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:35.003642 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee82e6-82af-4b09-99d1-5d51911d6423 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:35.006026 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee82e6-82af-4b09-99d1-5d51911d6423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:35.010047 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee82e6-82af-4b09-99d1-5d51911d6423 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:35.037358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1088/2189] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:56:35.039789 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de400d2c-c7a5-4bab-9dee-d6dfae8e6308 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:35.059747 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de400d2c-c7a5-4bab-9dee-d6dfae8e6308 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:35.068686 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084749a-c9c2-4f5f-8abc-602f65b65a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:35.070261 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084749a-c9c2-4f5f-8abc-602f65b65a75 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:35.071539 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084749a-c9c2-4f5f-8abc-602f65b65a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:35.071938 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084749a-c9c2-4f5f-8abc-602f65b65a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:35.073001 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084749a-c9c2-4f5f-8abc-602f65b65a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:35.080486 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084749a-c9c2-4f5f-8abc-602f65b65a75 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:35.098998 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1102/2190] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:56:35.100411 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee82e6-82af-4b09-99d1-5d51911d6423 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:35.123596 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee82e6-82af-4b09-99d1-5d51911d6423 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:35.129350 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaff11-c611-4d2b-b1ec-8669a499f951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:35.130556 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaff11-c611-4d2b-b1ec-8669a499f951 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:35.130998 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaff11-c611-4d2b-b1ec-8669a499f951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:35.131734 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaff11-c611-4d2b-b1ec-8669a499f951 admin admin] PATH_INFO: `/v3/projects/a7e723a47d5246779d7835b9898429e1/users/fc4e3249c43c4e8292475684ce7fd36e/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:35.155782 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aaff11-c611-4d2b-b1ec-8669a499f951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7e723a47d5246779d7835b9898429e1, user_id=fc4e3249c43c4e8292475684ce7fd36e, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:35.158615 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aaff11-c611-4d2b-b1ec-8669a499f951 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:35.206574 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1089/2191] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:56:35 2022] PUT /identity/v3/projects/a7e723a47d5246779d7835b9898429e1/users/fc4e3249c43c4e8292475684ce7fd36e/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 05:56:35.212624 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdebf8-01b0-4dce-97fa-b9dd33c9a593 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:35.212914 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdebf8-01b0-4dce-97fa-b9dd33c9a593 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:35.213199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdebf8-01b0-4dce-97fa-b9dd33c9a593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:35.238681 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-c6fdebf8-01b0-4dce-97fa-b9dd33c9a593 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:35.240246 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c6fdebf8-01b0-4dce-97fa-b9dd33c9a593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:35.500969 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1103/2192] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:56:35.514302 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaff11-c611-4d2b-b1ec-8669a499f951 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:35.517552 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-41aaff11-c611-4d2b-b1ec-8669a499f951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:35.663648 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:35.686036 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaff11-c611-4d2b-b1ec-8669a499f951 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:35.699064 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6edcb0-756f-484c-9020-32acf90c7640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:35.700119 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6edcb0-756f-484c-9020-32acf90c7640 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:35.700265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6edcb0-756f-484c-9020-32acf90c7640 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:35.700648 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6edcb0-756f-484c-9020-32acf90c7640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:35.736680 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6edcb0-756f-484c-9020-32acf90c7640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:35.742020 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6edcb0-756f-484c-9020-32acf90c7640 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:35.769297 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1090/2193] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:56:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:56:37.088009 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860518b-b428-4851-bcc6-a37fedc0ca55 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:37.088508 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860518b-b428-4851-bcc6-a37fedc0ca55 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:37.088615 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860518b-b428-4851-bcc6-a37fedc0ca55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:37.152882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-b860518b-b428-4851-bcc6-a37fedc0ca55 None None] MFA Rules not processed for user `fc4e3249c43c4e8292475684ce7fd36e`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:37.154471 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b860518b-b428-4851-bcc6-a37fedc0ca55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:37.314945 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1104/2194] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:56:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:56:37.328876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6edcb0-756f-484c-9020-32acf90c7640 service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:37.330621 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-cc6edcb0-756f-484c-9020-32acf90c7640 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:37.558021 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6edcb0-756f-484c-9020-32acf90c7640 service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:37.582853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e74fc-fda3-41aa-9d68-54c45019b058 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:37.583858 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e74fc-fda3-41aa-9d68-54c45019b058 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:37.584217 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e74fc-fda3-41aa-9d68-54c45019b058 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:37.584570 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e74fc-fda3-41aa-9d68-54c45019b058 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:37.597621 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e74fc-fda3-41aa-9d68-54c45019b058 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:37.599276 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e74fc-fda3-41aa-9d68-54c45019b058 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:37.628592 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1091/2195] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:56:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 05:56:39.579865 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4baeacd-9a16-4f48-92d3-018f41d11e40 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:39.580750 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4baeacd-9a16-4f48-92d3-018f41d11e40 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:39.580750 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4baeacd-9a16-4f48-92d3-018f41d11e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:39.610910 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-d4baeacd-9a16-4f48-92d3-018f41d11e40 None None] MFA Rules not processed for user `fc4e3249c43c4e8292475684ce7fd36e`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:39.613056 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d4baeacd-9a16-4f48-92d3-018f41d11e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:39.650802 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1105/2196] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:56:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:56:39.871682 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b5e68-db35-40be-8f76-6e718aed0872 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:39.871682 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b5e68-db35-40be-8f76-6e718aed0872 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:39.871682 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b5e68-db35-40be-8f76-6e718aed0872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:39.959474 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-766b5e68-db35-40be-8f76-6e718aed0872 None None] MFA Rules not processed for user `f4cd1d7c5a4a4b658f7abf8e434cf716`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:39.963838 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-766b5e68-db35-40be-8f76-6e718aed0872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:40.051641 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1092/2197] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:56:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:56:46.474587 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4baeacd-9a16-4f48-92d3-018f41d11e40 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:46.477522 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d4baeacd-9a16-4f48-92d3-018f41d11e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:46.530569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4baeacd-9a16-4f48-92d3-018f41d11e40 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:46.552039 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b8c9a-03b0-4ab5-92f4-3f6e14e4627c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:46.556519 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b8c9a-03b0-4ab5-92f4-3f6e14e4627c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:46.557739 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b8c9a-03b0-4ab5-92f4-3f6e14e4627c admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:46.558063 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b8c9a-03b0-4ab5-92f4-3f6e14e4627c admin admin] PATH_INFO: `/v3/users/99e74fdd66eb4c50abc19709ceef636f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:46.563193 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b8c9a-03b0-4ab5-92f4-3f6e14e4627c admin admin] RBAC: Authorizing `identity:delete_user(user_id=99e74fdd66eb4c50abc19709ceef636f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:46.572923 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b8c9a-03b0-4ab5-92f4-3f6e14e4627c admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:46.800392 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:46.826022 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-177b8c9a-03b0-4ab5-92f4-3f6e14e4627c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99e74fdd66eb4c50abc19709ceef636f'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:46.868384 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-177b8c9a-03b0-4ab5-92f4-3f6e14e4627c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99e74fdd66eb4c50abc19709ceef636f'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:46.872162 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-177b8c9a-03b0-4ab5-92f4-3f6e14e4627c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99e74fdd66eb4c50abc19709ceef636f'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:46.909091 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-177b8c9a-03b0-4ab5-92f4-3f6e14e4627c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99e74fdd66eb4c50abc19709ceef636f'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:46.939335 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-177b8c9a-03b0-4ab5-92f4-3f6e14e4627c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99e74fdd66eb4c50abc19709ceef636f'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:46.951518 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1106/2198] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:56:46 2022] DELETE /identity/v3/users/99e74fdd66eb4c50abc19709ceef636f => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:56:46.960146 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0436da-9de9-45f0-b0f5-4ef7c35fd4ae None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:46.962141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0436da-9de9-45f0-b0f5-4ef7c35fd4ae None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:46.962880 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0436da-9de9-45f0-b0f5-4ef7c35fd4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:47.041500 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-ef0436da-9de9-45f0-b0f5-4ef7c35fd4ae None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:47.044486 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ef0436da-9de9-45f0-b0f5-4ef7c35fd4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:47.365799 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1093/2199] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:56:47.378174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b8c9a-03b0-4ab5-92f4-3f6e14e4627c admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:47.380558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-177b8c9a-03b0-4ab5-92f4-3f6e14e4627c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:47.542552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b8c9a-03b0-4ab5-92f4-3f6e14e4627c admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:47.550282 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6501d2-9bc4-4ad4-b114-abbf7d2ed592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:47.551281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6501d2-9bc4-4ad4-b114-abbf7d2ed592 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:47.551888 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6501d2-9bc4-4ad4-b114-abbf7d2ed592 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:47.552269 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6501d2-9bc4-4ad4-b114-abbf7d2ed592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:47.583410 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6501d2-9bc4-4ad4-b114-abbf7d2ed592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:47.585038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6501d2-9bc4-4ad4-b114-abbf7d2ed592 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:47.608734 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1107/2200] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:56:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:56:47.892233 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6a181-9a0b-413a-b7d5-5f161560cfc9 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:47.892568 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6a181-9a0b-413a-b7d5-5f161560cfc9 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:47.892802 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6a181-9a0b-413a-b7d5-5f161560cfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:47.927242 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-d1a6a181-9a0b-413a-b7d5-5f161560cfc9 None None] MFA Rules not processed for user `af8e0eb5ff8c40ae848929780d99e72d`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:47.929736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d1a6a181-9a0b-413a-b7d5-5f161560cfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:47.957280 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:48.022846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1094/2201] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jun 21 05:56:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:56:48.039472 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6501d2-9bc4-4ad4-b114-abbf7d2ed592 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:48.040998 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-8c6501d2-9bc4-4ad4-b114-abbf7d2ed592 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:48.230898 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6501d2-9bc4-4ad4-b114-abbf7d2ed592 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:48.243744 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d6a66-5a5e-4609-9c1d-95780fa9daac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac485a336d8b4360bce4f495bd02dbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:48.244396 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d6a66-5a5e-4609-9c1d-95780fa9daac service swift] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:48.245623 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d6a66-5a5e-4609-9c1d-95780fa9daac service swift] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:48.246019 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d6a66-5a5e-4609-9c1d-95780fa9daac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:48.275672 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d6a66-5a5e-4609-9c1d-95780fa9daac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:48.288222 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d6a66-5a5e-4609-9c1d-95780fa9daac service swift] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:48.306168 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1108/2202] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 21 05:56:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 05:56:48.361180 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8cf53-1a0a-4f18-9d2f-de9d91c88576 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:48.362284 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8cf53-1a0a-4f18-9d2f-de9d91c88576 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:48.362723 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8cf53-1a0a-4f18-9d2f-de9d91c88576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:48.418829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-88b8cf53-1a0a-4f18-9d2f-de9d91c88576 None None] MFA Rules not processed for user `af8e0eb5ff8c40ae848929780d99e72d`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:48.435057 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-88b8cf53-1a0a-4f18-9d2f-de9d91c88576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:48.477844 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1095/2203] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jun 21 05:56:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:56:48.552118 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d6a66-5a5e-4609-9c1d-95780fa9daac service swift] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:48.567924 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d6a66-5a5e-4609-9c1d-95780fa9daac service swift] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:48.591791 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7d0ac-8e1d-41b2-b655-5ffd7e0b349a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac485a336d8b4360bce4f495bd02dbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:48.592477 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7d0ac-8e1d-41b2-b655-5ffd7e0b349a service swift] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:48.592763 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7d0ac-8e1d-41b2-b655-5ffd7e0b349a service swift] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:48.593046 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7d0ac-8e1d-41b2-b655-5ffd7e0b349a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:48.624301 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7d0ac-8e1d-41b2-b655-5ffd7e0b349a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:48.626029 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7d0ac-8e1d-41b2-b655-5ffd7e0b349a service swift] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:48.666790 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1109/2204] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 21 05:56:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 05:56:48.982581 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8cf53-1a0a-4f18-9d2f-de9d91c88576 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:48.985780 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-88b8cf53-1a0a-4f18-9d2f-de9d91c88576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:49.017593 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b336d0-cb06-455d-a8a5-990f4db8800b None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:49.018373 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b336d0-cb06-455d-a8a5-990f4db8800b None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:49.018952 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b336d0-cb06-455d-a8a5-990f4db8800b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:49.054272 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8cf53-1a0a-4f18-9d2f-de9d91c88576 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:49.056219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-98b336d0-cb06-455d-a8a5-990f4db8800b None None] MFA Rules not processed for user `af8e0eb5ff8c40ae848929780d99e72d`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:49.059077 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-98b336d0-cb06-455d-a8a5-990f4db8800b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:49.086735 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d2015-9ca6-4f06-9385-0fb56ed324da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:49.090282 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d2015-9ca6-4f06-9385-0fb56ed324da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:49.092440 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d2015-9ca6-4f06-9385-0fb56ed324da admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:49.093079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d2015-9ca6-4f06-9385-0fb56ed324da admin admin] PATH_INFO: `/v3/projects/47b0d3dbb14f4fd981beef2c015869d1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:49.099254 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d2015-9ca6-4f06-9385-0fb56ed324da admin admin] RBAC: Authorizing `identity:delete_project(project_id=47b0d3dbb14f4fd981beef2c015869d1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:49.105377 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d2015-9ca6-4f06-9385-0fb56ed324da admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:49.121153 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1110/2205] 10.222.0.18 () {58 vars in 967 bytes} [Tue Jun 21 05:56:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:56:49.183135 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b336d0-cb06-455d-a8a5-990f4db8800b None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:49.208288 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b336d0-cb06-455d-a8a5-990f4db8800b None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:49.244650 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d27d2015-9ca6-4f06-9385-0fb56ed324da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47b0d3dbb14f4fd981beef2c015869d1', 'request_id': 'req-d27d2015-9ca6-4f06-9385-0fb56ed324da'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:49.266482 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d27d2015-9ca6-4f06-9385-0fb56ed324da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47b0d3dbb14f4fd981beef2c015869d1', 'request_id': 'req-d27d2015-9ca6-4f06-9385-0fb56ed324da'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:49.275625 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d27d2015-9ca6-4f06-9385-0fb56ed324da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47b0d3dbb14f4fd981beef2c015869d1', 'request_id': 'req-d27d2015-9ca6-4f06-9385-0fb56ed324da'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:49.299920 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:49.318988 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d27d2015-9ca6-4f06-9385-0fb56ed324da admin admin] The token cache is being invalidate because project 47b0d3dbb14f4fd981beef2c015869d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:56:49.319181 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d27d2015-9ca6-4f06-9385-0fb56ed324da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:49.323590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d27d2015-9ca6-4f06-9385-0fb56ed324da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:49.331133 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1096/2206] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:56:48 2022] DELETE /identity/v3/projects/47b0d3dbb14f4fd981beef2c015869d1 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:56:49.373719 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ecc4c-9973-475f-afbc-94c2fe569c1f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac485a336d8b4360bce4f495bd02dbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:49.374469 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ecc4c-9973-475f-afbc-94c2fe569c1f service swift] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:49.374755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ecc4c-9973-475f-afbc-94c2fe569c1f service swift] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:49.375143 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ecc4c-9973-475f-afbc-94c2fe569c1f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:49.377772 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-724ecc4c-9973-475f-afbc-94c2fe569c1f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:49.475949 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ecc4c-9973-475f-afbc-94c2fe569c1f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:49.478230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ecc4c-9973-475f-afbc-94c2fe569c1f service swift] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:49.490925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1111/2207] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 21 05:56:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 21 05:56:50.068977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08324ac5-386b-4217-b5c8-b8d71dd8cb7b None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:50.073124 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08324ac5-386b-4217-b5c8-b8d71dd8cb7b None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:50.073645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08324ac5-386b-4217-b5c8-b8d71dd8cb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:50.119083 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-08324ac5-386b-4217-b5c8-b8d71dd8cb7b None None] MFA Rules not processed for user `f2d23615fd6349e1b70fdbad64b89b78`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:50.120652 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-08324ac5-386b-4217-b5c8-b8d71dd8cb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:50.282910 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1097/2208] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:56:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:56:51.954391 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8451477-4b2c-407e-9280-ee23b360ef4d None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:51.958628 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8451477-4b2c-407e-9280-ee23b360ef4d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:51.959262 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8451477-4b2c-407e-9280-ee23b360ef4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:51.995031 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-c8451477-4b2c-407e-9280-ee23b360ef4d None None] MFA Rules not processed for user `af8e0eb5ff8c40ae848929780d99e72d`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:51.996684 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c8451477-4b2c-407e-9280-ee23b360ef4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:52.012726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1112/2209] 10.222.0.18 () {58 vars in 967 bytes} [Tue Jun 21 05:56:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:56:52.072524 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08324ac5-386b-4217-b5c8-b8d71dd8cb7b None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:52.075124 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-08324ac5-386b-4217-b5c8-b8d71dd8cb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:52.097479 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08324ac5-386b-4217-b5c8-b8d71dd8cb7b None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:52.112010 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63836dc8-fbe2-42e1-b456-f6f3bcad175d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac485a336d8b4360bce4f495bd02dbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:52.112926 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63836dc8-fbe2-42e1-b456-f6f3bcad175d service swift] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:52.113372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63836dc8-fbe2-42e1-b456-f6f3bcad175d service swift] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:52.113818 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63836dc8-fbe2-42e1-b456-f6f3bcad175d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:52.131211 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63836dc8-fbe2-42e1-b456-f6f3bcad175d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:52.133516 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63836dc8-fbe2-42e1-b456-f6f3bcad175d service swift] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:52.152224 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1098/2210] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 21 05:56:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 05:56:52.535971 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b3e8d-24e0-4ef4-81cc-2397ffc1d117 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:52.536865 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b3e8d-24e0-4ef4-81cc-2397ffc1d117 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:52.537591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b3e8d-24e0-4ef4-81cc-2397ffc1d117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:52.611740 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-628b3e8d-24e0-4ef4-81cc-2397ffc1d117 None None] MFA Rules not processed for user `af8e0eb5ff8c40ae848929780d99e72d`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:52.613887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-628b3e8d-24e0-4ef4-81cc-2397ffc1d117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:52.647477 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1113/2211] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jun 21 05:56:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:56:52.675947 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63836dc8-fbe2-42e1-b456-f6f3bcad175d service swift] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:52.698624 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63836dc8-fbe2-42e1-b456-f6f3bcad175d service swift] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:52.708385 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a7d0a-8577-4e74-9afd-a94ae41721a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac485a336d8b4360bce4f495bd02dbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:52.709398 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a7d0a-8577-4e74-9afd-a94ae41721a4 service swift] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:52.709828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a7d0a-8577-4e74-9afd-a94ae41721a4 service swift] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:52.710297 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a7d0a-8577-4e74-9afd-a94ae41721a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:52.743106 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a7d0a-8577-4e74-9afd-a94ae41721a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:52.746744 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a7d0a-8577-4e74-9afd-a94ae41721a4 service swift] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:52.816878 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1099/2212] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 21 05:56:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 05:56:53.731390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db369af0-9ae5-4bac-a1f3-387302733c94 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:53.732405 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db369af0-9ae5-4bac-a1f3-387302733c94 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:53.732911 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db369af0-9ae5-4bac-a1f3-387302733c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:53.786608 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-db369af0-9ae5-4bac-a1f3-387302733c94 None None] MFA Rules not processed for user `af8e0eb5ff8c40ae848929780d99e72d`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:53.789458 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-db369af0-9ae5-4bac-a1f3-387302733c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:53.812583 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1114/2213] 10.222.0.18 () {58 vars in 967 bytes} [Tue Jun 21 05:56:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:56:53.837388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a7d0a-8577-4e74-9afd-a94ae41721a4 service swift] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:53.854854 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a7d0a-8577-4e74-9afd-a94ae41721a4 service swift] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:53.886178 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69f0ac-8e41-4a48-8698-8c52e1bbf941 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac485a336d8b4360bce4f495bd02dbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:53.887301 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69f0ac-8e41-4a48-8698-8c52e1bbf941 service swift] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:53.890493 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69f0ac-8e41-4a48-8698-8c52e1bbf941 service swift] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:53.891295 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69f0ac-8e41-4a48-8698-8c52e1bbf941 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:53.917143 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69f0ac-8e41-4a48-8698-8c52e1bbf941 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:53.923429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69f0ac-8e41-4a48-8698-8c52e1bbf941 service swift] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:53.951985 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1100/2214] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 21 05:56:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 05:56:54.308866 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db369af0-9ae5-4bac-a1f3-387302733c94 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:54.323051 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-db369af0-9ae5-4bac-a1f3-387302733c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:54.543542 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db369af0-9ae5-4bac-a1f3-387302733c94 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:54.560314 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d9afc-f89b-4206-82b9-9d862c06a5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:54.561829 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d9afc-f89b-4206-82b9-9d862c06a5be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:54.562302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d9afc-f89b-4206-82b9-9d862c06a5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:54.562764 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d9afc-f89b-4206-82b9-9d862c06a5be admin admin] PATH_INFO: `/v3/users/2decc2b4793f4b2297d6da0b32eb512e` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:54.567227 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d9afc-f89b-4206-82b9-9d862c06a5be admin admin] RBAC: Authorizing `identity:delete_user(user_id=2decc2b4793f4b2297d6da0b32eb512e)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:54.569273 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d9afc-f89b-4206-82b9-9d862c06a5be admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:54.742688 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-973d9afc-f89b-4206-82b9-9d862c06a5be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2decc2b4793f4b2297d6da0b32eb512e'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:54.758337 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-973d9afc-f89b-4206-82b9-9d862c06a5be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2decc2b4793f4b2297d6da0b32eb512e'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:54.759346 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-973d9afc-f89b-4206-82b9-9d862c06a5be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2decc2b4793f4b2297d6da0b32eb512e'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:54.762220 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:54.777974 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-973d9afc-f89b-4206-82b9-9d862c06a5be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2decc2b4793f4b2297d6da0b32eb512e'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:54.834995 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-973d9afc-f89b-4206-82b9-9d862c06a5be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2decc2b4793f4b2297d6da0b32eb512e'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:54.872651 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1115/2215] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:56:54 2022] DELETE /identity/v3/users/2decc2b4793f4b2297d6da0b32eb512e => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:56:55.272286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69f0ac-8e41-4a48-8698-8c52e1bbf941 service swift] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:55.291191 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69f0ac-8e41-4a48-8698-8c52e1bbf941 service swift] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:55.302287 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:55.427824 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae79e92-d3e9-4da7-a917-fd538be5ee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:55.429812 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae79e92-d3e9-4da7-a917-fd538be5ee6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:55.432122 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae79e92-d3e9-4da7-a917-fd538be5ee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:55.432683 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae79e92-d3e9-4da7-a917-fd538be5ee6b admin admin] PATH_INFO: `/v3/projects/cbeaefc57cd14db6ba982fc059b70b70` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:55.438289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae79e92-d3e9-4da7-a917-fd538be5ee6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbeaefc57cd14db6ba982fc059b70b70)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:55.440843 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae79e92-d3e9-4da7-a917-fd538be5ee6b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:55.588905 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7ae79e92-d3e9-4da7-a917-fd538be5ee6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbeaefc57cd14db6ba982fc059b70b70', 'request_id': 'req-7ae79e92-d3e9-4da7-a917-fd538be5ee6b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:55.640049 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7ae79e92-d3e9-4da7-a917-fd538be5ee6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbeaefc57cd14db6ba982fc059b70b70', 'request_id': 'req-7ae79e92-d3e9-4da7-a917-fd538be5ee6b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:55.664561 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7ae79e92-d3e9-4da7-a917-fd538be5ee6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbeaefc57cd14db6ba982fc059b70b70', 'request_id': 'req-7ae79e92-d3e9-4da7-a917-fd538be5ee6b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:55.699001 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7ae79e92-d3e9-4da7-a917-fd538be5ee6b admin admin] The token cache is being invalidate because project cbeaefc57cd14db6ba982fc059b70b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:56:55.699321 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7ae79e92-d3e9-4da7-a917-fd538be5ee6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:55.700020 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7ae79e92-d3e9-4da7-a917-fd538be5ee6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:55.709381 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5faa38c-ee15-4059-9751-cb88dc1bcb09 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:55.709664 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5faa38c-ee15-4059-9751-cb88dc1bcb09 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:55.709973 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5faa38c-ee15-4059-9751-cb88dc1bcb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:55.712072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1101/2216] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:56:55 2022] DELETE /identity/v3/projects/cbeaefc57cd14db6ba982fc059b70b70 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:56:55.764704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-f5faa38c-ee15-4059-9751-cb88dc1bcb09 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:55.768460 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f5faa38c-ee15-4059-9751-cb88dc1bcb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:55.902554 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1116/2217] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:56:55.921179 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62798c-b2f4-4f35-b82b-be1d5ac65df3 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:55.922133 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62798c-b2f4-4f35-b82b-be1d5ac65df3 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:55.922888 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62798c-b2f4-4f35-b82b-be1d5ac65df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:56.030009 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-cb62798c-b2f4-4f35-b82b-be1d5ac65df3 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:56.037135 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-cb62798c-b2f4-4f35-b82b-be1d5ac65df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:56.109875 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5faa38c-ee15-4059-9751-cb88dc1bcb09 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:56.122975 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1102/2218] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:56:56.155634 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5faa38c-ee15-4059-9751-cb88dc1bcb09 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:56.166835 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749cf6d-eafb-408a-9d5b-8e74966656dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:56.169608 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749cf6d-eafb-408a-9d5b-8e74966656dc admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:56.177629 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749cf6d-eafb-408a-9d5b-8e74966656dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:56.178524 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749cf6d-eafb-408a-9d5b-8e74966656dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:56.180671 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749cf6d-eafb-408a-9d5b-8e74966656dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 05:56:56.182372 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749cf6d-eafb-408a-9d5b-8e74966656dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:56.188922 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749cf6d-eafb-408a-9d5b-8e74966656dc admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:56.267969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62798c-b2f4-4f35-b82b-be1d5ac65df3 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:56.276879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1117/2219] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 05:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 05:56:56.319067 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62798c-b2f4-4f35-b82b-be1d5ac65df3 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:56.352057 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd81f6-3d3a-43a0-b791-71ba64535d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:56.355168 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd81f6-3d3a-43a0-b791-71ba64535d6f admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:56.358691 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd81f6-3d3a-43a0-b791-71ba64535d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:56.361866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd81f6-3d3a-43a0-b791-71ba64535d6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:56.365699 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd81f6-3d3a-43a0-b791-71ba64535d6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:56.378264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd81f6-3d3a-43a0-b791-71ba64535d6f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:56.537071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749cf6d-eafb-408a-9d5b-8e74966656dc admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:56.542504 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1103/2220] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:56:56 2022] POST /identity/v3/projects => generated 371 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:56:56.557890 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749cf6d-eafb-408a-9d5b-8e74966656dc admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:56.754555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f2920-3aed-4dd8-8caf-d088e7bf6787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:56.755490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f2920-3aed-4dd8-8caf-d088e7bf6787 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:56.755949 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f2920-3aed-4dd8-8caf-d088e7bf6787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:56.756394 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f2920-3aed-4dd8-8caf-d088e7bf6787 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:56.757336 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f2920-3aed-4dd8-8caf-d088e7bf6787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:56.759528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f2920-3aed-4dd8-8caf-d088e7bf6787 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:56.787890 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1118/2221] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:56:56 2022] POST /identity/v3/users => generated 286 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:56:56.795000 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd81f6-3d3a-43a0-b791-71ba64535d6f admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:56.856761 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd81f6-3d3a-43a0-b791-71ba64535d6f admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:56.881141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c1bf2-5416-4172-8101-aef8059717d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:56.883749 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c1bf2-5416-4172-8101-aef8059717d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:56.885616 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c1bf2-5416-4172-8101-aef8059717d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:56.886295 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c1bf2-5416-4172-8101-aef8059717d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:56.889176 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c1bf2-5416-4172-8101-aef8059717d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:56.893697 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c1bf2-5416-4172-8101-aef8059717d4 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:56.929068 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1104/2222] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:56:56.933866 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f2920-3aed-4dd8-8caf-d088e7bf6787 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:56.948651 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f2920-3aed-4dd8-8caf-d088e7bf6787 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:56.962283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24bce1-5d3b-44ff-81c4-d4a3ae883b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:56.964130 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24bce1-5d3b-44ff-81c4-d4a3ae883b41 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:56.966296 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24bce1-5d3b-44ff-81c4-d4a3ae883b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:56.966774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24bce1-5d3b-44ff-81c4-d4a3ae883b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:56.967727 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24bce1-5d3b-44ff-81c4-d4a3ae883b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:56.973094 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24bce1-5d3b-44ff-81c4-d4a3ae883b41 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:56.998128 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1119/2223] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:56:57.002445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c1bf2-5416-4172-8101-aef8059717d4 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:57.029399 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c1bf2-5416-4172-8101-aef8059717d4 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:57.046927 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448770b-c65a-4dc4-84ac-a04a35212c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:57.047670 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448770b-c65a-4dc4-84ac-a04a35212c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:57.047952 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448770b-c65a-4dc4-84ac-a04a35212c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:57.048230 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448770b-c65a-4dc4-84ac-a04a35212c41 admin admin] PATH_INFO: `/v3/projects/4e17d31f99954cca8b4eb24b3b798f1e/users/353add140e784d90a16c124e52f5d36d/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:57.077585 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448770b-c65a-4dc4-84ac-a04a35212c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e17d31f99954cca8b4eb24b3b798f1e, user_id=353add140e784d90a16c124e52f5d36d, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:57.089491 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448770b-c65a-4dc4-84ac-a04a35212c41 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:57.191446 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1105/2224] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:56:57 2022] PUT /identity/v3/projects/4e17d31f99954cca8b4eb24b3b798f1e/users/353add140e784d90a16c124e52f5d36d/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:56:57.196952 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00915131-e5f5-4cc3-b533-92c65f28d135 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:57.197905 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00915131-e5f5-4cc3-b533-92c65f28d135 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:57.199738 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00915131-e5f5-4cc3-b533-92c65f28d135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:57.296489 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-00915131-e5f5-4cc3-b533-92c65f28d135 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:57.302895 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-00915131-e5f5-4cc3-b533-92c65f28d135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:57.519415 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448770b-c65a-4dc4-84ac-a04a35212c41 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:57.523533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f448770b-c65a-4dc4-84ac-a04a35212c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:57.591278 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:57.756424 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:57.783934 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1120/2225] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:56:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 590 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:56:57.813013 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00915131-e5f5-4cc3-b533-92c65f28d135 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:57.816562 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-00915131-e5f5-4cc3-b533-92c65f28d135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:57.842544 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448770b-c65a-4dc4-84ac-a04a35212c41 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:57.855443 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60458618-882d-44f2-800e-c24aa242790c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:57.856353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60458618-882d-44f2-800e-c24aa242790c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:57.856642 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60458618-882d-44f2-800e-c24aa242790c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:57.856980 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60458618-882d-44f2-800e-c24aa242790c admin admin] PATH_INFO: `/v3/users/81262a5bbc824136ba8d940442dfae66` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:57.858666 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60458618-882d-44f2-800e-c24aa242790c admin admin] RBAC: Authorizing `identity:delete_user(user_id=81262a5bbc824136ba8d940442dfae66)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:57.862278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60458618-882d-44f2-800e-c24aa242790c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:57.997412 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-60458618-882d-44f2-800e-c24aa242790c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81262a5bbc824136ba8d940442dfae66'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:58.023936 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-60458618-882d-44f2-800e-c24aa242790c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81262a5bbc824136ba8d940442dfae66'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:58.026748 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-60458618-882d-44f2-800e-c24aa242790c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81262a5bbc824136ba8d940442dfae66'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:58.027795 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-60458618-882d-44f2-800e-c24aa242790c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81262a5bbc824136ba8d940442dfae66'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:58.064755 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-60458618-882d-44f2-800e-c24aa242790c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81262a5bbc824136ba8d940442dfae66'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:58.094271 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1106/2226] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:56:57 2022] DELETE /identity/v3/users/81262a5bbc824136ba8d940442dfae66 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:56:58.115884 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca7451-c1ac-4a1f-a1e8-fe69f2d166bf None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:58.118396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca7451-c1ac-4a1f-a1e8-fe69f2d166bf None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:58.120576 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca7451-c1ac-4a1f-a1e8-fe69f2d166bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:58.152867 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00915131-e5f5-4cc3-b533-92c65f28d135 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:58.202132 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-a5ca7451-c1ac-4a1f-a1e8-fe69f2d166bf None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:56:58.208635 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a5ca7451-c1ac-4a1f-a1e8-fe69f2d166bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:58.266981 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a21f8-e2ba-4b13-bec9-f6049418f5f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:58.268212 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a21f8-e2ba-4b13-bec9-f6049418f5f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:58.268499 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a21f8-e2ba-4b13-bec9-f6049418f5f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:58.268777 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a21f8-e2ba-4b13-bec9-f6049418f5f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:58.275404 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-991a21f8-e2ba-4b13-bec9-f6049418f5f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:58.416547 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1107/2227] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:56:58.443226 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a21f8-e2ba-4b13-bec9-f6049418f5f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:58.445607 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a21f8-e2ba-4b13-bec9-f6049418f5f9 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:58.453778 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca7451-c1ac-4a1f-a1e8-fe69f2d166bf None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:58.458175 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a5ca7451-c1ac-4a1f-a1e8-fe69f2d166bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:58.489517 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca7451-c1ac-4a1f-a1e8-fe69f2d166bf None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:58.492804 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1121/2228] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:56:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:56:58.495743 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de65d8f-7903-4d69-b313-1bf52e6591ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:58.496408 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de65d8f-7903-4d69-b313-1bf52e6591ac service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:58.496688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de65d8f-7903-4d69-b313-1bf52e6591ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:58.497843 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de65d8f-7903-4d69-b313-1bf52e6591ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:58.510925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de65d8f-7903-4d69-b313-1bf52e6591ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:58.514665 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de65d8f-7903-4d69-b313-1bf52e6591ac service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:58.534242 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1108/2229] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:56:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 05:56:59.299107 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a21f8-e2ba-4b13-bec9-f6049418f5f9 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:59.300769 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-991a21f8-e2ba-4b13-bec9-f6049418f5f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:59.335692 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a21f8-e2ba-4b13-bec9-f6049418f5f9 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:56:59.363167 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00f910-1509-4cb4-a76b-7eec9a6cd8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:56:59.364197 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00f910-1509-4cb4-a76b-7eec9a6cd8f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:56:59.364487 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00f910-1509-4cb4-a76b-7eec9a6cd8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:56:59.364770 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00f910-1509-4cb4-a76b-7eec9a6cd8f3 admin admin] PATH_INFO: `/v3/projects/88247de6a0dc4a1089749816533eabd2` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:56:59.369477 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00f910-1509-4cb4-a76b-7eec9a6cd8f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88247de6a0dc4a1089749816533eabd2)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:56:59.371599 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00f910-1509-4cb4-a76b-7eec9a6cd8f3 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:56:59.448044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:59.468918 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1a00f910-1509-4cb4-a76b-7eec9a6cd8f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88247de6a0dc4a1089749816533eabd2', 'request_id': 'req-1a00f910-1509-4cb4-a76b-7eec9a6cd8f3'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:59.479528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1a00f910-1509-4cb4-a76b-7eec9a6cd8f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88247de6a0dc4a1089749816533eabd2', 'request_id': 'req-1a00f910-1509-4cb4-a76b-7eec9a6cd8f3'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:59.500474 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1a00f910-1509-4cb4-a76b-7eec9a6cd8f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88247de6a0dc4a1089749816533eabd2', 'request_id': 'req-1a00f910-1509-4cb4-a76b-7eec9a6cd8f3'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:59.535271 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1a00f910-1509-4cb4-a76b-7eec9a6cd8f3 admin admin] The token cache is being invalidate because project 88247de6a0dc4a1089749816533eabd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:56:59.535545 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1a00f910-1509-4cb4-a76b-7eec9a6cd8f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:59.537042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1a00f910-1509-4cb4-a76b-7eec9a6cd8f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:56:59.549973 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1122/2230] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:56:59 2022] DELETE /identity/v3/projects/88247de6a0dc4a1089749816533eabd2 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:56:59.677871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de65d8f-7903-4d69-b313-1bf52e6591ac service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:56:59.689253 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1de65d8f-7903-4d69-b313-1bf52e6591ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:56:59.881191 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:57:00.015213 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de65d8f-7903-4d69-b313-1bf52e6591ac service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:57:00.146496 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6fe4d-f3bc-4a03-a370-ed544cf341f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17a40bea6ba41f19c88e16f9b15cf27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:57:00.157642 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6fe4d-f3bc-4a03-a370-ed544cf341f7 service placement] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:57:00.157642 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6fe4d-f3bc-4a03-a370-ed544cf341f7 service placement] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:57:00.157642 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6fe4d-f3bc-4a03-a370-ed544cf341f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:57:00.159865 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-dab6fe4d-f3bc-4a03-a370-ed544cf341f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:57:00.183366 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab6fe4d-f3bc-4a03-a370-ed544cf341f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:57:00.185530 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab6fe4d-f3bc-4a03-a370-ed544cf341f7 service placement] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:57:00.201093 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1109/2231] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:56:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:57:09.530390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=9,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:57:10.194358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=49 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:57:10.341268 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1356d-939b-4150-882a-814c107d5647 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:57:10.341663 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1356d-939b-4150-882a-814c107d5647 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:57:10.341926 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1356d-939b-4150-882a-814c107d5647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:57:10.435363 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-d3b1356d-939b-4150-882a-814c107d5647 None None] MFA Rules not processed for user `353add140e784d90a16c124e52f5d36d`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:57:10.436651 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d3b1356d-939b-4150-882a-814c107d5647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:57:10.584417 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1123/2232] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:57:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:57:10.588549 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6fe4d-f3bc-4a03-a370-ed544cf341f7 service placement] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:57:10.590714 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-dab6fe4d-f3bc-4a03-a370-ed544cf341f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:57:10.694205 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6fe4d-f3bc-4a03-a370-ed544cf341f7 service placement] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:57:10.702543 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cd7e4-b4c6-4682-bfa3-34bc4a95826a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:57:10.703654 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cd7e4-b4c6-4682-bfa3-34bc4a95826a admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:57:10.704149 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cd7e4-b4c6-4682-bfa3-34bc4a95826a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:57:10.704624 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cd7e4-b4c6-4682-bfa3-34bc4a95826a admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:57:10.705907 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889cd7e4-b4c6-4682-bfa3-34bc4a95826a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:57:10.710431 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889cd7e4-b4c6-4682-bfa3-34bc4a95826a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:57:10.768675 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1110/2233] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 05:57:10 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:57:10.770711 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1356d-939b-4150-882a-814c107d5647 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:57:10.788421 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1356d-939b-4150-882a-814c107d5647 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:57:10.900806 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78465b-0f47-436d-92ae-81f379526173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:57:10.901886 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78465b-0f47-436d-92ae-81f379526173 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:57:10.902528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78465b-0f47-436d-92ae-81f379526173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:57:10.903001 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78465b-0f47-436d-92ae-81f379526173 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:57:10.903962 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78465b-0f47-436d-92ae-81f379526173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:57:10.907144 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78465b-0f47-436d-92ae-81f379526173 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:57:10.931202 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1124/2234] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 05:57:10 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 05:57:10.935640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cd7e4-b4c6-4682-bfa3-34bc4a95826a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:57:10.947229 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cd7e4-b4c6-4682-bfa3-34bc4a95826a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:57:10.952245 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7688749-abd3-4bd7-bcce-4727fa82d334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:57:10.952934 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7688749-abd3-4bd7-bcce-4727fa82d334 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:57:10.953224 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7688749-abd3-4bd7-bcce-4727fa82d334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:57:10.953509 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7688749-abd3-4bd7-bcce-4727fa82d334 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:57:10.954305 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7688749-abd3-4bd7-bcce-4727fa82d334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:57:10.955957 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7688749-abd3-4bd7-bcce-4727fa82d334 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:57:10.968938 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1111/2235] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 05:57:10.975330 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78465b-0f47-436d-92ae-81f379526173 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:57:10.989371 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78465b-0f47-436d-92ae-81f379526173 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:57:10.994955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff880e0f-b9f9-4233-b43b-c0093a6d2e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:57:10.996481 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff880e0f-b9f9-4233-b43b-c0093a6d2e35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:57:10.997127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff880e0f-b9f9-4233-b43b-c0093a6d2e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:57:10.997737 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff880e0f-b9f9-4233-b43b-c0093a6d2e35 admin admin] PATH_INFO: `/v3/projects/4e4c039b12fa4ca0a1be60baa4a83686/users/1afb0338b660436aa8022be14595a434/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:57:11.034689 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff880e0f-b9f9-4233-b43b-c0093a6d2e35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e4c039b12fa4ca0a1be60baa4a83686, user_id=1afb0338b660436aa8022be14595a434, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:57:11.040378 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff880e0f-b9f9-4233-b43b-c0093a6d2e35 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:57:11.065569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1125/2236] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:57:10 2022] PUT /identity/v3/projects/4e4c039b12fa4ca0a1be60baa4a83686/users/1afb0338b660436aa8022be14595a434/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:57:11.070686 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7688749-abd3-4bd7-bcce-4727fa82d334 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:57:11.084218 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7688749-abd3-4bd7-bcce-4727fa82d334 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:57:11.197811 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218c09f-c6d2-4862-a3f9-894b6cf9bccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:57:11.199017 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218c09f-c6d2-4862-a3f9-894b6cf9bccd admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:57:11.199524 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218c09f-c6d2-4862-a3f9-894b6cf9bccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:57:11.200025 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218c09f-c6d2-4862-a3f9-894b6cf9bccd admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:57:11.201679 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b218c09f-c6d2-4862-a3f9-894b6cf9bccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:57:11.204575 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b218c09f-c6d2-4862-a3f9-894b6cf9bccd admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:57:11.227793 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1112/2237] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 05:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 05:57:11.229099 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff880e0f-b9f9-4233-b43b-c0093a6d2e35 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:57:11.240374 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff880e0f-b9f9-4233-b43b-c0093a6d2e35 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:57:11.265863 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df977eb-0e15-4cf4-8e02-e39b62fc9321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:57:11.266992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df977eb-0e15-4cf4-8e02-e39b62fc9321 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:57:11.267336 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df977eb-0e15-4cf4-8e02-e39b62fc9321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:57:11.267746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df977eb-0e15-4cf4-8e02-e39b62fc9321 admin admin] PATH_INFO: `/v3/projects/4e4c039b12fa4ca0a1be60baa4a83686/users/1afb0338b660436aa8022be14595a434/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:57:11.275550 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df977eb-0e15-4cf4-8e02-e39b62fc9321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e4c039b12fa4ca0a1be60baa4a83686, user_id=1afb0338b660436aa8022be14595a434, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:57:11.281821 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df977eb-0e15-4cf4-8e02-e39b62fc9321 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:57:11.303332 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1126/2238] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 05:57:11 2022] PUT /identity/v3/projects/4e4c039b12fa4ca0a1be60baa4a83686/users/1afb0338b660436aa8022be14595a434/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:57:15.567746 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebd762-f459-4d76-bd24-76913b67ca38 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:57:15.570120 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebd762-f459-4d76-bd24-76913b67ca38 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:57:15.570909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebd762-f459-4d76-bd24-76913b67ca38 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:57:15.574249 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1113/2239] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jun 21 05:57:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:57:15.583275 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0990d-be01-4f41-908a-6592c656687d None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:57:15.585132 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0990d-be01-4f41-908a-6592c656687d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:57:15.585911 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0990d-be01-4f41-908a-6592c656687d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:57:15.705160 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-3cd0990d-be01-4f41-908a-6592c656687d None None] MFA Rules not processed for user `f702830987ba4548a4c2ee3d0e302d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:57:15.706587 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3cd0990d-be01-4f41-908a-6592c656687d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:57:15.725533 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:57:15.869569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1127/2240] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jun 21 05:57:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:57:15.902588 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebd762-f459-4d76-bd24-76913b67ca38 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:57:15.905311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-4cebd762-f459-4d76-bd24-76913b67ca38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:57:16.118169 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebd762-f459-4d76-bd24-76913b67ca38 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:57:16.128022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678a206-8617-4c67-b4ae-7119194850c6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44776834b134ae98fa28d4741cc4ec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:57:16.129397 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678a206-8617-4c67-b4ae-7119194850c6 service glance] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:57:16.134407 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678a206-8617-4c67-b4ae-7119194850c6 service glance] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:57:16.134595 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678a206-8617-4c67-b4ae-7119194850c6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:57:16.150882 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:57:16.158239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678a206-8617-4c67-b4ae-7119194850c6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:57:16.161419 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678a206-8617-4c67-b4ae-7119194850c6 service glance] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:57:16.194648 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1114/2241] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:57:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 05:57:16.306677 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d0f69-d5d1-4fc1-94cd-b5333a4c0962 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:57:16.307776 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d0f69-d5d1-4fc1-94cd-b5333a4c0962 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:57:16.307776 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d0f69-d5d1-4fc1-94cd-b5333a4c0962 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:57:16.311557 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1128/2242] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jun 21 05:57:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:57:16.320142 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5a3cc-c4c1-4f40-9ff0-fce778fc3e7a None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:57:16.320660 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5a3cc-c4c1-4f40-9ff0-fce778fc3e7a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:57:16.321157 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5a3cc-c4c1-4f40-9ff0-fce778fc3e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:57:16.356478 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-95a5a3cc-c4c1-4f40-9ff0-fce778fc3e7a None None] MFA Rules not processed for user `51e845d0dc2c4a1fa612556c1aa73ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:57:16.358619 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-95a5a3cc-c4c1-4f40-9ff0-fce778fc3e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:57:16.452713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1115/2243] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jun 21 05:57:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:57:16.465426 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d0f69-d5d1-4fc1-94cd-b5333a4c0962 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:57:16.469057 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-991d0f69-d5d1-4fc1-94cd-b5333a4c0962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:57:16.486506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d0f69-d5d1-4fc1-94cd-b5333a4c0962 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:57:16.491043 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233d659-5d88-414d-8a1c-a6790832ad85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:57:16.491874 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233d659-5d88-414d-8a1c-a6790832ad85 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:57:16.492258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233d659-5d88-414d-8a1c-a6790832ad85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:57:16.492636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233d659-5d88-414d-8a1c-a6790832ad85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:57:16.530799 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233d659-5d88-414d-8a1c-a6790832ad85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:57:16.532464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233d659-5d88-414d-8a1c-a6790832ad85 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:57:16.550450 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1129/2244] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:57:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:57:16.657054 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd18fb8-4ca2-4e98-a53c-3ae6f785e082 None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:57:16.658145 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd18fb8-4ca2-4e98-a53c-3ae6f785e082 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:57:16.658764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd18fb8-4ca2-4e98-a53c-3ae6f785e082 None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:57:16.660703 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1116/2245] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jun 21 05:57:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 05:57:16.668712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b16644-ff9b-49d9-a824-3aef9969b9ce None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:57:16.669251 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b16644-ff9b-49d9-a824-3aef9969b9ce None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:57:16.669392 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b16644-ff9b-49d9-a824-3aef9969b9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:57:16.690304 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-73b16644-ff9b-49d9-a824-3aef9969b9ce None None] MFA Rules not processed for user `f702830987ba4548a4c2ee3d0e302d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:57:16.691637 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-73b16644-ff9b-49d9-a824-3aef9969b9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:57:16.702365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1130/2246] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jun 21 05:57:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:57:16.717701 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd18fb8-4ca2-4e98-a53c-3ae6f785e082 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:57:16.739735 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd18fb8-4ca2-4e98-a53c-3ae6f785e082 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:57:16.748114 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94fd93-ed81-4794-b6d5-2715e78cfd3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:57:16.749730 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94fd93-ed81-4794-b6d5-2715e78cfd3c service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:57:16.750282 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94fd93-ed81-4794-b6d5-2715e78cfd3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:57:16.750901 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94fd93-ed81-4794-b6d5-2715e78cfd3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:57:16.773712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec94fd93-ed81-4794-b6d5-2715e78cfd3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:57:16.776584 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec94fd93-ed81-4794-b6d5-2715e78cfd3c service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:57:16.814185 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1117/2247] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:57:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:57:18.280698 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57376e8c-7eee-46c2-98c9-185eae1fd63a None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:57:18.281747 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57376e8c-7eee-46c2-98c9-185eae1fd63a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:57:18.282252 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57376e8c-7eee-46c2-98c9-185eae1fd63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:57:18.346848 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-57376e8c-7eee-46c2-98c9-185eae1fd63a None None] MFA Rules not processed for user `1afb0338b660436aa8022be14595a434`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:57:18.348565 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-57376e8c-7eee-46c2-98c9-185eae1fd63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:57:18.480666 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1131/2248] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:57:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:57:18.481753 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94fd93-ed81-4794-b6d5-2715e78cfd3c service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:57:18.483451 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ec94fd93-ed81-4794-b6d5-2715e78cfd3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:57:18.522243 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94fd93-ed81-4794-b6d5-2715e78cfd3c service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:57:18.540369 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2dca9e-17ff-495f-b107-a7e2b3100f73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:57:18.541112 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dca9e-17ff-495f-b107-a7e2b3100f73 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:57:18.541343 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dca9e-17ff-495f-b107-a7e2b3100f73 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:57:18.546660 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dca9e-17ff-495f-b107-a7e2b3100f73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:57:18.634943 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2dca9e-17ff-495f-b107-a7e2b3100f73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:57:18.637402 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2dca9e-17ff-495f-b107-a7e2b3100f73 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:57:18.649180 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1118/2249] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:57:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 05:57:20.158688 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d748bdb-d838-4173-9fc7-c4e630b59924 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:57:20.159263 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d748bdb-d838-4173-9fc7-c4e630b59924 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:57:20.159527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d748bdb-d838-4173-9fc7-c4e630b59924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:57:20.183559 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-8d748bdb-d838-4173-9fc7-c4e630b59924 None None] MFA Rules not processed for user `353add140e784d90a16c124e52f5d36d`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:57:20.185498 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-8d748bdb-d838-4173-9fc7-c4e630b59924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:57:20.201793 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1132/2250] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:57:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:57:21.148444 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0c199-f461-410b-a45b-671e2ce381bf None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:57:21.148989 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0c199-f461-410b-a45b-671e2ce381bf None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:57:21.148989 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0c199-f461-410b-a45b-671e2ce381bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:57:21.235656 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-02e0c199-f461-410b-a45b-671e2ce381bf None None] MFA Rules not processed for user `af8e0eb5ff8c40ae848929780d99e72d`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:57:21.236965 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-02e0c199-f461-410b-a45b-671e2ce381bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:57:21.317835 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:57:21.323099 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1119/2251] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jun 21 05:57:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 05:57:21.356732 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d748bdb-d838-4173-9fc7-c4e630b59924 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:57:21.358430 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-8d748bdb-d838-4173-9fc7-c4e630b59924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:57:21.467734 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:57:21.540970 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d748bdb-d838-4173-9fc7-c4e630b59924 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:57:21.546983 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a91b72-e0a4-4898-b9fe-1632767707d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac485a336d8b4360bce4f495bd02dbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:57:21.547667 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a91b72-e0a4-4898-b9fe-1632767707d3 service swift] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:57:21.548456 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a91b72-e0a4-4898-b9fe-1632767707d3 service swift] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:57:21.548740 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a91b72-e0a4-4898-b9fe-1632767707d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:57:21.567018 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a91b72-e0a4-4898-b9fe-1632767707d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:57:21.572236 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a91b72-e0a4-4898-b9fe-1632767707d3 service swift] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:57:21.590131 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1133/2252] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 21 05:57:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 21 05:57:31.582266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=14 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:57:50.682518 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c355c8-cf28-4587-aa80-0fb4f800f15a None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:57:50.683018 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c355c8-cf28-4587-aa80-0fb4f800f15a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:57:50.683116 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c355c8-cf28-4587-aa80-0fb4f800f15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:57:50.700277 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-62c355c8-cf28-4587-aa80-0fb4f800f15a None None] MFA Rules not processed for user `af8e0eb5ff8c40ae848929780d99e72d`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:57:50.701471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-62c355c8-cf28-4587-aa80-0fb4f800f15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:57:50.708663 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1120/2253] 10.222.0.18 () {58 vars in 967 bytes} [Tue Jun 21 05:57:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:57:50.721000 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a91b72-e0a4-4898-b9fe-1632767707d3 service swift] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:57:50.732809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a91b72-e0a4-4898-b9fe-1632767707d3 service swift] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:57:50.737959 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75f77d-7e67-464b-b23f-a1bc6907ad59 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac485a336d8b4360bce4f495bd02dbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:57:50.739215 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75f77d-7e67-464b-b23f-a1bc6907ad59 service swift] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:57:50.739504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75f77d-7e67-464b-b23f-a1bc6907ad59 service swift] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:57:50.739787 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75f77d-7e67-464b-b23f-a1bc6907ad59 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:57:50.748477 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75f77d-7e67-464b-b23f-a1bc6907ad59 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:57:50.750530 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75f77d-7e67-464b-b23f-a1bc6907ad59 service swift] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:57:50.758722 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1134/2254] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 21 05:57:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 05:58:00.695253 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:58:00.757033 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=6 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:58:05.960047 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e82b9-b62b-49ea-bc8f-27d770f1a7f9 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:58:05.960578 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e82b9-b62b-49ea-bc8f-27d770f1a7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:58:05.960701 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e82b9-b62b-49ea-bc8f-27d770f1a7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:58:05.979447 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-bf9e82b9-b62b-49ea-bc8f-27d770f1a7f9 None None] MFA Rules not processed for user `fc4e3249c43c4e8292475684ce7fd36e`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:58:05.984923 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-bf9e82b9-b62b-49ea-bc8f-27d770f1a7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:58:06.042561 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1121/2255] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:58:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:58:09.831678 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75f77d-7e67-464b-b23f-a1bc6907ad59 service swift] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:58:09.833179 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-eb75f77d-7e67-464b-b23f-a1bc6907ad59 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:58:09.846556 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75f77d-7e67-464b-b23f-a1bc6907ad59 service swift] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:58:09.850902 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943322b5-c8f8-40c2-a601-d3d665f4abb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:58:09.851569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943322b5-c8f8-40c2-a601-d3d665f4abb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:58:09.851850 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943322b5-c8f8-40c2-a601-d3d665f4abb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:58:09.852276 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943322b5-c8f8-40c2-a601-d3d665f4abb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:58:09.862096 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943322b5-c8f8-40c2-a601-d3d665f4abb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:58:09.863571 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943322b5-c8f8-40c2-a601-d3d665f4abb2 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:58:09.874003 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1135/2256] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:58:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:58:16.034916 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=25 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:58:19.869845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=6 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:58:39.766278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cc4e8-e9c3-4910-a1c6-23a209f6dd13 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:58:39.766837 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cc4e8-e9c3-4910-a1c6-23a209f6dd13 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:58:39.766837 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cc4e8-e9c3-4910-a1c6-23a209f6dd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:58:39.784710 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-727cc4e8-e9c3-4910-a1c6-23a209f6dd13 None None] MFA Rules not processed for user `f4cd1d7c5a4a4b658f7abf8e434cf716`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:58:39.785973 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-727cc4e8-e9c3-4910-a1c6-23a209f6dd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:58:39.841583 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1122/2257] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:58:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:58:49.834961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=25 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:58:49.976620 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943322b5-c8f8-40c2-a601-d3d665f4abb2 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:58:49.985360 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943322b5-c8f8-40c2-a601-d3d665f4abb2 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:58:49.989089 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59493798-29ee-4c63-9765-ddfaba3d4e94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:58:49.989724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59493798-29ee-4c63-9765-ddfaba3d4e94 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:58:49.990053 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59493798-29ee-4c63-9765-ddfaba3d4e94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:58:49.990330 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59493798-29ee-4c63-9765-ddfaba3d4e94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:58:49.992079 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-59493798-29ee-4c63-9765-ddfaba3d4e94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:58:50.007194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59493798-29ee-4c63-9765-ddfaba3d4e94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:58:50.008622 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59493798-29ee-4c63-9765-ddfaba3d4e94 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:58:50.020198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1136/2258] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:58:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:58:52.171926 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cc4e8-e9c3-4910-a1c6-23a209f6dd13 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:58:52.173381 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-727cc4e8-e9c3-4910-a1c6-23a209f6dd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:58:52.269078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cc4e8-e9c3-4910-a1c6-23a209f6dd13 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:58:52.274716 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efa4fc-9a3f-4574-8175-d18817b1a543 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:58:52.275309 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efa4fc-9a3f-4574-8175-d18817b1a543 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:58:52.275860 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efa4fc-9a3f-4574-8175-d18817b1a543 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:58:52.276149 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efa4fc-9a3f-4574-8175-d18817b1a543 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:58:52.278507 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-94efa4fc-9a3f-4574-8175-d18817b1a543 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:58:52.298762 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94efa4fc-9a3f-4574-8175-d18817b1a543 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:58:52.301050 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94efa4fc-9a3f-4574-8175-d18817b1a543 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:58:52.315266 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1123/2259] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:58:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:59:00.014775 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=6 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:59:02.308770 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=35 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:59:03.562512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e31b9-4ba5-4017-9b9e-91ff2f101b45 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:59:03.563014 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e31b9-4ba5-4017-9b9e-91ff2f101b45 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:59:03.563109 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e31b9-4ba5-4017-9b9e-91ff2f101b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:59:03.581667 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-065e31b9-4ba5-4017-9b9e-91ff2f101b45 None None] MFA Rules not processed for user `7e3e3935d57a48f195a568f90ed25a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:59:03.582951 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-065e31b9-4ba5-4017-9b9e-91ff2f101b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:59:03.638413 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1137/2260] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:59:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:59:04.287867 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efa4fc-9a3f-4574-8175-d18817b1a543 service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:59:04.299234 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efa4fc-9a3f-4574-8175-d18817b1a543 service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:59:04.304979 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b532bf-6c69-4e07-9bf7-aa6fcc98b040 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:59:04.305624 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b532bf-6c69-4e07-9bf7-aa6fcc98b040 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:59:04.305908 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b532bf-6c69-4e07-9bf7-aa6fcc98b040 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:59:04.306219 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b532bf-6c69-4e07-9bf7-aa6fcc98b040 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:59:04.308026 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b3b532bf-6c69-4e07-9bf7-aa6fcc98b040 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:59:04.319547 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b532bf-6c69-4e07-9bf7-aa6fcc98b040 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:59:04.321127 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b532bf-6c69-4e07-9bf7-aa6fcc98b040 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:59:04.331122 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1124/2261] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:59:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:59:08.549750 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e31b9-4ba5-4017-9b9e-91ff2f101b45 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:59:08.551256 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-065e31b9-4ba5-4017-9b9e-91ff2f101b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:59:08.571282 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e31b9-4ba5-4017-9b9e-91ff2f101b45 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:59:08.577331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a45466-154d-45f6-ae38-b761d2041863 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:59:08.578031 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a45466-154d-45f6-ae38-b761d2041863 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:59:08.578318 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a45466-154d-45f6-ae38-b761d2041863 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:59:08.578595 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a45466-154d-45f6-ae38-b761d2041863 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:59:08.580443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b7a45466-154d-45f6-ae38-b761d2041863 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:59:08.641127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a45466-154d-45f6-ae38-b761d2041863 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:59:08.643602 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a45466-154d-45f6-ae38-b761d2041863 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:59:08.653550 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1138/2262] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:59:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:59:10.776074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b532bf-6c69-4e07-9bf7-aa6fcc98b040 service nova] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:59:10.777657 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b3b532bf-6c69-4e07-9bf7-aa6fcc98b040 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:59:10.843324 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b532bf-6c69-4e07-9bf7-aa6fcc98b040 service nova] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:59:10.847954 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe861fd5-0948-4d26-b309-487e772ec723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:59:10.848909 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe861fd5-0948-4d26-b309-487e772ec723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:59:10.849107 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe861fd5-0948-4d26-b309-487e772ec723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:59:10.849384 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe861fd5-0948-4d26-b309-487e772ec723 admin admin] PATH_INFO: `/v3/users/fc4e3249c43c4e8292475684ce7fd36e` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:59:10.850590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe861fd5-0948-4d26-b309-487e772ec723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc4e3249c43c4e8292475684ce7fd36e)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:59:10.852529 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe861fd5-0948-4d26-b309-487e772ec723 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:59:10.901227 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-fe861fd5-0948-4d26-b309-487e772ec723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc4e3249c43c4e8292475684ce7fd36e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:59:10.908355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-fe861fd5-0948-4d26-b309-487e772ec723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc4e3249c43c4e8292475684ce7fd36e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:59:10.909016 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-fe861fd5-0948-4d26-b309-487e772ec723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc4e3249c43c4e8292475684ce7fd36e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:59:10.909655 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-fe861fd5-0948-4d26-b309-487e772ec723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc4e3249c43c4e8292475684ce7fd36e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:59:10.921910 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-fe861fd5-0948-4d26-b309-487e772ec723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc4e3249c43c4e8292475684ce7fd36e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:59:10.934295 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1125/2263] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 05:59:10 2022] DELETE /identity/v3/users/fc4e3249c43c4e8292475684ce7fd36e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:59:11.185879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a45466-154d-45f6-ae38-b761d2041863 service nova] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:59:11.197189 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a45466-154d-45f6-ae38-b761d2041863 service nova] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:59:11.256776 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6b5b6-0bac-444d-a343-efc8837c4219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:59:11.257642 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6b5b6-0bac-444d-a343-efc8837c4219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:59:11.257925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6b5b6-0bac-444d-a343-efc8837c4219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:59:11.258234 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6b5b6-0bac-444d-a343-efc8837c4219 admin admin] PATH_INFO: `/v3/projects/a7e723a47d5246779d7835b9898429e1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:59:11.259408 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6b5b6-0bac-444d-a343-efc8837c4219 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7e723a47d5246779d7835b9898429e1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:59:11.261396 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6b5b6-0bac-444d-a343-efc8837c4219 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:59:11.305578 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:59:11.308559 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4cf6b5b6-0bac-444d-a343-efc8837c4219 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7e723a47d5246779d7835b9898429e1', 'request_id': 'req-4cf6b5b6-0bac-444d-a343-efc8837c4219'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:59:11.316063 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4cf6b5b6-0bac-444d-a343-efc8837c4219 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7e723a47d5246779d7835b9898429e1', 'request_id': 'req-4cf6b5b6-0bac-444d-a343-efc8837c4219'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:59:11.322362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4cf6b5b6-0bac-444d-a343-efc8837c4219 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7e723a47d5246779d7835b9898429e1', 'request_id': 'req-4cf6b5b6-0bac-444d-a343-efc8837c4219'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:59:11.335532 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4cf6b5b6-0bac-444d-a343-efc8837c4219 admin admin] The token cache is being invalidate because project a7e723a47d5246779d7835b9898429e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 05:59:11.335833 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4cf6b5b6-0bac-444d-a343-efc8837c4219 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:59:11.336499 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4cf6b5b6-0bac-444d-a343-efc8837c4219 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 05:59:11.338078 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1139/2264] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 05:59:11 2022] DELETE /identity/v3/projects/a7e723a47d5246779d7835b9898429e1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 05:59:19.462645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2c481-4e49-4b14-8207-bb44a81fb194 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:59:19.463159 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2c481-4e49-4b14-8207-bb44a81fb194 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:59:19.463286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2c481-4e49-4b14-8207-bb44a81fb194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:59:19.481421 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-2ae2c481-4e49-4b14-8207-bb44a81fb194 None None] MFA Rules not processed for user `f2d23615fd6349e1b70fdbad64b89b78`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:59:19.482667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-2ae2c481-4e49-4b14-8207-bb44a81fb194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:59:19.538661 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1126/2265] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:59:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:59:21.332100 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:59:25.055217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6b5b6-0bac-444d-a343-efc8837c4219 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:59:25.056753 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4cf6b5b6-0bac-444d-a343-efc8837c4219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:59:25.127706 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6b5b6-0bac-444d-a343-efc8837c4219 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:59:25.132667 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b1b3f-2a56-40c4-851e-7ddf8fc27817 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:59:25.133335 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b1b3f-2a56-40c4-851e-7ddf8fc27817 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:59:25.133625 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b1b3f-2a56-40c4-851e-7ddf8fc27817 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:59:25.133909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b1b3f-2a56-40c4-851e-7ddf8fc27817 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:59:25.135830 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-096b1b3f-2a56-40c4-851e-7ddf8fc27817 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:59:25.203555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b1b3f-2a56-40c4-851e-7ddf8fc27817 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:59:25.205065 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b1b3f-2a56-40c4-851e-7ddf8fc27817 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:59:25.215002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1140/2266] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:59:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:59:29.531082 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=84,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:59:32.056681 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f6e40-f7cd-4ea6-aa34-73b479478cfa None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:59:32.057283 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f6e40-f7cd-4ea6-aa34-73b479478cfa None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:59:32.057283 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f6e40-f7cd-4ea6-aa34-73b479478cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:59:32.076552 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-6f1f6e40-f7cd-4ea6-aa34-73b479478cfa None None] MFA Rules not processed for user `abd380b05ae94a29bdf56c529f1d411e`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:59:32.077759 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-6f1f6e40-f7cd-4ea6-aa34-73b479478cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:59:32.085350 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1127/2267] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:59:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:59:32.644023 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b1b3f-2a56-40c4-851e-7ddf8fc27817 service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:59:32.645442 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-096b1b3f-2a56-40c4-851e-7ddf8fc27817 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:59:32.705082 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b1b3f-2a56-40c4-851e-7ddf8fc27817 service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:59:32.708567 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb1da5-6a06-41e4-881f-be57fea66d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:59:32.709196 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb1da5-6a06-41e4-881f-be57fea66d90 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:59:32.709478 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb1da5-6a06-41e4-881f-be57fea66d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:59:32.709755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb1da5-6a06-41e4-881f-be57fea66d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:59:32.711818 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f1fb1da5-6a06-41e4-881f-be57fea66d90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:59:32.722540 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb1da5-6a06-41e4-881f-be57fea66d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:59:32.723967 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb1da5-6a06-41e4-881f-be57fea66d90 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:59:32.732165 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1141/2268] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:59:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:59:33.047988 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f6e40-f7cd-4ea6-aa34-73b479478cfa None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:59:33.049774 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-6f1f6e40-f7cd-4ea6-aa34-73b479478cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:59:33.130370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f6e40-f7cd-4ea6-aa34-73b479478cfa None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:59:33.135567 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c200e3f-2f04-46dc-a5a6-09feb8f83644 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17a40bea6ba41f19c88e16f9b15cf27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:59:33.136216 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c200e3f-2f04-46dc-a5a6-09feb8f83644 service placement] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:59:33.136502 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c200e3f-2f04-46dc-a5a6-09feb8f83644 service placement] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:59:33.136782 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c200e3f-2f04-46dc-a5a6-09feb8f83644 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:59:33.138669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3c200e3f-2f04-46dc-a5a6-09feb8f83644 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:59:33.151115 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c200e3f-2f04-46dc-a5a6-09feb8f83644 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:59:33.152707 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c200e3f-2f04-46dc-a5a6-09feb8f83644 service placement] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:59:33.163436 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1128/2269] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:59:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:59:33.736363 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb1da5-6a06-41e4-881f-be57fea66d90 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:59:33.737995 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f1fb1da5-6a06-41e4-881f-be57fea66d90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:59:33.796966 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:59:33.817081 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb1da5-6a06-41e4-881f-be57fea66d90 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:59:33.822520 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bd0e1-4c13-49db-a905-c7473b471e69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:59:33.823163 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bd0e1-4c13-49db-a905-c7473b471e69 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:59:33.823445 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bd0e1-4c13-49db-a905-c7473b471e69 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:59:33.823767 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bd0e1-4c13-49db-a905-c7473b471e69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:59:33.825734 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-5f5bd0e1-4c13-49db-a905-c7473b471e69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:59:33.885871 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bd0e1-4c13-49db-a905-c7473b471e69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:59:33.887816 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bd0e1-4c13-49db-a905-c7473b471e69 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:59:33.897382 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1142/2270] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:59:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 05:59:42.139223 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c200e3f-2f04-46dc-a5a6-09feb8f83644 service placement] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:59:42.141208 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3c200e3f-2f04-46dc-a5a6-09feb8f83644 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:59:42.152900 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c200e3f-2f04-46dc-a5a6-09feb8f83644 service placement] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:59:42.157184 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02eee7-c24d-4924-aec8-50b33d014ee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:59:42.157822 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02eee7-c24d-4924-aec8-50b33d014ee5 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:59:42.158274 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02eee7-c24d-4924-aec8-50b33d014ee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:59:42.158406 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02eee7-c24d-4924-aec8-50b33d014ee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:59:42.160199 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-bf02eee7-c24d-4924-aec8-50b33d014ee5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:59:42.169731 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02eee7-c24d-4924-aec8-50b33d014ee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:59:42.171189 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02eee7-c24d-4924-aec8-50b33d014ee5 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:59:42.179215 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1129/2271] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:59:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:59:43.893049 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=30 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:59:45.882679 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bd0e1-4c13-49db-a905-c7473b471e69 service nova] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:59:45.896440 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bd0e1-4c13-49db-a905-c7473b471e69 service nova] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:59:45.904946 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af1687-04bd-4ef2-b634-64193e9c506a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:59:45.906604 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af1687-04bd-4ef2-b634-64193e9c506a service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:59:45.907212 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af1687-04bd-4ef2-b634-64193e9c506a service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:59:45.907569 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af1687-04bd-4ef2-b634-64193e9c506a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:59:45.909869 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-57af1687-04bd-4ef2-b634-64193e9c506a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:59:45.926996 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af1687-04bd-4ef2-b634-64193e9c506a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:59:45.928828 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af1687-04bd-4ef2-b634-64193e9c506a service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:59:45.941758 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1143/2272] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:59:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:59:47.196489 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049b8cb-cc52-464e-b7d5-a5706a2ab2ed None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:59:47.197045 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049b8cb-cc52-464e-b7d5-a5706a2ab2ed None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:59:47.197045 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049b8cb-cc52-464e-b7d5-a5706a2ab2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:59:47.214408 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-4049b8cb-cc52-464e-b7d5-a5706a2ab2ed None None] MFA Rules not processed for user `f4cd1d7c5a4a4b658f7abf8e434cf716`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 05:59:47.215601 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-4049b8cb-cc52-464e-b7d5-a5706a2ab2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:59:47.222704 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1130/2273] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 05:59:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 05:59:47.530050 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af1687-04bd-4ef2-b634-64193e9c506a service nova] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:59:47.539459 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af1687-04bd-4ef2-b634-64193e9c506a service nova] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:59:47.543169 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897ca1c-7e3b-4ffb-96e0-c6d5c8f6315f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:59:47.543811 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897ca1c-7e3b-4ffb-96e0-c6d5c8f6315f service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:59:47.544097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897ca1c-7e3b-4ffb-96e0-c6d5c8f6315f service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:59:47.544376 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897ca1c-7e3b-4ffb-96e0-c6d5c8f6315f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:59:47.546211 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1897ca1c-7e3b-4ffb-96e0-c6d5c8f6315f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:59:47.557343 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897ca1c-7e3b-4ffb-96e0-c6d5c8f6315f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:59:47.558808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897ca1c-7e3b-4ffb-96e0-c6d5c8f6315f service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:59:47.567579 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1144/2274] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:59:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 05:59:57.209125 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=44 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:59:57.564205 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=12 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:59:58.401805 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049b8cb-cc52-464e-b7d5-a5706a2ab2ed None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 05:59:58.403329 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-4049b8cb-cc52-464e-b7d5-a5706a2ab2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:59:58.419895 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049b8cb-cc52-464e-b7d5-a5706a2ab2ed None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 05:59:58.426094 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93896a0-0db5-43c5-8491-2fe80708c1d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 05:59:58.426752 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93896a0-0db5-43c5-8491-2fe80708c1d8 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 05:59:58.427032 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93896a0-0db5-43c5-8491-2fe80708c1d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 05:59:58.427317 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93896a0-0db5-43c5-8491-2fe80708c1d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 05:59:58.429160 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e93896a0-0db5-43c5-8491-2fe80708c1d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 05:59:58.442069 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93896a0-0db5-43c5-8491-2fe80708c1d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 05:59:58.443689 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93896a0-0db5-43c5-8491-2fe80708c1d8 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 05:59:58.456299 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1131/2275] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 05:59:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:00:08.450280 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=6 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:18.877124 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897ca1c-7e3b-4ffb-96e0-c6d5c8f6315f service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:18.891745 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897ca1c-7e3b-4ffb-96e0-c6d5c8f6315f service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:18.896831 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137dd75c-2435-42ca-9305-e74f93cefb1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:18.897495 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137dd75c-2435-42ca-9305-e74f93cefb1d service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:18.897777 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137dd75c-2435-42ca-9305-e74f93cefb1d service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:18.898094 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137dd75c-2435-42ca-9305-e74f93cefb1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:18.899882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-137dd75c-2435-42ca-9305-e74f93cefb1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:18.913200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137dd75c-2435-42ca-9305-e74f93cefb1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:18.914832 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137dd75c-2435-42ca-9305-e74f93cefb1d service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:18.926928 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1145/2276] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:00:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:00:20.360072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85c749-b2db-4901-bc55-fb1f719e6368 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:20.360862 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85c749-b2db-4901-bc55-fb1f719e6368 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:20.361151 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85c749-b2db-4901-bc55-fb1f719e6368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:20.381506 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-9e85c749-b2db-4901-bc55-fb1f719e6368 None None] MFA Rules not processed for user `af8e0eb5ff8c40ae848929780d99e72d`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:00:20.382745 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-9e85c749-b2db-4901-bc55-fb1f719e6368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:20.449125 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1132/2277] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jun 21 06:00:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:00:20.500233 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137dd75c-2435-42ca-9305-e74f93cefb1d service nova] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:20.502253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-137dd75c-2435-42ca-9305-e74f93cefb1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:20.589040 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137dd75c-2435-42ca-9305-e74f93cefb1d service nova] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:20.595215 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ade11e-eff0-4491-8c3b-fbd949642465 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac485a336d8b4360bce4f495bd02dbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:20.595888 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ade11e-eff0-4491-8c3b-fbd949642465 service swift] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:20.596174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ade11e-eff0-4491-8c3b-fbd949642465 service swift] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:20.596454 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ade11e-eff0-4491-8c3b-fbd949642465 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:20.605502 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ade11e-eff0-4491-8c3b-fbd949642465 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:20.607705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ade11e-eff0-4491-8c3b-fbd949642465 service swift] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:20.616329 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1146/2278] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 21 06:00:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 06:00:22.204574 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85c749-b2db-4901-bc55-fb1f719e6368 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:22.218021 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85c749-b2db-4901-bc55-fb1f719e6368 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:22.221788 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc16c1f-8248-4517-95d5-4f2feb8db1c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:22.222482 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc16c1f-8248-4517-95d5-4f2feb8db1c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:22.222938 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc16c1f-8248-4517-95d5-4f2feb8db1c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:22.223225 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc16c1f-8248-4517-95d5-4f2feb8db1c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:22.225067 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-bcc16c1f-8248-4517-95d5-4f2feb8db1c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:22.329382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc16c1f-8248-4517-95d5-4f2feb8db1c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:22.334995 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc16c1f-8248-4517-95d5-4f2feb8db1c9 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:22.352177 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1133/2279] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:00:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:00:26.607779 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ade11e-eff0-4491-8c3b-fbd949642465 service swift] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:26.610224 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c1ade11e-eff0-4491-8c3b-fbd949642465 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:26.628673 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ade11e-eff0-4491-8c3b-fbd949642465 service swift] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:26.634411 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53f75e-f7d1-43cf-a2d1-98a4e5da9349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:26.637952 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53f75e-f7d1-43cf-a2d1-98a4e5da9349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:26.637952 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53f75e-f7d1-43cf-a2d1-98a4e5da9349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:26.637952 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53f75e-f7d1-43cf-a2d1-98a4e5da9349 admin admin] PATH_INFO: `/v3/users/f2d23615fd6349e1b70fdbad64b89b78` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:26.637952 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53f75e-f7d1-43cf-a2d1-98a4e5da9349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2d23615fd6349e1b70fdbad64b89b78)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:26.640821 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53f75e-f7d1-43cf-a2d1-98a4e5da9349 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:26.701980 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0c53f75e-f7d1-43cf-a2d1-98a4e5da9349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2d23615fd6349e1b70fdbad64b89b78'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:26.709808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0c53f75e-f7d1-43cf-a2d1-98a4e5da9349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2d23615fd6349e1b70fdbad64b89b78'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:26.710564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0c53f75e-f7d1-43cf-a2d1-98a4e5da9349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2d23615fd6349e1b70fdbad64b89b78'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:26.725735 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0c53f75e-f7d1-43cf-a2d1-98a4e5da9349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2d23615fd6349e1b70fdbad64b89b78'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:26.741601 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0c53f75e-f7d1-43cf-a2d1-98a4e5da9349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2d23615fd6349e1b70fdbad64b89b78'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:26.750545 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1147/2280] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:00:26 2022] DELETE /identity/v3/users/f2d23615fd6349e1b70fdbad64b89b78 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:00:26.989953 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc16c1f-8248-4517-95d5-4f2feb8db1c9 service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:27.004434 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc16c1f-8248-4517-95d5-4f2feb8db1c9 service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:27.115079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea81076-3a91-4d17-8aa7-7a469c92169b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:27.116563 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea81076-3a91-4d17-8aa7-7a469c92169b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:27.117063 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea81076-3a91-4d17-8aa7-7a469c92169b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:27.117505 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea81076-3a91-4d17-8aa7-7a469c92169b admin admin] PATH_INFO: `/v3/projects/7050c81c7efe4c0199573adc5687e9c0` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:27.119889 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea81076-3a91-4d17-8aa7-7a469c92169b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7050c81c7efe4c0199573adc5687e9c0)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:27.123524 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea81076-3a91-4d17-8aa7-7a469c92169b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:27.179554 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:27.187187 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-aea81076-3a91-4d17-8aa7-7a469c92169b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7050c81c7efe4c0199573adc5687e9c0', 'request_id': 'req-aea81076-3a91-4d17-8aa7-7a469c92169b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:27.199540 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-aea81076-3a91-4d17-8aa7-7a469c92169b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7050c81c7efe4c0199573adc5687e9c0', 'request_id': 'req-aea81076-3a91-4d17-8aa7-7a469c92169b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:27.208311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-aea81076-3a91-4d17-8aa7-7a469c92169b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7050c81c7efe4c0199573adc5687e9c0', 'request_id': 'req-aea81076-3a91-4d17-8aa7-7a469c92169b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:27.226717 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-aea81076-3a91-4d17-8aa7-7a469c92169b admin admin] The token cache is being invalidate because project 7050c81c7efe4c0199573adc5687e9c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:00:27.227246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-aea81076-3a91-4d17-8aa7-7a469c92169b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:27.227989 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-aea81076-3a91-4d17-8aa7-7a469c92169b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:27.230305 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1134/2281] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:00:26 2022] DELETE /identity/v3/projects/7050c81c7efe4c0199573adc5687e9c0 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:00:27.235747 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305c762-1d71-4ffd-92cb-663066ecbee8 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:27.235939 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305c762-1d71-4ffd-92cb-663066ecbee8 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:27.236227 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305c762-1d71-4ffd-92cb-663066ecbee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:27.255846 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-a305c762-1d71-4ffd-92cb-663066ecbee8 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:00:27.257093 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a305c762-1d71-4ffd-92cb-663066ecbee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:27.312701 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:27.334817 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1148/2282] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:00:27.345183 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11405147-5978-4b5d-be66-9a53580314ec None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:27.345542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11405147-5978-4b5d-be66-9a53580314ec None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:27.345900 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11405147-5978-4b5d-be66-9a53580314ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:27.369247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-11405147-5978-4b5d-be66-9a53580314ec None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:00:27.371410 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-11405147-5978-4b5d-be66-9a53580314ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:27.387116 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1135/2283] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:00:27.387830 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305c762-1d71-4ffd-92cb-663066ecbee8 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:27.401140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305c762-1d71-4ffd-92cb-663066ecbee8 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:27.406399 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf37eb1-9d1a-4df5-a029-39a4f571dad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:27.407103 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf37eb1-9d1a-4df5-a029-39a4f571dad9 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:27.407395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf37eb1-9d1a-4df5-a029-39a4f571dad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:27.407703 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf37eb1-9d1a-4df5-a029-39a4f571dad9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:27.408615 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf37eb1-9d1a-4df5-a029-39a4f571dad9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 06:00:27.409171 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf37eb1-9d1a-4df5-a029-39a4f571dad9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:27.413332 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf37eb1-9d1a-4df5-a029-39a4f571dad9 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:27.432608 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1149/2284] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 06:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 06:00:27.433523 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11405147-5978-4b5d-be66-9a53580314ec None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:27.445622 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11405147-5978-4b5d-be66-9a53580314ec None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:27.452884 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324f314-6f1b-40dc-88fc-0a0291f63c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:27.453638 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324f314-6f1b-40dc-88fc-0a0291f63c1f admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:27.453945 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324f314-6f1b-40dc-88fc-0a0291f63c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:27.454240 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324f314-6f1b-40dc-88fc-0a0291f63c1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:27.454956 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324f314-6f1b-40dc-88fc-0a0291f63c1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:27.456930 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324f314-6f1b-40dc-88fc-0a0291f63c1f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:27.509205 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1136/2285] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:00:27 2022] POST /identity/v3/projects => generated 381 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 06:00:27.513625 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf37eb1-9d1a-4df5-a029-39a4f571dad9 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:27.527374 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf37eb1-9d1a-4df5-a029-39a4f571dad9 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:27.606212 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c893e-1265-456c-b16b-3ae31be1048d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:27.607621 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c893e-1265-456c-b16b-3ae31be1048d admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:27.608108 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c893e-1265-456c-b16b-3ae31be1048d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:27.608691 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c893e-1265-456c-b16b-3ae31be1048d admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:27.610248 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c893e-1265-456c-b16b-3ae31be1048d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:27.612807 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c893e-1265-456c-b16b-3ae31be1048d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:27.647878 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1150/2286] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:00:27 2022] POST /identity/v3/users => generated 291 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:00:27.653038 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324f314-6f1b-40dc-88fc-0a0291f63c1f admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:27.668805 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324f314-6f1b-40dc-88fc-0a0291f63c1f admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:27.676091 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058fb24-c4bc-49e8-b6e8-2da68cc24982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:27.677110 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058fb24-c4bc-49e8-b6e8-2da68cc24982 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:27.677736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058fb24-c4bc-49e8-b6e8-2da68cc24982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:27.678511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058fb24-c4bc-49e8-b6e8-2da68cc24982 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:27.679746 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058fb24-c4bc-49e8-b6e8-2da68cc24982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:27.682626 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058fb24-c4bc-49e8-b6e8-2da68cc24982 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:27.694299 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1137/2287] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:00:27.698485 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c893e-1265-456c-b16b-3ae31be1048d admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:27.710172 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c893e-1265-456c-b16b-3ae31be1048d admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:27.715842 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262404b-cd15-4b98-b343-c4a7ba9b9da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:27.716690 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262404b-cd15-4b98-b343-c4a7ba9b9da6 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:27.717058 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262404b-cd15-4b98-b343-c4a7ba9b9da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:27.717387 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262404b-cd15-4b98-b343-c4a7ba9b9da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:27.718249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262404b-cd15-4b98-b343-c4a7ba9b9da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:27.722128 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262404b-cd15-4b98-b343-c4a7ba9b9da6 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:27.738407 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1151/2288] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:00:27.742910 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058fb24-c4bc-49e8-b6e8-2da68cc24982 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:27.754485 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058fb24-c4bc-49e8-b6e8-2da68cc24982 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:27.762004 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48d7da-2e7c-4fe0-8302-0041b5a89693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:27.762848 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48d7da-2e7c-4fe0-8302-0041b5a89693 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:27.763128 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48d7da-2e7c-4fe0-8302-0041b5a89693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:27.763405 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48d7da-2e7c-4fe0-8302-0041b5a89693 admin admin] PATH_INFO: `/v3/projects/bb8d47163b2540aa8b356cb12c97a34b/users/6d095039c76a4d8f94893c37866d4c0f/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:27.783053 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48d7da-2e7c-4fe0-8302-0041b5a89693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb8d47163b2540aa8b356cb12c97a34b, user_id=6d095039c76a4d8f94893c37866d4c0f, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:27.786212 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48d7da-2e7c-4fe0-8302-0041b5a89693 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:27.814659 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1138/2289] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:00:27 2022] PUT /identity/v3/projects/bb8d47163b2540aa8b356cb12c97a34b/users/6d095039c76a4d8f94893c37866d4c0f/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:00:27.819099 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83caa96-49b7-4aea-966b-8d7c17b0a9be None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:27.819099 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83caa96-49b7-4aea-966b-8d7c17b0a9be None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:27.819099 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83caa96-49b7-4aea-966b-8d7c17b0a9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:27.859397 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-d83caa96-49b7-4aea-966b-8d7c17b0a9be None None] MFA Rules not processed for user `6d095039c76a4d8f94893c37866d4c0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:00:27.860661 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d83caa96-49b7-4aea-966b-8d7c17b0a9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:27.971028 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1152/2290] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:00:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:00:27.975329 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48d7da-2e7c-4fe0-8302-0041b5a89693 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:28.072686 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48d7da-2e7c-4fe0-8302-0041b5a89693 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:28.077873 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94923f1b-5f0f-4fe8-b6c6-8514b2132999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:28.078496 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94923f1b-5f0f-4fe8-b6c6-8514b2132999 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:28.078961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94923f1b-5f0f-4fe8-b6c6-8514b2132999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:28.079245 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94923f1b-5f0f-4fe8-b6c6-8514b2132999 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:28.080108 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94923f1b-5f0f-4fe8-b6c6-8514b2132999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:28.082431 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94923f1b-5f0f-4fe8-b6c6-8514b2132999 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:28.124778 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1139/2291] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:00:27 2022] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:00:28.128194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83caa96-49b7-4aea-966b-8d7c17b0a9be None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:28.143273 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83caa96-49b7-4aea-966b-8d7c17b0a9be None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:28.197446 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:28.218456 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e800c50-bd53-4db4-9861-52db9aed8e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:28.219497 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e800c50-bd53-4db4-9861-52db9aed8e2b admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:28.219961 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e800c50-bd53-4db4-9861-52db9aed8e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:28.220392 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e800c50-bd53-4db4-9861-52db9aed8e2b admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:28.221494 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e800c50-bd53-4db4-9861-52db9aed8e2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:28.223456 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e800c50-bd53-4db4-9861-52db9aed8e2b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:28.249127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1153/2292] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:00:28 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:00:28.253277 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94923f1b-5f0f-4fe8-b6c6-8514b2132999 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:28.266291 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94923f1b-5f0f-4fe8-b6c6-8514b2132999 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:28.272597 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabb6a1-523c-41e0-8f9f-8f42996b36cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:28.273404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabb6a1-523c-41e0-8f9f-8f42996b36cc admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:28.273818 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabb6a1-523c-41e0-8f9f-8f42996b36cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:28.274234 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabb6a1-523c-41e0-8f9f-8f42996b36cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:28.275060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cabb6a1-523c-41e0-8f9f-8f42996b36cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:28.276770 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cabb6a1-523c-41e0-8f9f-8f42996b36cc admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:28.292283 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1140/2293] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:00:28.298595 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e800c50-bd53-4db4-9861-52db9aed8e2b admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:28.310020 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e800c50-bd53-4db4-9861-52db9aed8e2b admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:28.315342 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee115a-ba49-4c59-bdcd-a1907a6230ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:28.316393 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee115a-ba49-4c59-bdcd-a1907a6230ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:28.316795 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee115a-ba49-4c59-bdcd-a1907a6230ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:28.317169 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee115a-ba49-4c59-bdcd-a1907a6230ba admin admin] PATH_INFO: `/v3/projects/1f9be275192e41f5ac759e3d5025b900/users/166d28328c094e65937b68a04a21533c/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:28.334079 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee115a-ba49-4c59-bdcd-a1907a6230ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f9be275192e41f5ac759e3d5025b900, user_id=166d28328c094e65937b68a04a21533c, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:28.336661 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee115a-ba49-4c59-bdcd-a1907a6230ba admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:28.354035 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1154/2294] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:00:28 2022] PUT /identity/v3/projects/1f9be275192e41f5ac759e3d5025b900/users/166d28328c094e65937b68a04a21533c/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:00:28.358618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabb6a1-523c-41e0-8f9f-8f42996b36cc admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:28.369748 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabb6a1-523c-41e0-8f9f-8f42996b36cc admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:28.403184 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:28.443469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1655b-adc6-4e2f-8add-c94affa55f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:28.444283 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1655b-adc6-4e2f-8add-c94affa55f6f admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:28.444661 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1655b-adc6-4e2f-8add-c94affa55f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:28.444936 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1655b-adc6-4e2f-8add-c94affa55f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:28.445691 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1655b-adc6-4e2f-8add-c94affa55f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:28.447357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1655b-adc6-4e2f-8add-c94affa55f6f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:28.462395 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1141/2295] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:00:28.467877 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee115a-ba49-4c59-bdcd-a1907a6230ba admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:28.479135 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee115a-ba49-4c59-bdcd-a1907a6230ba admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:28.490295 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be01c07-93d9-4922-8397-35c53b6b8ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:28.491521 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be01c07-93d9-4922-8397-35c53b6b8ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:28.491809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be01c07-93d9-4922-8397-35c53b6b8ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:28.492091 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be01c07-93d9-4922-8397-35c53b6b8ca7 admin admin] PATH_INFO: `/v3/projects/1f9be275192e41f5ac759e3d5025b900/users/166d28328c094e65937b68a04a21533c/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:28.494219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be01c07-93d9-4922-8397-35c53b6b8ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f9be275192e41f5ac759e3d5025b900, user_id=166d28328c094e65937b68a04a21533c, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:28.496939 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be01c07-93d9-4922-8397-35c53b6b8ca7 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:28.508955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1155/2296] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:00:28 2022] PUT /identity/v3/projects/1f9be275192e41f5ac759e3d5025b900/users/166d28328c094e65937b68a04a21533c/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:00:28.520837 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fda03d-2c1b-43b0-a563-d7a94097d918 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:28.521042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fda03d-2c1b-43b0-a563-d7a94097d918 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:28.521316 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fda03d-2c1b-43b0-a563-d7a94097d918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:28.554815 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-d0fda03d-2c1b-43b0-a563-d7a94097d918 None None] MFA Rules not processed for user `166d28328c094e65937b68a04a21533c`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:00:28.556184 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d0fda03d-2c1b-43b0-a563-d7a94097d918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:28.642908 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1142/2297] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:00:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:00:28.655103 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be01c07-93d9-4922-8397-35c53b6b8ca7 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:28.656947 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-2be01c07-93d9-4922-8397-35c53b6b8ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:28.735415 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be01c07-93d9-4922-8397-35c53b6b8ca7 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:28.739385 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4e961-308c-44d7-9413-f260cb4c7d50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:28.740050 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4e961-308c-44d7-9413-f260cb4c7d50 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:28.740335 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4e961-308c-44d7-9413-f260cb4c7d50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:28.740633 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4e961-308c-44d7-9413-f260cb4c7d50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:28.750883 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4e961-308c-44d7-9413-f260cb4c7d50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:28.752347 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4e961-308c-44d7-9413-f260cb4c7d50 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:28.774167 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1156/2298] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:00:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:00:28.859324 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fda03d-2c1b-43b0-a563-d7a94097d918 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:28.871637 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fda03d-2c1b-43b0-a563-d7a94097d918 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:28.876354 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abdfee-0fd5-44b2-86b2-d9538d39f330 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:28.880221 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abdfee-0fd5-44b2-86b2-d9538d39f330 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:28.880532 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abdfee-0fd5-44b2-86b2-d9538d39f330 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:28.880816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abdfee-0fd5-44b2-86b2-d9538d39f330 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:28.969159 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abdfee-0fd5-44b2-86b2-d9538d39f330 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:28.970652 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abdfee-0fd5-44b2-86b2-d9538d39f330 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:28.985098 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1143/2299] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:00:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:00:36.133114 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b6625-e0bb-4f53-bc08-d2b7b9770dd4 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:36.133754 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b6625-e0bb-4f53-bc08-d2b7b9770dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:36.133754 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b6625-e0bb-4f53-bc08-d2b7b9770dd4 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:36.136254 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1157/2300] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jun 21 06:00:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 06:00:36.144331 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7213c9-7236-4472-b317-1edade0b8bb1 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:36.144894 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7213c9-7236-4472-b317-1edade0b8bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:36.145300 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7213c9-7236-4472-b317-1edade0b8bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:36.168665 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-df7213c9-7236-4472-b317-1edade0b8bb1 None None] MFA Rules not processed for user `f702830987ba4548a4c2ee3d0e302d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:00:36.169906 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-df7213c9-7236-4472-b317-1edade0b8bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:36.219141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:36.242382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1144/2301] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jun 21 06:00:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:00:36.254074 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b6625-e0bb-4f53-bc08-d2b7b9770dd4 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:36.256009 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-382b6625-e0bb-4f53-bc08-d2b7b9770dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:36.315033 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b6625-e0bb-4f53-bc08-d2b7b9770dd4 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:36.318554 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada457c0-b16c-4a83-a93b-d0de0b88f12c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44776834b134ae98fa28d4741cc4ec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:36.319202 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada457c0-b16c-4a83-a93b-d0de0b88f12c service glance] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:36.319487 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada457c0-b16c-4a83-a93b-d0de0b88f12c service glance] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:36.319765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada457c0-b16c-4a83-a93b-d0de0b88f12c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:36.330444 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada457c0-b16c-4a83-a93b-d0de0b88f12c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:36.331872 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada457c0-b16c-4a83-a93b-d0de0b88f12c service glance] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:36.342764 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1158/2302] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:00:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:00:36.410116 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4646484-38dc-44a4-aab5-47cf2c78c6ee None None] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:36.410413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4646484-38dc-44a4-aab5-47cf2c78c6ee None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:36.410694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4646484-38dc-44a4-aab5-47cf2c78c6ee None None] PATH_INFO: `/` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:36.412137 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1145/2303] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jun 21 06:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 06:00:36.417011 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ee017-75a5-4f0e-8ee3-afc2f54906d9 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:36.417522 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ee017-75a5-4f0e-8ee3-afc2f54906d9 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:36.417900 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ee017-75a5-4f0e-8ee3-afc2f54906d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:36.436751 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-0e7ee017-75a5-4f0e-8ee3-afc2f54906d9 None None] MFA Rules not processed for user `51e845d0dc2c4a1fa612556c1aa73ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:00:36.438032 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0e7ee017-75a5-4f0e-8ee3-afc2f54906d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:36.477280 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:36.491486 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1159/2304] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jun 21 06:00:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:00:36.503781 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4646484-38dc-44a4-aab5-47cf2c78c6ee None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:36.505474 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a4646484-38dc-44a4-aab5-47cf2c78c6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:36.519085 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4646484-38dc-44a4-aab5-47cf2c78c6ee None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:36.522586 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d4525-8f6e-4ede-a642-d2361c51c631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:36.523210 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d4525-8f6e-4ede-a642-d2361c51c631 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:36.523489 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d4525-8f6e-4ede-a642-d2361c51c631 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:36.523759 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d4525-8f6e-4ede-a642-d2361c51c631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:36.532142 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d4525-8f6e-4ede-a642-d2361c51c631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:36.534059 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d4525-8f6e-4ede-a642-d2361c51c631 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:36.542762 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1146/2305] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:00:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:00:36.636091 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744d009-d25f-432e-aa28-de256aa74870 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:36.636388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744d009-d25f-432e-aa28-de256aa74870 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:36.636675 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744d009-d25f-432e-aa28-de256aa74870 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:36.638821 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1160/2306] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jun 21 06:00:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 06:00:36.644643 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7338cd8-8a28-4f4b-bd89-f2d67e991263 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:36.644933 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7338cd8-8a28-4f4b-bd89-f2d67e991263 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:36.645210 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7338cd8-8a28-4f4b-bd89-f2d67e991263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:36.663691 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-a7338cd8-8a28-4f4b-bd89-f2d67e991263 None None] MFA Rules not processed for user `f702830987ba4548a4c2ee3d0e302d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:00:36.665056 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a7338cd8-8a28-4f4b-bd89-f2d67e991263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:36.675283 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1147/2307] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jun 21 06:00:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:00:36.686862 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744d009-d25f-432e-aa28-de256aa74870 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:36.689013 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3744d009-d25f-432e-aa28-de256aa74870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:36.701675 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744d009-d25f-432e-aa28-de256aa74870 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:36.705197 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcae0ef-8363-43b7-b338-20e8b5c47194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:36.705841 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcae0ef-8363-43b7-b338-20e8b5c47194 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:36.706155 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcae0ef-8363-43b7-b338-20e8b5c47194 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:36.706435 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcae0ef-8363-43b7-b338-20e8b5c47194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:36.717229 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcae0ef-8363-43b7-b338-20e8b5c47194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:36.718951 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcae0ef-8363-43b7-b338-20e8b5c47194 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:36.731980 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1161/2308] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:00:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:00:38.169785 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7338cd8-8a28-4f4b-bd89-f2d67e991263 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:38.233774 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7338cd8-8a28-4f4b-bd89-f2d67e991263 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:38.238427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057b462-7984-4bc4-91f5-e8e79bfcd443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:38.239521 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057b462-7984-4bc4-91f5-e8e79bfcd443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:38.239813 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057b462-7984-4bc4-91f5-e8e79bfcd443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:38.240122 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057b462-7984-4bc4-91f5-e8e79bfcd443 admin admin] PATH_INFO: `/v3/users/6d095039c76a4d8f94893c37866d4c0f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:38.241429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057b462-7984-4bc4-91f5-e8e79bfcd443 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d095039c76a4d8f94893c37866d4c0f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:38.243608 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057b462-7984-4bc4-91f5-e8e79bfcd443 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:38.294167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f057b462-7984-4bc4-91f5-e8e79bfcd443 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d095039c76a4d8f94893c37866d4c0f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:38.302692 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f057b462-7984-4bc4-91f5-e8e79bfcd443 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d095039c76a4d8f94893c37866d4c0f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:38.303339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f057b462-7984-4bc4-91f5-e8e79bfcd443 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d095039c76a4d8f94893c37866d4c0f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:38.303950 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f057b462-7984-4bc4-91f5-e8e79bfcd443 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d095039c76a4d8f94893c37866d4c0f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:38.317073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f057b462-7984-4bc4-91f5-e8e79bfcd443 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d095039c76a4d8f94893c37866d4c0f'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:38.331028 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1148/2309] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:00:38 2022] DELETE /identity/v3/users/6d095039c76a4d8f94893c37866d4c0f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:00:38.335592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95f020-ff38-434d-99f9-ecbb15963657 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:38.336212 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95f020-ff38-434d-99f9-ecbb15963657 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:38.336403 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95f020-ff38-434d-99f9-ecbb15963657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:38.357568 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-1a95f020-ff38-434d-99f9-ecbb15963657 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:00:38.359058 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1a95f020-ff38-434d-99f9-ecbb15963657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:38.397469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40025c11-000f-4b47-b65f-42bd51d66be4 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:38.398931 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40025c11-000f-4b47-b65f-42bd51d66be4 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:38.399231 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40025c11-000f-4b47-b65f-42bd51d66be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:38.420861 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-40025c11-000f-4b47-b65f-42bd51d66be4 None None] MFA Rules not processed for user `af8e0eb5ff8c40ae848929780d99e72d`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:00:38.422117 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-40025c11-000f-4b47-b65f-42bd51d66be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:38.435793 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1162/2310] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:00:38.446637 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95f020-ff38-434d-99f9-ecbb15963657 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:38.448027 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1a95f020-ff38-434d-99f9-ecbb15963657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:38.474920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:38.499869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1149/2311] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jun 21 06:00:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:00:38.516311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40025c11-000f-4b47-b65f-42bd51d66be4 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:38.522726 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-40025c11-000f-4b47-b65f-42bd51d66be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:38.547149 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95f020-ff38-434d-99f9-ecbb15963657 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:38.552461 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e93df-45b7-4cdb-aa2b-320c3e135989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:38.553275 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e93df-45b7-4cdb-aa2b-320c3e135989 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:38.553559 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e93df-45b7-4cdb-aa2b-320c3e135989 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:38.553836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e93df-45b7-4cdb-aa2b-320c3e135989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:38.565244 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e93df-45b7-4cdb-aa2b-320c3e135989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:38.566716 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e93df-45b7-4cdb-aa2b-320c3e135989 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:38.579835 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1163/2312] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:00:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:00:38.615057 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40025c11-000f-4b47-b65f-42bd51d66be4 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:38.620934 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f45f0-1d3d-4b8e-a75d-94122bd2face service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac485a336d8b4360bce4f495bd02dbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:38.622190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f45f0-1d3d-4b8e-a75d-94122bd2face service swift] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:38.622482 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f45f0-1d3d-4b8e-a75d-94122bd2face service swift] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:38.622768 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f45f0-1d3d-4b8e-a75d-94122bd2face service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:38.633014 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f45f0-1d3d-4b8e-a75d-94122bd2face service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:38.634812 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f45f0-1d3d-4b8e-a75d-94122bd2face service swift] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:38.645261 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1150/2313] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 21 06:00:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 06:00:39.052428 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e93df-45b7-4cdb-aa2b-320c3e135989 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:39.053094 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-711e93df-45b7-4cdb-aa2b-320c3e135989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:39.075759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e93df-45b7-4cdb-aa2b-320c3e135989 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:39.098553 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8156b2d-2ca6-4c72-860b-43956d43e3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:39.100752 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8156b2d-2ca6-4c72-860b-43956d43e3d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:39.105387 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8156b2d-2ca6-4c72-860b-43956d43e3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:39.105592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8156b2d-2ca6-4c72-860b-43956d43e3d2 admin admin] PATH_INFO: `/v3/projects/bb8d47163b2540aa8b356cb12c97a34b` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:39.111015 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8156b2d-2ca6-4c72-860b-43956d43e3d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb8d47163b2540aa8b356cb12c97a34b)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:39.113495 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8156b2d-2ca6-4c72-860b-43956d43e3d2 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:39.188941 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a8156b2d-2ca6-4c72-860b-43956d43e3d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb8d47163b2540aa8b356cb12c97a34b', 'request_id': 'req-a8156b2d-2ca6-4c72-860b-43956d43e3d2'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:39.195288 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a8156b2d-2ca6-4c72-860b-43956d43e3d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb8d47163b2540aa8b356cb12c97a34b', 'request_id': 'req-a8156b2d-2ca6-4c72-860b-43956d43e3d2'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:39.204127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a8156b2d-2ca6-4c72-860b-43956d43e3d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb8d47163b2540aa8b356cb12c97a34b', 'request_id': 'req-a8156b2d-2ca6-4c72-860b-43956d43e3d2'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:39.224015 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a8156b2d-2ca6-4c72-860b-43956d43e3d2 admin admin] The token cache is being invalidate because project bb8d47163b2540aa8b356cb12c97a34b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:00:39.224394 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a8156b2d-2ca6-4c72-860b-43956d43e3d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:39.224974 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a8156b2d-2ca6-4c72-860b-43956d43e3d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:39.226931 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1164/2314] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:00:39 2022] DELETE /identity/v3/projects/bb8d47163b2540aa8b356cb12c97a34b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:00:39.234462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f45f0-1d3d-4b8e-a75d-94122bd2face service swift] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:39.250344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f45f0-1d3d-4b8e-a75d-94122bd2face service swift] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:39.339291 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68ab07-7452-48f8-bc88-6af5524889cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:39.340399 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68ab07-7452-48f8-bc88-6af5524889cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:39.340693 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68ab07-7452-48f8-bc88-6af5524889cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:39.341056 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68ab07-7452-48f8-bc88-6af5524889cf admin admin] PATH_INFO: `/v3/users/166d28328c094e65937b68a04a21533c` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:39.342687 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68ab07-7452-48f8-bc88-6af5524889cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=166d28328c094e65937b68a04a21533c)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:39.344811 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68ab07-7452-48f8-bc88-6af5524889cf admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:39.408430 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4a68ab07-7452-48f8-bc88-6af5524889cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '166d28328c094e65937b68a04a21533c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:39.419545 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4a68ab07-7452-48f8-bc88-6af5524889cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '166d28328c094e65937b68a04a21533c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:39.420294 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4a68ab07-7452-48f8-bc88-6af5524889cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '166d28328c094e65937b68a04a21533c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:39.420969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4a68ab07-7452-48f8-bc88-6af5524889cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '166d28328c094e65937b68a04a21533c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:39.438039 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4a68ab07-7452-48f8-bc88-6af5524889cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '166d28328c094e65937b68a04a21533c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:39.444249 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:39.462549 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1151/2315] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:00:39 2022] DELETE /identity/v3/users/166d28328c094e65937b68a04a21533c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:00:40.244286 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8156b2d-2ca6-4c72-860b-43956d43e3d2 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:40.244961 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a8156b2d-2ca6-4c72-860b-43956d43e3d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:40.267289 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:40.273444 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8156b2d-2ca6-4c72-860b-43956d43e3d2 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:40.352342 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b3eb4-1579-47ba-a26e-4ebffe542a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:40.353231 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b3eb4-1579-47ba-a26e-4ebffe542a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:40.353510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b3eb4-1579-47ba-a26e-4ebffe542a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:40.353789 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b3eb4-1579-47ba-a26e-4ebffe542a26 admin admin] PATH_INFO: `/v3/projects/1f9be275192e41f5ac759e3d5025b900` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:40.355034 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b3eb4-1579-47ba-a26e-4ebffe542a26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f9be275192e41f5ac759e3d5025b900)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:40.357544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b3eb4-1579-47ba-a26e-4ebffe542a26 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:40.410411 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-908b3eb4-1579-47ba-a26e-4ebffe542a26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f9be275192e41f5ac759e3d5025b900', 'request_id': 'req-908b3eb4-1579-47ba-a26e-4ebffe542a26'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:40.417689 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-908b3eb4-1579-47ba-a26e-4ebffe542a26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f9be275192e41f5ac759e3d5025b900', 'request_id': 'req-908b3eb4-1579-47ba-a26e-4ebffe542a26'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:40.426483 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-908b3eb4-1579-47ba-a26e-4ebffe542a26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f9be275192e41f5ac759e3d5025b900', 'request_id': 'req-908b3eb4-1579-47ba-a26e-4ebffe542a26'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:40.440653 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-908b3eb4-1579-47ba-a26e-4ebffe542a26 admin admin] The token cache is being invalidate because project 1f9be275192e41f5ac759e3d5025b900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:00:40.440962 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-908b3eb4-1579-47ba-a26e-4ebffe542a26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:40.441648 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-908b3eb4-1579-47ba-a26e-4ebffe542a26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:40.443268 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1165/2316] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:00:40 2022] DELETE /identity/v3/projects/1f9be275192e41f5ac759e3d5025b900 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:00:40.448247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdaf7b-38ba-4dbd-98b1-f7b891f1be9d None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:40.448712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdaf7b-38ba-4dbd-98b1-f7b891f1be9d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:40.448892 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdaf7b-38ba-4dbd-98b1-f7b891f1be9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:40.469872 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-78fdaf7b-38ba-4dbd-98b1-f7b891f1be9d None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:00:40.471167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-78fdaf7b-38ba-4dbd-98b1-f7b891f1be9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:40.540979 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1152/2317] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:00:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:00:40.548825 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6d16b-a608-4906-a08e-119486ad8031 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:40.549175 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6d16b-a608-4906-a08e-119486ad8031 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:40.549508 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6d16b-a608-4906-a08e-119486ad8031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:40.570606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-c0a6d16b-a608-4906-a08e-119486ad8031 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:00:40.571868 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c0a6d16b-a608-4906-a08e-119486ad8031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:40.588103 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1166/2318] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:00:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:00:40.593209 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fdaf7b-38ba-4dbd-98b1-f7b891f1be9d None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:40.603234 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fdaf7b-38ba-4dbd-98b1-f7b891f1be9d None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:40.608112 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61684521-e8b7-477e-8265-40672978f388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:40.608778 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61684521-e8b7-477e-8265-40672978f388 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:40.609061 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61684521-e8b7-477e-8265-40672978f388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:40.609335 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61684521-e8b7-477e-8265-40672978f388 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:40.610099 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61684521-e8b7-477e-8265-40672978f388 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 06:00:40.610409 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61684521-e8b7-477e-8265-40672978f388 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:40.612025 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61684521-e8b7-477e-8265-40672978f388 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:40.625182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1153/2319] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 06:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 06:00:40.630659 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6d16b-a608-4906-a08e-119486ad8031 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:40.643495 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6d16b-a608-4906-a08e-119486ad8031 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:40.651702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e699a5-e4c5-466e-8470-a085e5cad56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:40.652482 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e699a5-e4c5-466e-8470-a085e5cad56a admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:40.653427 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e699a5-e4c5-466e-8470-a085e5cad56a admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:40.653912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e699a5-e4c5-466e-8470-a085e5cad56a admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:40.654802 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e699a5-e4c5-466e-8470-a085e5cad56a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:40.656852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e699a5-e4c5-466e-8470-a085e5cad56a admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:40.685161 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1167/2320] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:00:40 2022] POST /identity/v3/projects => generated 401 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:00:40.689643 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61684521-e8b7-477e-8265-40672978f388 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:40.701489 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61684521-e8b7-477e-8265-40672978f388 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:40.765725 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e5d73-3405-4660-8892-103a1a9ab13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:40.766767 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e5d73-3405-4660-8892-103a1a9ab13a admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:40.767217 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e5d73-3405-4660-8892-103a1a9ab13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:40.767681 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e5d73-3405-4660-8892-103a1a9ab13a admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:40.768576 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e5d73-3405-4660-8892-103a1a9ab13a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:40.770589 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e5d73-3405-4660-8892-103a1a9ab13a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:40.797805 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1154/2321] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:00:40 2022] POST /identity/v3/users => generated 301 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:00:40.799452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e699a5-e4c5-466e-8470-a085e5cad56a admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:40.811671 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e699a5-e4c5-466e-8470-a085e5cad56a admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:40.816647 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab7f1b-780f-4940-84a6-35d9c43b5a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:40.817330 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab7f1b-780f-4940-84a6-35d9c43b5a00 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:40.817615 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab7f1b-780f-4940-84a6-35d9c43b5a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:40.817894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab7f1b-780f-4940-84a6-35d9c43b5a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:40.818726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab7f1b-780f-4940-84a6-35d9c43b5a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:40.820327 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab7f1b-780f-4940-84a6-35d9c43b5a00 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:40.832865 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1168/2322] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:00:40.837013 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e5d73-3405-4660-8892-103a1a9ab13a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:40.848565 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e5d73-3405-4660-8892-103a1a9ab13a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:40.853374 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf059b4-ae8d-4c19-aab5-9921b036b82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:40.854142 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf059b4-ae8d-4c19-aab5-9921b036b82a admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:40.854374 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf059b4-ae8d-4c19-aab5-9921b036b82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:40.854654 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf059b4-ae8d-4c19-aab5-9921b036b82a admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:40.855379 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf059b4-ae8d-4c19-aab5-9921b036b82a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:40.857336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf059b4-ae8d-4c19-aab5-9921b036b82a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:40.870202 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1155/2323] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 06:00:40.873971 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab7f1b-780f-4940-84a6-35d9c43b5a00 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:40.884508 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab7f1b-780f-4940-84a6-35d9c43b5a00 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:40.891157 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9a560-447a-45ec-b622-d4eeb874291d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:40.892536 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9a560-447a-45ec-b622-d4eeb874291d admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:40.892976 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9a560-447a-45ec-b622-d4eeb874291d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:40.893531 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9a560-447a-45ec-b622-d4eeb874291d admin admin] PATH_INFO: `/v3/projects/b3daa923d3cb44f1a9d66e1fccfe6c8f/users/9c1cfdaf115a407ab578a9de92176e43/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:40.910546 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9a560-447a-45ec-b622-d4eeb874291d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3daa923d3cb44f1a9d66e1fccfe6c8f, user_id=9c1cfdaf115a407ab578a9de92176e43, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:40.913439 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9a560-447a-45ec-b622-d4eeb874291d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:40.928863 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1169/2324] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:00:40 2022] PUT /identity/v3/projects/b3daa923d3cb44f1a9d66e1fccfe6c8f/users/9c1cfdaf115a407ab578a9de92176e43/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:00:40.941103 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fff63-fe2b-4473-b835-1ccab5399965 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:40.941630 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fff63-fe2b-4473-b835-1ccab5399965 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:40.942099 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fff63-fe2b-4473-b835-1ccab5399965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:40.975520 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-465fff63-fe2b-4473-b835-1ccab5399965 None None] MFA Rules not processed for user `9c1cfdaf115a407ab578a9de92176e43`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:00:40.977353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-465fff63-fe2b-4473-b835-1ccab5399965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:41.031033 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:41.051705 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1156/2325] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:00:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:00:41.056393 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9a560-447a-45ec-b622-d4eeb874291d admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:41.107782 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:41.189610 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9a560-447a-45ec-b622-d4eeb874291d admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:41.197649 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbc213-62c3-4aba-9ffe-4c63a8ad1664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:41.198800 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbc213-62c3-4aba-9ffe-4c63a8ad1664 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:41.199269 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbc213-62c3-4aba-9ffe-4c63a8ad1664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:41.203683 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbc213-62c3-4aba-9ffe-4c63a8ad1664 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:41.203683 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbc213-62c3-4aba-9ffe-4c63a8ad1664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:41.206263 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbc213-62c3-4aba-9ffe-4c63a8ad1664 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:41.248145 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1170/2326] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:00:41 2022] POST /identity/v3/projects => generated 401 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:00:41.252348 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fff63-fe2b-4473-b835-1ccab5399965 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:41.277721 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fff63-fe2b-4473-b835-1ccab5399965 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:41.393908 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d876e-48d0-42da-85e0-e87745f01492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:41.394642 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d876e-48d0-42da-85e0-e87745f01492 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:41.394927 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d876e-48d0-42da-85e0-e87745f01492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:41.395214 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d876e-48d0-42da-85e0-e87745f01492 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:41.395926 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d876e-48d0-42da-85e0-e87745f01492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:41.397976 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d876e-48d0-42da-85e0-e87745f01492 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:41.420367 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1157/2327] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:00:41 2022] POST /identity/v3/users => generated 307 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:00:41.425150 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbc213-62c3-4aba-9ffe-4c63a8ad1664 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:41.436932 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbc213-62c3-4aba-9ffe-4c63a8ad1664 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:41.441774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040df0c-9b05-4382-8bdb-666f81c22083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:41.442993 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040df0c-9b05-4382-8bdb-666f81c22083 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:41.443288 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040df0c-9b05-4382-8bdb-666f81c22083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:41.443724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040df0c-9b05-4382-8bdb-666f81c22083 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:41.444472 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040df0c-9b05-4382-8bdb-666f81c22083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:41.446402 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040df0c-9b05-4382-8bdb-666f81c22083 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:41.458199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1171/2328] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 06:00:41.462228 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d876e-48d0-42da-85e0-e87745f01492 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:41.474227 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d876e-48d0-42da-85e0-e87745f01492 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:41.479515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5568e-a598-4ffe-bbfa-b97639321699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:41.480415 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5568e-a598-4ffe-bbfa-b97639321699 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:41.481219 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5568e-a598-4ffe-bbfa-b97639321699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:41.481517 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5568e-a598-4ffe-bbfa-b97639321699 admin admin] PATH_INFO: `/v3/projects/3e55d5808bad4e2e8deb722accf0a7ef/users/4170900e66814907b2310534a3475593/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:41.498762 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5568e-a598-4ffe-bbfa-b97639321699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e55d5808bad4e2e8deb722accf0a7ef, user_id=4170900e66814907b2310534a3475593, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:41.501476 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5568e-a598-4ffe-bbfa-b97639321699 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:41.515926 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1158/2329] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:00:41 2022] PUT /identity/v3/projects/3e55d5808bad4e2e8deb722accf0a7ef/users/4170900e66814907b2310534a3475593/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:00:41.519976 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040df0c-9b05-4382-8bdb-666f81c22083 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:41.535079 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040df0c-9b05-4382-8bdb-666f81c22083 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:41.614446 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79778a-43a2-40b8-bdd6-f3e332a24aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:41.615134 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79778a-43a2-40b8-bdd6-f3e332a24aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:41.615424 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79778a-43a2-40b8-bdd6-f3e332a24aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:41.615706 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79778a-43a2-40b8-bdd6-f3e332a24aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:41.616437 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79778a-43a2-40b8-bdd6-f3e332a24aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:41.618232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79778a-43a2-40b8-bdd6-f3e332a24aa2 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:41.632385 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1172/2330] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:00:41.633413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5568e-a598-4ffe-bbfa-b97639321699 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:41.644515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5568e-a598-4ffe-bbfa-b97639321699 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:41.649436 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c99a6-b45b-434c-8afb-2b0c937b4158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:41.650385 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c99a6-b45b-434c-8afb-2b0c937b4158 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:41.650661 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c99a6-b45b-434c-8afb-2b0c937b4158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:41.651112 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c99a6-b45b-434c-8afb-2b0c937b4158 admin admin] PATH_INFO: `/v3/projects/3e55d5808bad4e2e8deb722accf0a7ef/users/4170900e66814907b2310534a3475593/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:41.653733 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c99a6-b45b-434c-8afb-2b0c937b4158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e55d5808bad4e2e8deb722accf0a7ef, user_id=4170900e66814907b2310534a3475593, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:41.656515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c99a6-b45b-434c-8afb-2b0c937b4158 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:41.668890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1159/2331] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:00:41 2022] PUT /identity/v3/projects/3e55d5808bad4e2e8deb722accf0a7ef/users/4170900e66814907b2310534a3475593/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:00:41.679070 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83524406-888d-4a6c-850f-d59abd2c837a None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:41.679594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83524406-888d-4a6c-850f-d59abd2c837a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:41.679891 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83524406-888d-4a6c-850f-d59abd2c837a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:41.713054 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-83524406-888d-4a6c-850f-d59abd2c837a None None] MFA Rules not processed for user `4170900e66814907b2310534a3475593`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:00:41.714570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-83524406-888d-4a6c-850f-d59abd2c837a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:41.817602 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1173/2332] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:00:41 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:00:41.828642 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c99a6-b45b-434c-8afb-2b0c937b4158 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:41.830536 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-be6c99a6-b45b-434c-8afb-2b0c937b4158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:41.910275 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c99a6-b45b-434c-8afb-2b0c937b4158 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:41.914336 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64edeeb-96de-4fd4-b2b0-4219a67ce649 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:41.915098 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64edeeb-96de-4fd4-b2b0-4219a67ce649 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:41.915386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64edeeb-96de-4fd4-b2b0-4219a67ce649 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:41.915849 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64edeeb-96de-4fd4-b2b0-4219a67ce649 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:41.926810 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64edeeb-96de-4fd4-b2b0-4219a67ce649 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:41.928269 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64edeeb-96de-4fd4-b2b0-4219a67ce649 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:41.938855 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1160/2333] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:00:41 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:00:42.023607 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83524406-888d-4a6c-850f-d59abd2c837a None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:42.034907 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83524406-888d-4a6c-850f-d59abd2c837a None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:42.038909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5781ab2-788c-47d9-84c2-c8258a3d9641 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:42.039563 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5781ab2-788c-47d9-84c2-c8258a3d9641 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:42.039845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5781ab2-788c-47d9-84c2-c8258a3d9641 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:42.040123 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5781ab2-788c-47d9-84c2-c8258a3d9641 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:42.083928 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:42.135070 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5781ab2-788c-47d9-84c2-c8258a3d9641 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:42.136700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5781ab2-788c-47d9-84c2-c8258a3d9641 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:42.148408 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1174/2334] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:00:42 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:00:46.787758 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64edeeb-96de-4fd4-b2b0-4219a67ce649 service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:46.843310 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:46.861412 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64edeeb-96de-4fd4-b2b0-4219a67ce649 service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:46.866383 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27648f8-a7ca-48d8-94fa-9f846535834e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:46.867269 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27648f8-a7ca-48d8-94fa-9f846535834e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:46.867558 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27648f8-a7ca-48d8-94fa-9f846535834e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:46.867841 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27648f8-a7ca-48d8-94fa-9f846535834e admin admin] PATH_INFO: `/v3/users/9c1cfdaf115a407ab578a9de92176e43` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:46.869203 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27648f8-a7ca-48d8-94fa-9f846535834e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c1cfdaf115a407ab578a9de92176e43)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:46.871822 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27648f8-a7ca-48d8-94fa-9f846535834e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:46.926153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f27648f8-a7ca-48d8-94fa-9f846535834e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c1cfdaf115a407ab578a9de92176e43'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:46.936071 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f27648f8-a7ca-48d8-94fa-9f846535834e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c1cfdaf115a407ab578a9de92176e43'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:46.936755 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f27648f8-a7ca-48d8-94fa-9f846535834e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c1cfdaf115a407ab578a9de92176e43'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:46.937529 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f27648f8-a7ca-48d8-94fa-9f846535834e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c1cfdaf115a407ab578a9de92176e43'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:46.951702 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f27648f8-a7ca-48d8-94fa-9f846535834e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c1cfdaf115a407ab578a9de92176e43'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:46.965287 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1161/2335] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:00:46 2022] DELETE /identity/v3/users/9c1cfdaf115a407ab578a9de92176e43 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:00:46.969821 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb111353-7f7a-4122-ad38-a3892dd41577 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:46.970403 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb111353-7f7a-4122-ad38-a3892dd41577 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:46.970508 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb111353-7f7a-4122-ad38-a3892dd41577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:46.987338 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-cb111353-7f7a-4122-ad38-a3892dd41577 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:00:46.988556 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-cb111353-7f7a-4122-ad38-a3892dd41577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:47.056748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1175/2336] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:00:47.067169 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27648f8-a7ca-48d8-94fa-9f846535834e admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:47.068875 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f27648f8-a7ca-48d8-94fa-9f846535834e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:47.141035 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27648f8-a7ca-48d8-94fa-9f846535834e admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:47.144826 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667f08c-ab2d-4b01-afc6-c0aef9b6baa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:47.145477 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667f08c-ab2d-4b01-afc6-c0aef9b6baa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:47.145767 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667f08c-ab2d-4b01-afc6-c0aef9b6baa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:47.146085 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667f08c-ab2d-4b01-afc6-c0aef9b6baa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:47.156084 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667f08c-ab2d-4b01-afc6-c0aef9b6baa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:47.157526 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667f08c-ab2d-4b01-afc6-c0aef9b6baa7 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:47.167398 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1162/2337] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:00:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:00:47.433077 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb111353-7f7a-4122-ad38-a3892dd41577 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:47.435183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-cb111353-7f7a-4122-ad38-a3892dd41577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:47.452285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb111353-7f7a-4122-ad38-a3892dd41577 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:47.457620 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafbcc2-077d-442b-b772-58282eea630d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:47.458554 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafbcc2-077d-442b-b772-58282eea630d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:47.458840 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafbcc2-077d-442b-b772-58282eea630d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:47.459119 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafbcc2-077d-442b-b772-58282eea630d admin admin] PATH_INFO: `/v3/projects/b3daa923d3cb44f1a9d66e1fccfe6c8f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:47.460637 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafbcc2-077d-442b-b772-58282eea630d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3daa923d3cb44f1a9d66e1fccfe6c8f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:47.462612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafbcc2-077d-442b-b772-58282eea630d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:47.516128 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1aafbcc2-077d-442b-b772-58282eea630d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3daa923d3cb44f1a9d66e1fccfe6c8f', 'request_id': 'req-1aafbcc2-077d-442b-b772-58282eea630d'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:47.522339 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1aafbcc2-077d-442b-b772-58282eea630d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3daa923d3cb44f1a9d66e1fccfe6c8f', 'request_id': 'req-1aafbcc2-077d-442b-b772-58282eea630d'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:47.528898 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1aafbcc2-077d-442b-b772-58282eea630d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3daa923d3cb44f1a9d66e1fccfe6c8f', 'request_id': 'req-1aafbcc2-077d-442b-b772-58282eea630d'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:47.541987 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1aafbcc2-077d-442b-b772-58282eea630d admin admin] The token cache is being invalidate because project b3daa923d3cb44f1a9d66e1fccfe6c8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:00:47.542311 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1aafbcc2-077d-442b-b772-58282eea630d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:47.543479 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1aafbcc2-077d-442b-b772-58282eea630d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:47.545272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1176/2338] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:00:47 2022] DELETE /identity/v3/projects/b3daa923d3cb44f1a9d66e1fccfe6c8f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:00:47.549167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667f08c-ab2d-4b01-afc6-c0aef9b6baa7 service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:47.562112 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667f08c-ab2d-4b01-afc6-c0aef9b6baa7 service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:47.621822 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019604f-5ef8-4a0c-935f-eec2e11f5d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:47.622712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019604f-5ef8-4a0c-935f-eec2e11f5d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:47.623118 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019604f-5ef8-4a0c-935f-eec2e11f5d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:47.623396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019604f-5ef8-4a0c-935f-eec2e11f5d3c admin admin] PATH_INFO: `/v3/users/4170900e66814907b2310534a3475593` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:47.624582 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4019604f-5ef8-4a0c-935f-eec2e11f5d3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4170900e66814907b2310534a3475593)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:47.626581 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4019604f-5ef8-4a0c-935f-eec2e11f5d3c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:47.636870 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:47.679922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4019604f-5ef8-4a0c-935f-eec2e11f5d3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4170900e66814907b2310534a3475593'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:47.688047 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4019604f-5ef8-4a0c-935f-eec2e11f5d3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4170900e66814907b2310534a3475593'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:47.688834 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4019604f-5ef8-4a0c-935f-eec2e11f5d3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4170900e66814907b2310534a3475593'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:47.689402 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4019604f-5ef8-4a0c-935f-eec2e11f5d3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4170900e66814907b2310534a3475593'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:47.702915 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4019604f-5ef8-4a0c-935f-eec2e11f5d3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4170900e66814907b2310534a3475593'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:47.716757 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1163/2339] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:00:47 2022] DELETE /identity/v3/users/4170900e66814907b2310534a3475593 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:00:48.018622 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafbcc2-077d-442b-b772-58282eea630d admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:48.022327 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1aafbcc2-077d-442b-b772-58282eea630d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:48.043367 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafbcc2-077d-442b-b772-58282eea630d admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:48.106799 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:48.129998 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6a7d2-3102-4108-843f-ca334cf22ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:48.131142 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6a7d2-3102-4108-843f-ca334cf22ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:48.131492 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6a7d2-3102-4108-843f-ca334cf22ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:48.134555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6a7d2-3102-4108-843f-ca334cf22ece admin admin] PATH_INFO: `/v3/projects/3e55d5808bad4e2e8deb722accf0a7ef` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:48.137776 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6a7d2-3102-4108-843f-ca334cf22ece admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e55d5808bad4e2e8deb722accf0a7ef)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:48.140152 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6a7d2-3102-4108-843f-ca334cf22ece admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:48.197083 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-05d6a7d2-3102-4108-843f-ca334cf22ece admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e55d5808bad4e2e8deb722accf0a7ef', 'request_id': 'req-05d6a7d2-3102-4108-843f-ca334cf22ece'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:48.203871 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-05d6a7d2-3102-4108-843f-ca334cf22ece admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e55d5808bad4e2e8deb722accf0a7ef', 'request_id': 'req-05d6a7d2-3102-4108-843f-ca334cf22ece'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:48.211207 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-05d6a7d2-3102-4108-843f-ca334cf22ece admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e55d5808bad4e2e8deb722accf0a7ef', 'request_id': 'req-05d6a7d2-3102-4108-843f-ca334cf22ece'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:48.227600 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-05d6a7d2-3102-4108-843f-ca334cf22ece admin admin] The token cache is being invalidate because project 3e55d5808bad4e2e8deb722accf0a7ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:00:48.227899 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-05d6a7d2-3102-4108-843f-ca334cf22ece admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:48.228581 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-05d6a7d2-3102-4108-843f-ca334cf22ece admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:00:48.230237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1177/2340] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:00:48 2022] DELETE /identity/v3/projects/3e55d5808bad4e2e8deb722accf0a7ef => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:00:48.235315 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c292f60-0247-4209-ae17-700592bce65b None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:48.235848 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c292f60-0247-4209-ae17-700592bce65b None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:48.235848 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c292f60-0247-4209-ae17-700592bce65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:48.259771 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-4c292f60-0247-4209-ae17-700592bce65b None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:00:48.261030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-4c292f60-0247-4209-ae17-700592bce65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:48.338597 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1164/2341] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:00:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:00:48.346987 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65726814-9415-4452-93e9-31870eb63a62 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:48.347364 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65726814-9415-4452-93e9-31870eb63a62 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:48.347666 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65726814-9415-4452-93e9-31870eb63a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:48.367885 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-65726814-9415-4452-93e9-31870eb63a62 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:00:48.369129 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-65726814-9415-4452-93e9-31870eb63a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:48.377723 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1178/2342] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:00:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:00:48.382194 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c292f60-0247-4209-ae17-700592bce65b None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:48.392653 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c292f60-0247-4209-ae17-700592bce65b None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:48.397425 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0eed4-547d-433e-a52d-5b82160d4690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:48.398127 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0eed4-547d-433e-a52d-5b82160d4690 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:48.398417 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0eed4-547d-433e-a52d-5b82160d4690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:48.398695 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0eed4-547d-433e-a52d-5b82160d4690 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:48.399433 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0eed4-547d-433e-a52d-5b82160d4690 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 06:00:48.399744 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0eed4-547d-433e-a52d-5b82160d4690 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:48.401403 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0eed4-547d-433e-a52d-5b82160d4690 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:48.413727 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1165/2343] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 06:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 06:00:48.418054 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65726814-9415-4452-93e9-31870eb63a62 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:48.427669 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65726814-9415-4452-93e9-31870eb63a62 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:48.432287 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25c437-e0aa-4b71-8602-2e819495a9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:48.432938 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25c437-e0aa-4b71-8602-2e819495a9db admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:48.433220 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25c437-e0aa-4b71-8602-2e819495a9db admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:48.434024 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25c437-e0aa-4b71-8602-2e819495a9db admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:48.434778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25c437-e0aa-4b71-8602-2e819495a9db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:48.436618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25c437-e0aa-4b71-8602-2e819495a9db admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:48.461898 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1179/2344] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:00:48 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:00:48.466589 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0eed4-547d-433e-a52d-5b82160d4690 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:48.476845 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0eed4-547d-433e-a52d-5b82160d4690 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:48.537811 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924906b-21a5-46cf-95e5-a0d2fd4aef16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:48.538522 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924906b-21a5-46cf-95e5-a0d2fd4aef16 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:48.538805 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924906b-21a5-46cf-95e5-a0d2fd4aef16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:48.539104 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924906b-21a5-46cf-95e5-a0d2fd4aef16 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:48.539791 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924906b-21a5-46cf-95e5-a0d2fd4aef16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:48.541766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924906b-21a5-46cf-95e5-a0d2fd4aef16 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:48.562326 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1166/2345] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:00:48 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:00:48.566520 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25c437-e0aa-4b71-8602-2e819495a9db admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:48.578280 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25c437-e0aa-4b71-8602-2e819495a9db admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:48.583009 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b63ce-1963-4cbc-bb72-7f85747c2cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:48.583682 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b63ce-1963-4cbc-bb72-7f85747c2cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:48.583964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b63ce-1963-4cbc-bb72-7f85747c2cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:48.584235 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b63ce-1963-4cbc-bb72-7f85747c2cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:48.584963 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b63ce-1963-4cbc-bb72-7f85747c2cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:48.586600 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b63ce-1963-4cbc-bb72-7f85747c2cf1 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:48.597724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1180/2346] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:00:48.601741 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924906b-21a5-46cf-95e5-a0d2fd4aef16 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:48.608261 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:48.612015 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924906b-21a5-46cf-95e5-a0d2fd4aef16 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:48.618317 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c16704-77be-4256-83b2-d28f88d1e9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:48.619163 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c16704-77be-4256-83b2-d28f88d1e9b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:48.619640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c16704-77be-4256-83b2-d28f88d1e9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:48.620093 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c16704-77be-4256-83b2-d28f88d1e9b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:48.620854 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c16704-77be-4256-83b2-d28f88d1e9b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:48.623063 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c16704-77be-4256-83b2-d28f88d1e9b2 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:48.633914 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1167/2347] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:00:48.640463 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b63ce-1963-4cbc-bb72-7f85747c2cf1 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:48.650785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b63ce-1963-4cbc-bb72-7f85747c2cf1 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:48.656143 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972e634-7f69-426c-867d-8072c773b5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:48.657043 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972e634-7f69-426c-867d-8072c773b5f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:48.657316 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972e634-7f69-426c-867d-8072c773b5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:48.657592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972e634-7f69-426c-867d-8072c773b5f4 admin admin] PATH_INFO: `/v3/projects/28f57ca526714a3ab8ec5d487a6dc769/users/72b0236979324809bf69281043535d16/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:48.673330 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6972e634-7f69-426c-867d-8072c773b5f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28f57ca526714a3ab8ec5d487a6dc769, user_id=72b0236979324809bf69281043535d16, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:48.676023 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6972e634-7f69-426c-867d-8072c773b5f4 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:48.690788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1181/2348] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:00:48 2022] PUT /identity/v3/projects/28f57ca526714a3ab8ec5d487a6dc769/users/72b0236979324809bf69281043535d16/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:00:48.695938 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1830c3f-8b4f-494e-9cd2-dc430d871782 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:48.696310 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1830c3f-8b4f-494e-9cd2-dc430d871782 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:48.696714 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1830c3f-8b4f-494e-9cd2-dc430d871782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:48.717153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-c1830c3f-8b4f-494e-9cd2-dc430d871782 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:00:48.718739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c1830c3f-8b4f-494e-9cd2-dc430d871782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:48.829958 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1168/2349] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:00:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:00:48.840573 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972e634-7f69-426c-867d-8072c773b5f4 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:48.842694 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6972e634-7f69-426c-867d-8072c773b5f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:48.905298 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972e634-7f69-426c-867d-8072c773b5f4 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:48.909008 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc760e-6d5e-4172-ab8e-2da8e75f7f17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:48.909659 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc760e-6d5e-4172-ab8e-2da8e75f7f17 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:48.909970 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc760e-6d5e-4172-ab8e-2da8e75f7f17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:48.910253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc760e-6d5e-4172-ab8e-2da8e75f7f17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:48.921099 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc760e-6d5e-4172-ab8e-2da8e75f7f17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:48.922600 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc760e-6d5e-4172-ab8e-2da8e75f7f17 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:48.935312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1182/2350] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:00:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:00:49.935587 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd28a9-6c86-4791-9678-dc214a8a61ba None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:49.936139 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd28a9-6c86-4791-9678-dc214a8a61ba None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:49.936139 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd28a9-6c86-4791-9678-dc214a8a61ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:49.978399 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-8abd28a9-6c86-4791-9678-dc214a8a61ba None None] MFA Rules not processed for user `72b0236979324809bf69281043535d16`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:00:49.979669 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8abd28a9-6c86-4791-9678-dc214a8a61ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:50.071426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1169/2351] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:00:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:00:50.076006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc760e-6d5e-4172-ab8e-2da8e75f7f17 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:50.086413 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc760e-6d5e-4172-ab8e-2da8e75f7f17 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:50.092345 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ab3c0-3390-4494-a8ce-caafc1a25568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:50.093080 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ab3c0-3390-4494-a8ce-caafc1a25568 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:50.093365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ab3c0-3390-4494-a8ce-caafc1a25568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:50.093645 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ab3c0-3390-4494-a8ce-caafc1a25568 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:50.094388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ab3c0-3390-4494-a8ce-caafc1a25568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:50.096307 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ab3c0-3390-4494-a8ce-caafc1a25568 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:50.112255 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:50.133255 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1183/2352] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:00:50 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 06:00:50.134430 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd28a9-6c86-4791-9678-dc214a8a61ba None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:50.146265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd28a9-6c86-4791-9678-dc214a8a61ba None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:50.214012 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d66484-4c9f-4676-9f51-f790c933cda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:50.215135 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d66484-4c9f-4676-9f51-f790c933cda1 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:50.215423 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d66484-4c9f-4676-9f51-f790c933cda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:50.215703 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d66484-4c9f-4676-9f51-f790c933cda1 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:50.216429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d66484-4c9f-4676-9f51-f790c933cda1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:50.218411 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d66484-4c9f-4676-9f51-f790c933cda1 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:50.238809 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1170/2353] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:00:50 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:00:50.242914 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ab3c0-3390-4494-a8ce-caafc1a25568 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:50.253994 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ab3c0-3390-4494-a8ce-caafc1a25568 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:50.258577 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d6aac-4437-43f7-8547-4a3161ef85e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:50.259248 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d6aac-4437-43f7-8547-4a3161ef85e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:50.259546 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d6aac-4437-43f7-8547-4a3161ef85e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:50.259814 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d6aac-4437-43f7-8547-4a3161ef85e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:50.260534 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d6aac-4437-43f7-8547-4a3161ef85e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:50.262199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d6aac-4437-43f7-8547-4a3161ef85e9 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:50.273299 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1184/2354] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:00:50.277358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d66484-4c9f-4676-9f51-f790c933cda1 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:50.287376 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d66484-4c9f-4676-9f51-f790c933cda1 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:50.292560 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e9da2-5773-4e5c-95e2-675b1f1c3621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:50.294073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e9da2-5773-4e5c-95e2-675b1f1c3621 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:50.294355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e9da2-5773-4e5c-95e2-675b1f1c3621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:50.295172 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e9da2-5773-4e5c-95e2-675b1f1c3621 admin admin] PATH_INFO: `/v3/projects/4ee1dd65a5b244ea91a54c435f434b93/users/e57eae597c024b9a80fa6b0785171409/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:50.307828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:50.315464 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e9da2-5773-4e5c-95e2-675b1f1c3621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee1dd65a5b244ea91a54c435f434b93, user_id=e57eae597c024b9a80fa6b0785171409, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:50.318826 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e9da2-5773-4e5c-95e2-675b1f1c3621 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:50.334891 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1171/2355] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:00:50 2022] PUT /identity/v3/projects/4ee1dd65a5b244ea91a54c435f434b93/users/e57eae597c024b9a80fa6b0785171409/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:00:50.338784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d6aac-4437-43f7-8547-4a3161ef85e9 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:50.353824 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d6aac-4437-43f7-8547-4a3161ef85e9 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:50.414871 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b22b4-f17d-4ad6-b393-ff3fb6f73c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:50.415543 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b22b4-f17d-4ad6-b393-ff3fb6f73c83 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:50.415829 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b22b4-f17d-4ad6-b393-ff3fb6f73c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:50.416100 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b22b4-f17d-4ad6-b393-ff3fb6f73c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:50.416825 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b22b4-f17d-4ad6-b393-ff3fb6f73c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:50.419001 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b22b4-f17d-4ad6-b393-ff3fb6f73c83 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:50.429547 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1185/2356] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:00:50.434137 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e9da2-5773-4e5c-95e2-675b1f1c3621 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:50.446478 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e9da2-5773-4e5c-95e2-675b1f1c3621 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:50.451172 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c76b3-8b41-4f21-8552-25a1ac5f740a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:50.452064 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c76b3-8b41-4f21-8552-25a1ac5f740a admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:50.452350 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c76b3-8b41-4f21-8552-25a1ac5f740a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:50.452630 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c76b3-8b41-4f21-8552-25a1ac5f740a admin admin] PATH_INFO: `/v3/projects/4ee1dd65a5b244ea91a54c435f434b93/users/e57eae597c024b9a80fa6b0785171409/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:50.455092 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c76b3-8b41-4f21-8552-25a1ac5f740a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee1dd65a5b244ea91a54c435f434b93, user_id=e57eae597c024b9a80fa6b0785171409, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:50.458157 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c76b3-8b41-4f21-8552-25a1ac5f740a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:50.469575 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1172/2357] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:00:50 2022] PUT /identity/v3/projects/4ee1dd65a5b244ea91a54c435f434b93/users/e57eae597c024b9a80fa6b0785171409/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:00:51.307385 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2829f0b-1434-4d18-b7e8-786b5b1dc1b6 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:51.307977 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2829f0b-1434-4d18-b7e8-786b5b1dc1b6 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:51.309189 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2829f0b-1434-4d18-b7e8-786b5b1dc1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:51.341115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-d2829f0b-1434-4d18-b7e8-786b5b1dc1b6 None None] MFA Rules not processed for user `e57eae597c024b9a80fa6b0785171409`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:00:51.342443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d2829f0b-1434-4d18-b7e8-786b5b1dc1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:51.481127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1186/2358] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:00:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:00:51.524408 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c76b3-8b41-4f21-8552-25a1ac5f740a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:51.527313 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-890c76b3-8b41-4f21-8552-25a1ac5f740a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:51.635324 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c76b3-8b41-4f21-8552-25a1ac5f740a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:51.641618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047181d-d3b8-43f4-8e2f-8d43996928ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:51.642490 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047181d-d3b8-43f4-8e2f-8d43996928ed service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:51.642871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047181d-d3b8-43f4-8e2f-8d43996928ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:51.643412 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047181d-d3b8-43f4-8e2f-8d43996928ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:51.738215 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047181d-d3b8-43f4-8e2f-8d43996928ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:51.739796 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047181d-d3b8-43f4-8e2f-8d43996928ed service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:51.750501 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1173/2359] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:00:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:00:53.152543 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2829f0b-1434-4d18-b7e8-786b5b1dc1b6 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:53.164176 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2829f0b-1434-4d18-b7e8-786b5b1dc1b6 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:53.169966 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86380e4f-743c-46d6-bf85-4b3e32f5451b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:53.170182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86380e4f-743c-46d6-bf85-4b3e32f5451b service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:53.170477 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86380e4f-743c-46d6-bf85-4b3e32f5451b service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:53.170757 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86380e4f-743c-46d6-bf85-4b3e32f5451b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:53.181066 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86380e4f-743c-46d6-bf85-4b3e32f5451b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:53.182577 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86380e4f-743c-46d6-bf85-4b3e32f5451b service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:53.196028 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1187/2360] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:00:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:00:54.515335 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94315f5-a16d-4074-b980-1653562aac03 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:54.515818 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94315f5-a16d-4074-b980-1653562aac03 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:54.515911 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94315f5-a16d-4074-b980-1653562aac03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:54.534691 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-f94315f5-a16d-4074-b980-1653562aac03 None None] MFA Rules not processed for user `af8e0eb5ff8c40ae848929780d99e72d`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:00:54.535906 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f94315f5-a16d-4074-b980-1653562aac03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:54.594576 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1174/2361] 10.222.0.18 () {58 vars in 967 bytes} [Tue Jun 21 06:00:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:00:54.608843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86380e4f-743c-46d6-bf85-4b3e32f5451b service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:00:54.610399 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-86380e4f-743c-46d6-bf85-4b3e32f5451b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:00:54.671334 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:54.689176 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86380e4f-743c-46d6-bf85-4b3e32f5451b service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:00:54.697240 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88411ca-38d0-443a-8aa9-dd869da87c11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac485a336d8b4360bce4f495bd02dbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:00:54.697912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88411ca-38d0-443a-8aa9-dd869da87c11 service swift] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:00:54.698224 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88411ca-38d0-443a-8aa9-dd869da87c11 service swift] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:00:54.698507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88411ca-38d0-443a-8aa9-dd869da87c11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:00:54.710975 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88411ca-38d0-443a-8aa9-dd869da87c11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:00:54.712624 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88411ca-38d0-443a-8aa9-dd869da87c11 service swift] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:00:54.722784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1188/2362] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 21 06:00:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 21 06:01:04.586271 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=82,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:04.719503 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=8 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:05.744101 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94315f5-a16d-4074-b980-1653562aac03 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:05.745632 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f94315f5-a16d-4074-b980-1653562aac03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:05.832559 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94315f5-a16d-4074-b980-1653562aac03 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:05.837687 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02645313-beb2-42fb-99a5-6fff5c3be5d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17a40bea6ba41f19c88e16f9b15cf27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:05.838445 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02645313-beb2-42fb-99a5-6fff5c3be5d3 service placement] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:05.839244 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02645313-beb2-42fb-99a5-6fff5c3be5d3 service placement] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:05.839785 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02645313-beb2-42fb-99a5-6fff5c3be5d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:05.841774 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-02645313-beb2-42fb-99a5-6fff5c3be5d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:05.857959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02645313-beb2-42fb-99a5-6fff5c3be5d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:05.859428 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02645313-beb2-42fb-99a5-6fff5c3be5d3 service placement] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:05.871840 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1175/2363] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:01:06.488222 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88411ca-38d0-443a-8aa9-dd869da87c11 service swift] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:06.574318 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88411ca-38d0-443a-8aa9-dd869da87c11 service swift] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:06.580590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18f9fb-0a86-42e8-bec1-e2c36a1bdb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:06.581838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18f9fb-0a86-42e8-bec1-e2c36a1bdb47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:06.582267 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18f9fb-0a86-42e8-bec1-e2c36a1bdb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:06.582656 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18f9fb-0a86-42e8-bec1-e2c36a1bdb47 admin admin] PATH_INFO: `/v3/users/72b0236979324809bf69281043535d16` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:06.584295 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d18f9fb-0a86-42e8-bec1-e2c36a1bdb47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72b0236979324809bf69281043535d16)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:06.586721 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d18f9fb-0a86-42e8-bec1-e2c36a1bdb47 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:06.633895 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0d18f9fb-0a86-42e8-bec1-e2c36a1bdb47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72b0236979324809bf69281043535d16'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:06.642068 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0d18f9fb-0a86-42e8-bec1-e2c36a1bdb47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72b0236979324809bf69281043535d16'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:06.642821 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0d18f9fb-0a86-42e8-bec1-e2c36a1bdb47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72b0236979324809bf69281043535d16'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:06.649829 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0d18f9fb-0a86-42e8-bec1-e2c36a1bdb47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72b0236979324809bf69281043535d16'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:06.661570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0d18f9fb-0a86-42e8-bec1-e2c36a1bdb47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72b0236979324809bf69281043535d16'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:06.667919 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1189/2364] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:01:06 2022] DELETE /identity/v3/users/72b0236979324809bf69281043535d16 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:06.935199 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02645313-beb2-42fb-99a5-6fff5c3be5d3 service placement] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:06.947351 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02645313-beb2-42fb-99a5-6fff5c3be5d3 service placement] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:07.033864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020c1e9-3f7b-4594-8e8e-fa5b98ad07e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:07.034928 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020c1e9-3f7b-4594-8e8e-fa5b98ad07e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:07.035277 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020c1e9-3f7b-4594-8e8e-fa5b98ad07e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:07.035624 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020c1e9-3f7b-4594-8e8e-fa5b98ad07e3 admin admin] PATH_INFO: `/v3/projects/28f57ca526714a3ab8ec5d487a6dc769` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:07.037683 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020c1e9-3f7b-4594-8e8e-fa5b98ad07e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28f57ca526714a3ab8ec5d487a6dc769)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:07.039902 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020c1e9-3f7b-4594-8e8e-fa5b98ad07e3 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:07.124106 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c020c1e9-3f7b-4594-8e8e-fa5b98ad07e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28f57ca526714a3ab8ec5d487a6dc769', 'request_id': 'req-c020c1e9-3f7b-4594-8e8e-fa5b98ad07e3'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:07.136682 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c020c1e9-3f7b-4594-8e8e-fa5b98ad07e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28f57ca526714a3ab8ec5d487a6dc769', 'request_id': 'req-c020c1e9-3f7b-4594-8e8e-fa5b98ad07e3'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:07.147954 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c020c1e9-3f7b-4594-8e8e-fa5b98ad07e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28f57ca526714a3ab8ec5d487a6dc769', 'request_id': 'req-c020c1e9-3f7b-4594-8e8e-fa5b98ad07e3'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:07.161529 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c020c1e9-3f7b-4594-8e8e-fa5b98ad07e3 admin admin] The token cache is being invalidate because project 28f57ca526714a3ab8ec5d487a6dc769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:01:07.162212 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c020c1e9-3f7b-4594-8e8e-fa5b98ad07e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:07.162918 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c020c1e9-3f7b-4594-8e8e-fa5b98ad07e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:07.166032 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1176/2365] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:01:06 2022] DELETE /identity/v3/projects/28f57ca526714a3ab8ec5d487a6dc769 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:07.169184 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18f9fb-0a86-42e8-bec1-e2c36a1bdb47 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:07.170946 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0d18f9fb-0a86-42e8-bec1-e2c36a1bdb47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:07.185006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18f9fb-0a86-42e8-bec1-e2c36a1bdb47 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:07.246955 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2130cbf-ef73-4aa6-8192-ec7031ad38e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:07.247971 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2130cbf-ef73-4aa6-8192-ec7031ad38e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:07.248227 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2130cbf-ef73-4aa6-8192-ec7031ad38e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:07.248670 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2130cbf-ef73-4aa6-8192-ec7031ad38e1 admin admin] PATH_INFO: `/v3/users/e57eae597c024b9a80fa6b0785171409` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:07.249900 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2130cbf-ef73-4aa6-8192-ec7031ad38e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e57eae597c024b9a80fa6b0785171409)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:07.251860 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2130cbf-ef73-4aa6-8192-ec7031ad38e1 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:07.280573 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:07.312055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a2130cbf-ef73-4aa6-8192-ec7031ad38e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e57eae597c024b9a80fa6b0785171409'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:07.320029 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a2130cbf-ef73-4aa6-8192-ec7031ad38e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e57eae597c024b9a80fa6b0785171409'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:07.320780 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a2130cbf-ef73-4aa6-8192-ec7031ad38e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e57eae597c024b9a80fa6b0785171409'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:07.332388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a2130cbf-ef73-4aa6-8192-ec7031ad38e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e57eae597c024b9a80fa6b0785171409'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:07.348369 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a2130cbf-ef73-4aa6-8192-ec7031ad38e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e57eae597c024b9a80fa6b0785171409'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:07.355448 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1190/2366] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:01:07 2022] DELETE /identity/v3/users/e57eae597c024b9a80fa6b0785171409 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:07.572168 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020c1e9-3f7b-4594-8e8e-fa5b98ad07e3 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:07.574140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c020c1e9-3f7b-4594-8e8e-fa5b98ad07e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:07.615068 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020c1e9-3f7b-4594-8e8e-fa5b98ad07e3 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:07.642965 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:07.701645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ee660-bacf-42c7-bfaa-c2c5cb011591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:07.702786 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ee660-bacf-42c7-bfaa-c2c5cb011591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:07.703146 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ee660-bacf-42c7-bfaa-c2c5cb011591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:07.703694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ee660-bacf-42c7-bfaa-c2c5cb011591 admin admin] PATH_INFO: `/v3/projects/4ee1dd65a5b244ea91a54c435f434b93` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:07.704914 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ee660-bacf-42c7-bfaa-c2c5cb011591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ee1dd65a5b244ea91a54c435f434b93)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:07.707121 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ee660-bacf-42c7-bfaa-c2c5cb011591 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:07.764914 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-fe4ee660-bacf-42c7-bfaa-c2c5cb011591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ee1dd65a5b244ea91a54c435f434b93', 'request_id': 'req-fe4ee660-bacf-42c7-bfaa-c2c5cb011591'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:07.775884 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-fe4ee660-bacf-42c7-bfaa-c2c5cb011591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ee1dd65a5b244ea91a54c435f434b93', 'request_id': 'req-fe4ee660-bacf-42c7-bfaa-c2c5cb011591'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:07.786677 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-fe4ee660-bacf-42c7-bfaa-c2c5cb011591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ee1dd65a5b244ea91a54c435f434b93', 'request_id': 'req-fe4ee660-bacf-42c7-bfaa-c2c5cb011591'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:07.799434 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-fe4ee660-bacf-42c7-bfaa-c2c5cb011591 admin admin] The token cache is being invalidate because project 4ee1dd65a5b244ea91a54c435f434b93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:01:07.799912 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-fe4ee660-bacf-42c7-bfaa-c2c5cb011591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:07.800893 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-fe4ee660-bacf-42c7-bfaa-c2c5cb011591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:07.802743 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1177/2367] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:01:07 2022] DELETE /identity/v3/projects/4ee1dd65a5b244ea91a54c435f434b93 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:07.809027 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05138a16-e1ee-4c18-9926-9cc934c05a8a None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:07.809563 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05138a16-e1ee-4c18-9926-9cc934c05a8a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:07.809663 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05138a16-e1ee-4c18-9926-9cc934c05a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:07.835956 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-05138a16-e1ee-4c18-9926-9cc934c05a8a None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:07.836877 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-05138a16-e1ee-4c18-9926-9cc934c05a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:07.929480 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1191/2368] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:07.930707 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815ef3e-44ff-4d4c-ad60-7918dda82e9c None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:07.931003 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815ef3e-44ff-4d4c-ad60-7918dda82e9c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:07.931290 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815ef3e-44ff-4d4c-ad60-7918dda82e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:07.971065 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-c815ef3e-44ff-4d4c-ad60-7918dda82e9c None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:07.972938 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c815ef3e-44ff-4d4c-ad60-7918dda82e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:07.988498 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1178/2369] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:07.992581 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05138a16-e1ee-4c18-9926-9cc934c05a8a None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:08.006184 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05138a16-e1ee-4c18-9926-9cc934c05a8a None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:08.012123 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35486ee-7dda-4f98-bd96-a427097872b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:08.012810 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35486ee-7dda-4f98-bd96-a427097872b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:08.013098 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35486ee-7dda-4f98-bd96-a427097872b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:08.013396 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35486ee-7dda-4f98-bd96-a427097872b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:08.014180 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35486ee-7dda-4f98-bd96-a427097872b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 06:01:08.014492 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35486ee-7dda-4f98-bd96-a427097872b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:08.017405 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35486ee-7dda-4f98-bd96-a427097872b4 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:08.053283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1192/2370] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 06:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 06:01:08.058102 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815ef3e-44ff-4d4c-ad60-7918dda82e9c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:08.069268 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815ef3e-44ff-4d4c-ad60-7918dda82e9c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:08.076027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087bba6-b3e8-4fa5-809c-787fb35d2edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:08.081021 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087bba6-b3e8-4fa5-809c-787fb35d2edd admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:08.081640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087bba6-b3e8-4fa5-809c-787fb35d2edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:08.082139 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087bba6-b3e8-4fa5-809c-787fb35d2edd admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:08.083065 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087bba6-b3e8-4fa5-809c-787fb35d2edd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:08.085701 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087bba6-b3e8-4fa5-809c-787fb35d2edd admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:08.125666 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1179/2371] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:01:08 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:08.126704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35486ee-7dda-4f98-bd96-a427097872b4 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:08.153006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35486ee-7dda-4f98-bd96-a427097872b4 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:08.242527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260d3ff-9047-4d2c-8124-5e69eb2efbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:08.243487 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260d3ff-9047-4d2c-8124-5e69eb2efbaa admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:08.243765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260d3ff-9047-4d2c-8124-5e69eb2efbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:08.244299 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260d3ff-9047-4d2c-8124-5e69eb2efbaa admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:08.246203 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260d3ff-9047-4d2c-8124-5e69eb2efbaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:08.248721 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260d3ff-9047-4d2c-8124-5e69eb2efbaa admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:08.274107 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1193/2372] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:01:08 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:08.275862 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087bba6-b3e8-4fa5-809c-787fb35d2edd admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:08.287201 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087bba6-b3e8-4fa5-809c-787fb35d2edd admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:08.292718 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054cb358-1c92-4c63-8fa9-d964192520b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:08.293469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cb358-1c92-4c63-8fa9-d964192520b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:08.293841 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cb358-1c92-4c63-8fa9-d964192520b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:08.294200 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cb358-1c92-4c63-8fa9-d964192520b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:08.294999 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054cb358-1c92-4c63-8fa9-d964192520b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:08.296691 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054cb358-1c92-4c63-8fa9-d964192520b6 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:08.309361 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1180/2373] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:08.313328 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260d3ff-9047-4d2c-8124-5e69eb2efbaa admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:08.325839 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260d3ff-9047-4d2c-8124-5e69eb2efbaa admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:08.332605 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf6a12-7790-441b-bf29-c240e6724a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:08.333391 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf6a12-7790-441b-bf29-c240e6724a13 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:08.334111 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf6a12-7790-441b-bf29-c240e6724a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:08.334111 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf6a12-7790-441b-bf29-c240e6724a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:08.335044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf6a12-7790-441b-bf29-c240e6724a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:08.336742 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf6a12-7790-441b-bf29-c240e6724a13 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:08.352916 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1194/2374] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 06:01:08.355106 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054cb358-1c92-4c63-8fa9-d964192520b6 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:08.367248 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054cb358-1c92-4c63-8fa9-d964192520b6 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:08.373092 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b34798-11d1-4a6c-96ed-44b204b0f612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:08.374866 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b34798-11d1-4a6c-96ed-44b204b0f612 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:08.375079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b34798-11d1-4a6c-96ed-44b204b0f612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:08.375370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b34798-11d1-4a6c-96ed-44b204b0f612 admin admin] PATH_INFO: `/v3/projects/e2dc54c502f742298aed931c494481a4/users/e4cc5657db3e49a1b1bc44cac76a2176/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:08.400271 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b34798-11d1-4a6c-96ed-44b204b0f612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2dc54c502f742298aed931c494481a4, user_id=e4cc5657db3e49a1b1bc44cac76a2176, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:08.403261 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b34798-11d1-4a6c-96ed-44b204b0f612 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:08.417401 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1181/2375] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:08 2022] PUT /identity/v3/projects/e2dc54c502f742298aed931c494481a4/users/e4cc5657db3e49a1b1bc44cac76a2176/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:08.428099 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2e1b3-fd73-404d-b0cb-6bb99963e0ee None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:08.428339 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2e1b3-fd73-404d-b0cb-6bb99963e0ee None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:08.428622 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2e1b3-fd73-404d-b0cb-6bb99963e0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:08.436000 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:08.456739 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-a9f2e1b3-fd73-404d-b0cb-6bb99963e0ee None None] MFA Rules not processed for user `e4cc5657db3e49a1b1bc44cac76a2176`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:08.457993 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a9f2e1b3-fd73-404d-b0cb-6bb99963e0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:08.524912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1195/2376] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:08.536396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b34798-11d1-4a6c-96ed-44b204b0f612 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:08.538143 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-29b34798-11d1-4a6c-96ed-44b204b0f612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:08.593966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:08.600436 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b34798-11d1-4a6c-96ed-44b204b0f612 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:08.606202 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a6bbd-e3fa-4933-8a72-97eacd72311d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:08.607177 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a6bbd-e3fa-4933-8a72-97eacd72311d service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:08.607558 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a6bbd-e3fa-4933-8a72-97eacd72311d service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:08.607851 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a6bbd-e3fa-4933-8a72-97eacd72311d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:08.616946 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a6bbd-e3fa-4933-8a72-97eacd72311d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:08.618442 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a6bbd-e3fa-4933-8a72-97eacd72311d service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:08.627742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1182/2377] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:01:16.049584 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2e1b3-fd73-404d-b0cb-6bb99963e0ee None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:16.116963 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2e1b3-fd73-404d-b0cb-6bb99963e0ee None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:16.121483 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e2960-e217-4990-975d-1db86eba638e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:16.122386 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e2960-e217-4990-975d-1db86eba638e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:16.122668 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e2960-e217-4990-975d-1db86eba638e admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:16.122944 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e2960-e217-4990-975d-1db86eba638e admin admin] PATH_INFO: `/v3/users/e4cc5657db3e49a1b1bc44cac76a2176` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:16.124123 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e2960-e217-4990-975d-1db86eba638e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4cc5657db3e49a1b1bc44cac76a2176)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:16.126071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e2960-e217-4990-975d-1db86eba638e admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:16.172715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6e6e2960-e217-4990-975d-1db86eba638e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4cc5657db3e49a1b1bc44cac76a2176'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:16.179928 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6e6e2960-e217-4990-975d-1db86eba638e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4cc5657db3e49a1b1bc44cac76a2176'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:16.180617 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6e6e2960-e217-4990-975d-1db86eba638e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4cc5657db3e49a1b1bc44cac76a2176'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:16.188234 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6e6e2960-e217-4990-975d-1db86eba638e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4cc5657db3e49a1b1bc44cac76a2176'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:16.199983 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6e6e2960-e217-4990-975d-1db86eba638e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4cc5657db3e49a1b1bc44cac76a2176'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:16.206063 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1196/2378] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:01:16 2022] DELETE /identity/v3/users/e4cc5657db3e49a1b1bc44cac76a2176 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:16.210790 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c857b36-bbc0-4e86-bc71-8a5a5fe459b7 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:16.211266 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c857b36-bbc0-4e86-bc71-8a5a5fe459b7 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:16.211365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c857b36-bbc0-4e86-bc71-8a5a5fe459b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:16.229240 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-2c857b36-bbc0-4e86-bc71-8a5a5fe459b7 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:16.230471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-2c857b36-bbc0-4e86-bc71-8a5a5fe459b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:16.291967 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1183/2379] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:16.301884 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e2960-e217-4990-975d-1db86eba638e admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:16.303390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6e6e2960-e217-4990-975d-1db86eba638e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:16.318639 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:16.371645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c857b36-bbc0-4e86-bc71-8a5a5fe459b7 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:16.375491 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e2960-e217-4990-975d-1db86eba638e admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:16.379343 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899428d-7e0e-4aae-bd16-6753d03d5c97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:16.379996 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899428d-7e0e-4aae-bd16-6753d03d5c97 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:16.380287 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899428d-7e0e-4aae-bd16-6753d03d5c97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:16.380566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899428d-7e0e-4aae-bd16-6753d03d5c97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:16.381031 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c857b36-bbc0-4e86-bc71-8a5a5fe459b7 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:16.384553 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a6f9b-0fec-4663-b18d-a46f6913ca33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:16.385805 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a6f9b-0fec-4663-b18d-a46f6913ca33 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:16.386105 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a6f9b-0fec-4663-b18d-a46f6913ca33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:16.386382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a6f9b-0fec-4663-b18d-a46f6913ca33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:16.388516 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-954a6f9b-0fec-4663-b18d-a46f6913ca33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:16.390528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7899428d-7e0e-4aae-bd16-6753d03d5c97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:16.392077 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7899428d-7e0e-4aae-bd16-6753d03d5c97 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:16.400289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a6f9b-0fec-4663-b18d-a46f6913ca33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:16.401869 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1197/2380] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:01:16.402025 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a6f9b-0fec-4663-b18d-a46f6913ca33 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:16.412272 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1184/2381] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 06:01:16.930833 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899428d-7e0e-4aae-bd16-6753d03d5c97 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:16.932621 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-7899428d-7e0e-4aae-bd16-6753d03d5c97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:16.947015 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899428d-7e0e-4aae-bd16-6753d03d5c97 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:16.952971 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee824b-e5cd-4d70-98b0-582bd7459810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:16.953640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee824b-e5cd-4d70-98b0-582bd7459810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:16.954092 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee824b-e5cd-4d70-98b0-582bd7459810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:16.954469 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee824b-e5cd-4d70-98b0-582bd7459810 admin admin] PATH_INFO: `/v3/projects/e2dc54c502f742298aed931c494481a4` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:16.957024 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee824b-e5cd-4d70-98b0-582bd7459810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2dc54c502f742298aed931c494481a4)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:16.959133 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee824b-e5cd-4d70-98b0-582bd7459810 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:17.026558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-28ee824b-e5cd-4d70-98b0-582bd7459810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2dc54c502f742298aed931c494481a4', 'request_id': 'req-28ee824b-e5cd-4d70-98b0-582bd7459810'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:17.036442 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-28ee824b-e5cd-4d70-98b0-582bd7459810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2dc54c502f742298aed931c494481a4', 'request_id': 'req-28ee824b-e5cd-4d70-98b0-582bd7459810'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:17.045526 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-28ee824b-e5cd-4d70-98b0-582bd7459810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2dc54c502f742298aed931c494481a4', 'request_id': 'req-28ee824b-e5cd-4d70-98b0-582bd7459810'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:17.071036 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-28ee824b-e5cd-4d70-98b0-582bd7459810 admin admin] The token cache is being invalidate because project e2dc54c502f742298aed931c494481a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:01:17.072009 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-28ee824b-e5cd-4d70-98b0-582bd7459810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:17.072917 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-28ee824b-e5cd-4d70-98b0-582bd7459810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:17.079531 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1198/2382] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:01:16 2022] DELETE /identity/v3/projects/e2dc54c502f742298aed931c494481a4 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:17.082414 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fcaf9-4163-415f-bc54-10ab65a4902d None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:17.083130 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fcaf9-4163-415f-bc54-10ab65a4902d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:17.083571 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fcaf9-4163-415f-bc54-10ab65a4902d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:17.114817 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-dd8fcaf9-4163-415f-bc54-10ab65a4902d None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:17.116787 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-dd8fcaf9-4163-415f-bc54-10ab65a4902d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:17.218105 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1185/2383] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:17.225616 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fb723-054e-4e62-8f93-ff98f4d6f6df None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:17.226219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fb723-054e-4e62-8f93-ff98f4d6f6df None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:17.226824 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fb723-054e-4e62-8f93-ff98f4d6f6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:17.252038 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-b51fb723-054e-4e62-8f93-ff98f4d6f6df None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:17.253740 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b51fb723-054e-4e62-8f93-ff98f4d6f6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:17.264637 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1199/2384] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:17.275178 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fcaf9-4163-415f-bc54-10ab65a4902d None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:17.288620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fcaf9-4163-415f-bc54-10ab65a4902d None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:17.294121 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2a237-29b9-4c59-bcfd-1fbbdf4240f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:17.295208 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2a237-29b9-4c59-bcfd-1fbbdf4240f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:17.295399 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2a237-29b9-4c59-bcfd-1fbbdf4240f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:17.296458 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2a237-29b9-4c59-bcfd-1fbbdf4240f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:17.297226 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e2a237-29b9-4c59-bcfd-1fbbdf4240f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 06:01:17.297717 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e2a237-29b9-4c59-bcfd-1fbbdf4240f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:17.300551 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e2a237-29b9-4c59-bcfd-1fbbdf4240f6 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:17.315068 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1186/2385] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 06:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 06:01:17.319402 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fb723-054e-4e62-8f93-ff98f4d6f6df None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:17.330182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fb723-054e-4e62-8f93-ff98f4d6f6df None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:17.334839 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f19a53-3a9f-4b5f-b347-60824d12340e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:17.335508 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f19a53-3a9f-4b5f-b347-60824d12340e admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:17.335794 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f19a53-3a9f-4b5f-b347-60824d12340e admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:17.336060 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f19a53-3a9f-4b5f-b347-60824d12340e admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:17.336919 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f19a53-3a9f-4b5f-b347-60824d12340e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:17.339724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f19a53-3a9f-4b5f-b347-60824d12340e admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:17.376483 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2a237-29b9-4c59-bcfd-1fbbdf4240f6 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:17.378510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1200/2386] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:01:17 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 06:01:17.390115 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2a237-29b9-4c59-bcfd-1fbbdf4240f6 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:17.467985 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a1cda-d8ec-4574-a0a0-11b883a65c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:17.470021 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a1cda-d8ec-4574-a0a0-11b883a65c91 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:17.470685 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a1cda-d8ec-4574-a0a0-11b883a65c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:17.471397 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a1cda-d8ec-4574-a0a0-11b883a65c91 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:17.472267 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a1cda-d8ec-4574-a0a0-11b883a65c91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:17.475431 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a1cda-d8ec-4574-a0a0-11b883a65c91 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:17.487841 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:17.505061 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1187/2387] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:01:17 2022] POST /identity/v3/users => generated 289 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 06:01:17.508819 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f19a53-3a9f-4b5f-b347-60824d12340e admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:17.521555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f19a53-3a9f-4b5f-b347-60824d12340e admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:17.527115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e61dc-6262-4a2d-a4a3-28985aac51e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:17.527905 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e61dc-6262-4a2d-a4a3-28985aac51e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:17.528084 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e61dc-6262-4a2d-a4a3-28985aac51e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:17.528366 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e61dc-6262-4a2d-a4a3-28985aac51e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:17.529107 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e61dc-6262-4a2d-a4a3-28985aac51e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:17.530774 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e61dc-6262-4a2d-a4a3-28985aac51e4 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:17.542608 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1201/2388] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:17.546659 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a1cda-d8ec-4574-a0a0-11b883a65c91 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:17.561971 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a1cda-d8ec-4574-a0a0-11b883a65c91 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:17.566990 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b7860-169e-49e8-9b01-d6e4b428782b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:17.567698 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b7860-169e-49e8-9b01-d6e4b428782b admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:17.567975 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b7860-169e-49e8-9b01-d6e4b428782b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:17.568255 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b7860-169e-49e8-9b01-d6e4b428782b admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:17.568982 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b7860-169e-49e8-9b01-d6e4b428782b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:17.570628 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b7860-169e-49e8-9b01-d6e4b428782b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:17.582636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1188/2389] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 06:01:17.587037 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e61dc-6262-4a2d-a4a3-28985aac51e4 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:17.597649 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e61dc-6262-4a2d-a4a3-28985aac51e4 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:17.602825 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682c35a-1b83-4f0f-9b02-97e4e844db63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:17.603763 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682c35a-1b83-4f0f-9b02-97e4e844db63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:17.604049 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682c35a-1b83-4f0f-9b02-97e4e844db63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:17.604319 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682c35a-1b83-4f0f-9b02-97e4e844db63 admin admin] PATH_INFO: `/v3/projects/449735c7b5474b85b5a0ae27d13fd403/users/26d4401bd59f4fca9c11b78b6b3ba407/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:17.622696 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682c35a-1b83-4f0f-9b02-97e4e844db63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=449735c7b5474b85b5a0ae27d13fd403, user_id=26d4401bd59f4fca9c11b78b6b3ba407, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:17.625418 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682c35a-1b83-4f0f-9b02-97e4e844db63 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:17.642266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1202/2390] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:17 2022] PUT /identity/v3/projects/449735c7b5474b85b5a0ae27d13fd403/users/26d4401bd59f4fca9c11b78b6b3ba407/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:17.654744 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624ab0a-e081-42a2-b20e-fa4309463385 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:17.655057 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624ab0a-e081-42a2-b20e-fa4309463385 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:17.656088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624ab0a-e081-42a2-b20e-fa4309463385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:17.684267 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-6624ab0a-e081-42a2-b20e-fa4309463385 None None] MFA Rules not processed for user `26d4401bd59f4fca9c11b78b6b3ba407`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:17.685501 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-6624ab0a-e081-42a2-b20e-fa4309463385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:17.759430 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1189/2391] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:17.764597 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682c35a-1b83-4f0f-9b02-97e4e844db63 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:17.809773 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:17.842077 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682c35a-1b83-4f0f-9b02-97e4e844db63 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:17.850289 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a014062-7d84-48e1-b8ad-9e5db9917b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:17.850971 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a014062-7d84-48e1-b8ad-9e5db9917b5d admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:17.851764 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a014062-7d84-48e1-b8ad-9e5db9917b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:17.851764 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a014062-7d84-48e1-b8ad-9e5db9917b5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:17.852239 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a014062-7d84-48e1-b8ad-9e5db9917b5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:17.854733 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a014062-7d84-48e1-b8ad-9e5db9917b5d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:17.900002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1203/2392] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:01:17 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:17.904123 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624ab0a-e081-42a2-b20e-fa4309463385 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:17.918671 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624ab0a-e081-42a2-b20e-fa4309463385 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:17.986113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47327f4b-90dc-4c6b-9c46-6533d7193833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:17.986897 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47327f4b-90dc-4c6b-9c46-6533d7193833 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:17.987246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47327f4b-90dc-4c6b-9c46-6533d7193833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:17.987628 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47327f4b-90dc-4c6b-9c46-6533d7193833 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:17.988677 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47327f4b-90dc-4c6b-9c46-6533d7193833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:17.990589 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47327f4b-90dc-4c6b-9c46-6533d7193833 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:18.013844 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1190/2393] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:01:17 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 06:01:18.017717 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a014062-7d84-48e1-b8ad-9e5db9917b5d admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:18.028549 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a014062-7d84-48e1-b8ad-9e5db9917b5d admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:18.033956 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d63af-fc9d-496d-a5f2-aeff76c52155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:18.034814 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d63af-fc9d-496d-a5f2-aeff76c52155 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:18.035167 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d63af-fc9d-496d-a5f2-aeff76c52155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:18.035513 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d63af-fc9d-496d-a5f2-aeff76c52155 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:18.036342 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d63af-fc9d-496d-a5f2-aeff76c52155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:18.040288 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d63af-fc9d-496d-a5f2-aeff76c52155 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:18.057434 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1204/2394] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:18.061152 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47327f4b-90dc-4c6b-9c46-6533d7193833 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:18.072248 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47327f4b-90dc-4c6b-9c46-6533d7193833 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:18.077690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8034d7-9f41-498f-a31f-b2954b29a194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:18.078681 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8034d7-9f41-498f-a31f-b2954b29a194 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:18.078966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8034d7-9f41-498f-a31f-b2954b29a194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:18.079243 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8034d7-9f41-498f-a31f-b2954b29a194 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:18.079974 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8034d7-9f41-498f-a31f-b2954b29a194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:18.081598 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8034d7-9f41-498f-a31f-b2954b29a194 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:18.092712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1191/2395] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:18.096718 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d63af-fc9d-496d-a5f2-aeff76c52155 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:18.113459 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d63af-fc9d-496d-a5f2-aeff76c52155 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:18.120095 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ca0f7-c204-4166-968f-6357e3c55790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:18.120589 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ca0f7-c204-4166-968f-6357e3c55790 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:18.120943 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ca0f7-c204-4166-968f-6357e3c55790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:18.121289 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ca0f7-c204-4166-968f-6357e3c55790 admin admin] PATH_INFO: `/v3/projects/44e9c847dbed45cc8c6f7c4fe19a23cd/users/d81401c34b604aa79d77263ba098a9ab/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:18.138765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ca0f7-c204-4166-968f-6357e3c55790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44e9c847dbed45cc8c6f7c4fe19a23cd, user_id=d81401c34b604aa79d77263ba098a9ab, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:18.141608 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ca0f7-c204-4166-968f-6357e3c55790 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:18.169515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325391eb-0231-460a-98e0-055f03395394 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:18.169800 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325391eb-0231-460a-98e0-055f03395394 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:18.170026 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1205/2396] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:18 2022] PUT /identity/v3/projects/44e9c847dbed45cc8c6f7c4fe19a23cd/users/d81401c34b604aa79d77263ba098a9ab/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:18.170154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325391eb-0231-460a-98e0-055f03395394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:18.204843 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-325391eb-0231-460a-98e0-055f03395394 None None] MFA Rules not processed for user `d81401c34b604aa79d77263ba098a9ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:18.206174 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-325391eb-0231-460a-98e0-055f03395394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:18.255549 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:18.294408 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1192/2397] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:18.299181 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ca0f7-c204-4166-968f-6357e3c55790 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:18.370040 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ca0f7-c204-4166-968f-6357e3c55790 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:18.374705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6547a9c-5690-4394-baff-fe77a75e55e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:18.375397 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6547a9c-5690-4394-baff-fe77a75e55e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:18.375680 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6547a9c-5690-4394-baff-fe77a75e55e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:18.375959 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6547a9c-5690-4394-baff-fe77a75e55e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:18.376680 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6547a9c-5690-4394-baff-fe77a75e55e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:18.378693 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6547a9c-5690-4394-baff-fe77a75e55e6 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:18.412004 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1206/2398] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:01:18 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:18.416045 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325391eb-0231-460a-98e0-055f03395394 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:18.428633 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325391eb-0231-460a-98e0-055f03395394 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:18.504920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266ad93-d4b7-411f-a285-f678532e3b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:18.505605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266ad93-d4b7-411f-a285-f678532e3b7c admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:18.505894 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266ad93-d4b7-411f-a285-f678532e3b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:18.506219 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266ad93-d4b7-411f-a285-f678532e3b7c admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:18.506957 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266ad93-d4b7-411f-a285-f678532e3b7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:18.508904 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266ad93-d4b7-411f-a285-f678532e3b7c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:18.539131 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1193/2399] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:01:18 2022] POST /identity/v3/users => generated 294 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:18.540619 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6547a9c-5690-4394-baff-fe77a75e55e6 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:18.555185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6547a9c-5690-4394-baff-fe77a75e55e6 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:18.560716 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf728e7-a120-4dcb-bb98-38770f3b6201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:18.561548 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf728e7-a120-4dcb-bb98-38770f3b6201 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:18.561976 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf728e7-a120-4dcb-bb98-38770f3b6201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:18.562364 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf728e7-a120-4dcb-bb98-38770f3b6201 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:18.563199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf728e7-a120-4dcb-bb98-38770f3b6201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:18.565181 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf728e7-a120-4dcb-bb98-38770f3b6201 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:18.581331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1207/2400] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:18.583280 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266ad93-d4b7-411f-a285-f678532e3b7c admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:18.594771 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266ad93-d4b7-411f-a285-f678532e3b7c admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:18.602182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b125c0f-3650-4b9b-86f2-ef68069b8810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:18.603387 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b125c0f-3650-4b9b-86f2-ef68069b8810 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:18.604284 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b125c0f-3650-4b9b-86f2-ef68069b8810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:18.604781 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b125c0f-3650-4b9b-86f2-ef68069b8810 admin admin] PATH_INFO: `/v3/projects/8f7114ecf71f4e5d954e12d97cc775ab/users/715db77108da43b8af267497ea0bc350/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:18.622827 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b125c0f-3650-4b9b-86f2-ef68069b8810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f7114ecf71f4e5d954e12d97cc775ab, user_id=715db77108da43b8af267497ea0bc350, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:18.626487 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b125c0f-3650-4b9b-86f2-ef68069b8810 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:18.644150 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1194/2401] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:18 2022] PUT /identity/v3/projects/8f7114ecf71f4e5d954e12d97cc775ab/users/715db77108da43b8af267497ea0bc350/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:18.648115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf728e7-a120-4dcb-bb98-38770f3b6201 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:18.660322 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf728e7-a120-4dcb-bb98-38770f3b6201 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:18.724259 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a05ae-4d3b-4f19-9f9b-d6c3d48ccd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:18.724937 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a05ae-4d3b-4f19-9f9b-d6c3d48ccd13 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:18.725222 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a05ae-4d3b-4f19-9f9b-d6c3d48ccd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:18.725500 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a05ae-4d3b-4f19-9f9b-d6c3d48ccd13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:18.726279 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a05ae-4d3b-4f19-9f9b-d6c3d48ccd13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:18.727941 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a05ae-4d3b-4f19-9f9b-d6c3d48ccd13 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:18.729482 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:18.743000 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1208/2402] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:18.744447 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b125c0f-3650-4b9b-86f2-ef68069b8810 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:18.757195 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b125c0f-3650-4b9b-86f2-ef68069b8810 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:18.763948 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffd9af-4e14-433a-a6c9-9643ad58792e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:18.764857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffd9af-4e14-433a-a6c9-9643ad58792e admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:18.765142 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffd9af-4e14-433a-a6c9-9643ad58792e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:18.765421 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffd9af-4e14-433a-a6c9-9643ad58792e admin admin] PATH_INFO: `/v3/projects/8f7114ecf71f4e5d954e12d97cc775ab/users/715db77108da43b8af267497ea0bc350/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:18.767503 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffd9af-4e14-433a-a6c9-9643ad58792e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f7114ecf71f4e5d954e12d97cc775ab, user_id=715db77108da43b8af267497ea0bc350, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:18.770950 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffd9af-4e14-433a-a6c9-9643ad58792e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:18.783973 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1195/2403] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:18 2022] PUT /identity/v3/projects/8f7114ecf71f4e5d954e12d97cc775ab/users/715db77108da43b8af267497ea0bc350/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:18.794313 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7231d-5ed1-4703-8416-128c98ba76ef None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:18.794882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7231d-5ed1-4703-8416-128c98ba76ef None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:18.795263 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7231d-5ed1-4703-8416-128c98ba76ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:18.825663 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-8da7231d-5ed1-4703-8416-128c98ba76ef None None] MFA Rules not processed for user `715db77108da43b8af267497ea0bc350`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:18.826975 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-8da7231d-5ed1-4703-8416-128c98ba76ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:18.923389 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1209/2404] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:18.936628 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffd9af-4e14-433a-a6c9-9643ad58792e admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:18.938837 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-eaffd9af-4e14-433a-a6c9-9643ad58792e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:19.012317 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffd9af-4e14-433a-a6c9-9643ad58792e admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:19.016114 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475486f1-1c74-4253-bd3c-d355a938c3e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:19.016763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475486f1-1c74-4253-bd3c-d355a938c3e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:19.017045 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475486f1-1c74-4253-bd3c-d355a938c3e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:19.017325 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475486f1-1c74-4253-bd3c-d355a938c3e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:19.068146 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:19.084620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475486f1-1c74-4253-bd3c-d355a938c3e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:19.085874 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475486f1-1c74-4253-bd3c-d355a938c3e2 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:19.106115 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1196/2405] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:01:19.540103 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7231d-5ed1-4703-8416-128c98ba76ef None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:19.542909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-8da7231d-5ed1-4703-8416-128c98ba76ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:19.627293 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7231d-5ed1-4703-8416-128c98ba76ef None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:19.631200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9061ca-fa03-4a7b-a958-62db2a24f949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:19.631868 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9061ca-fa03-4a7b-a958-62db2a24f949 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:19.632135 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9061ca-fa03-4a7b-a958-62db2a24f949 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:19.632413 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9061ca-fa03-4a7b-a958-62db2a24f949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:19.634331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-dc9061ca-fa03-4a7b-a958-62db2a24f949 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:19.709177 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9061ca-fa03-4a7b-a958-62db2a24f949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:19.711362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9061ca-fa03-4a7b-a958-62db2a24f949 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:19.723365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1210/2406] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:01:20.335753 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475486f1-1c74-4253-bd3c-d355a938c3e2 service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:20.337287 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-475486f1-1c74-4253-bd3c-d355a938c3e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:20.352538 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475486f1-1c74-4253-bd3c-d355a938c3e2 service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:20.358662 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212f5bd-069f-4ff2-8fba-710c023ba912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:20.359712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212f5bd-069f-4ff2-8fba-710c023ba912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:20.360123 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212f5bd-069f-4ff2-8fba-710c023ba912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:20.360477 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212f5bd-069f-4ff2-8fba-710c023ba912 admin admin] PATH_INFO: `/v3/users/f4cd1d7c5a4a4b658f7abf8e434cf716` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:20.361991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212f5bd-069f-4ff2-8fba-710c023ba912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4cd1d7c5a4a4b658f7abf8e434cf716)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:20.363967 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212f5bd-069f-4ff2-8fba-710c023ba912 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:20.414029 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-0212f5bd-069f-4ff2-8fba-710c023ba912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4cd1d7c5a4a4b658f7abf8e434cf716'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:20.423500 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-0212f5bd-069f-4ff2-8fba-710c023ba912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4cd1d7c5a4a4b658f7abf8e434cf716'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:20.424224 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-0212f5bd-069f-4ff2-8fba-710c023ba912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4cd1d7c5a4a4b658f7abf8e434cf716'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:20.424908 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-0212f5bd-069f-4ff2-8fba-710c023ba912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4cd1d7c5a4a4b658f7abf8e434cf716'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:20.437051 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-0212f5bd-069f-4ff2-8fba-710c023ba912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4cd1d7c5a4a4b658f7abf8e434cf716'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:20.452273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1197/2407] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:01:20 2022] DELETE /identity/v3/users/f4cd1d7c5a4a4b658f7abf8e434cf716 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:20.774284 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9061ca-fa03-4a7b-a958-62db2a24f949 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:20.785790 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9061ca-fa03-4a7b-a958-62db2a24f949 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:20.820531 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212f5bd-069f-4ff2-8fba-710c023ba912 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:20.823542 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:20.827064 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-0212f5bd-069f-4ff2-8fba-710c023ba912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:20.870330 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9e850-fe9d-40a4-967a-5df7b161dee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:20.871267 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9e850-fe9d-40a4-967a-5df7b161dee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:20.871551 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9e850-fe9d-40a4-967a-5df7b161dee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:20.871823 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9e850-fe9d-40a4-967a-5df7b161dee8 admin admin] PATH_INFO: `/v3/projects/ed1571657afc4ffd9fa9125c251de2c8` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:20.873802 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9e850-fe9d-40a4-967a-5df7b161dee8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed1571657afc4ffd9fa9125c251de2c8)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:20.876480 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9e850-fe9d-40a4-967a-5df7b161dee8 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:20.913464 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212f5bd-069f-4ff2-8fba-710c023ba912 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:20.919035 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee4651-720e-4d04-909c-8a84f7a7863a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:20.919910 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee4651-720e-4d04-909c-8a84f7a7863a service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:20.920206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee4651-720e-4d04-909c-8a84f7a7863a service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:20.920489 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee4651-720e-4d04-909c-8a84f7a7863a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:20.923237 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-02ee4651-720e-4d04-909c-8a84f7a7863a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:20.964148 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-98b9e850-fe9d-40a4-967a-5df7b161dee8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed1571657afc4ffd9fa9125c251de2c8', 'request_id': 'req-98b9e850-fe9d-40a4-967a-5df7b161dee8'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:20.980369 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-98b9e850-fe9d-40a4-967a-5df7b161dee8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed1571657afc4ffd9fa9125c251de2c8', 'request_id': 'req-98b9e850-fe9d-40a4-967a-5df7b161dee8'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:20.995743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-98b9e850-fe9d-40a4-967a-5df7b161dee8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed1571657afc4ffd9fa9125c251de2c8', 'request_id': 'req-98b9e850-fe9d-40a4-967a-5df7b161dee8'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:21.015595 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee4651-720e-4d04-909c-8a84f7a7863a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:21.017074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee4651-720e-4d04-909c-8a84f7a7863a service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:21.019519 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-98b9e850-fe9d-40a4-967a-5df7b161dee8 admin admin] The token cache is being invalidate because project ed1571657afc4ffd9fa9125c251de2c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:01:21.022253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-98b9e850-fe9d-40a4-967a-5df7b161dee8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:21.023923 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-98b9e850-fe9d-40a4-967a-5df7b161dee8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:21.026849 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1211/2408] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:01:20 2022] DELETE /identity/v3/projects/ed1571657afc4ffd9fa9125c251de2c8 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:21.029039 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1198/2409] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:01:21.035697 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025af38-0056-451a-9791-a0eafc7dc08b None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:21.036021 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025af38-0056-451a-9791-a0eafc7dc08b None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:21.039187 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025af38-0056-451a-9791-a0eafc7dc08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:21.062281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-8025af38-0056-451a-9791-a0eafc7dc08b None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:21.063497 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-8025af38-0056-451a-9791-a0eafc7dc08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:21.153979 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1212/2410] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:21.155801 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657e213-970c-4e35-9514-66766716d7bc None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:21.156092 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657e213-970c-4e35-9514-66766716d7bc None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:21.156378 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657e213-970c-4e35-9514-66766716d7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:21.187802 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-3657e213-970c-4e35-9514-66766716d7bc None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:21.189424 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3657e213-970c-4e35-9514-66766716d7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:21.202850 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1199/2411] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:21.207261 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025af38-0056-451a-9791-a0eafc7dc08b None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:21.218555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025af38-0056-451a-9791-a0eafc7dc08b None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:21.224093 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845936c-a2bc-4fec-b023-019bc504b9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:21.224775 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845936c-a2bc-4fec-b023-019bc504b9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:21.225062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845936c-a2bc-4fec-b023-019bc504b9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:21.225335 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845936c-a2bc-4fec-b023-019bc504b9e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:21.226100 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845936c-a2bc-4fec-b023-019bc504b9e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 06:01:21.226405 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845936c-a2bc-4fec-b023-019bc504b9e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:21.228039 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845936c-a2bc-4fec-b023-019bc504b9e1 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:21.242018 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1213/2412] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 06:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 06:01:21.245377 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657e213-970c-4e35-9514-66766716d7bc None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:21.256731 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657e213-970c-4e35-9514-66766716d7bc None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:21.263334 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97df0f-a9ac-4e17-b34d-4e14b5284ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:21.263985 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97df0f-a9ac-4e17-b34d-4e14b5284ecd admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:21.264458 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97df0f-a9ac-4e17-b34d-4e14b5284ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:21.264856 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97df0f-a9ac-4e17-b34d-4e14b5284ecd admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:21.265760 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97df0f-a9ac-4e17-b34d-4e14b5284ecd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:21.268264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97df0f-a9ac-4e17-b34d-4e14b5284ecd admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:21.273452 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:21.304100 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1200/2413] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:01:21 2022] POST /identity/v3/projects => generated 405 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:21.308748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845936c-a2bc-4fec-b023-019bc504b9e1 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:21.320794 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845936c-a2bc-4fec-b023-019bc504b9e1 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:21.398380 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:21.415358 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c1ed4-0016-49ca-b44e-150991cb903c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:21.416658 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c1ed4-0016-49ca-b44e-150991cb903c admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:21.417447 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c1ed4-0016-49ca-b44e-150991cb903c admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:21.418026 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c1ed4-0016-49ca-b44e-150991cb903c admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:21.419044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c1ed4-0016-49ca-b44e-150991cb903c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:21.421578 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c1ed4-0016-49ca-b44e-150991cb903c admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:21.444888 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1214/2414] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:01:21 2022] POST /identity/v3/users => generated 303 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:21.449499 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97df0f-a9ac-4e17-b34d-4e14b5284ecd admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:21.461006 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97df0f-a9ac-4e17-b34d-4e14b5284ecd admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:21.467702 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcd434-1e4d-4fdf-88f6-d8a2517e984d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:21.468728 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcd434-1e4d-4fdf-88f6-d8a2517e984d admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:21.469812 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcd434-1e4d-4fdf-88f6-d8a2517e984d admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:21.470266 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcd434-1e4d-4fdf-88f6-d8a2517e984d admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:21.471174 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcd434-1e4d-4fdf-88f6-d8a2517e984d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:21.473613 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcd434-1e4d-4fdf-88f6-d8a2517e984d admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:21.487910 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1201/2415] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 06:01:21.492220 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c1ed4-0016-49ca-b44e-150991cb903c admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:21.503142 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c1ed4-0016-49ca-b44e-150991cb903c admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:21.508227 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06827f-dc9e-4798-b6ee-eda168410cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:21.508944 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06827f-dc9e-4798-b6ee-eda168410cdb admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:21.509235 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06827f-dc9e-4798-b6ee-eda168410cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:21.509564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06827f-dc9e-4798-b6ee-eda168410cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:21.510896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06827f-dc9e-4798-b6ee-eda168410cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:21.512506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06827f-dc9e-4798-b6ee-eda168410cdb admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:21.526762 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1215/2416] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:21.531416 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcd434-1e4d-4fdf-88f6-d8a2517e984d admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:21.544027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcd434-1e4d-4fdf-88f6-d8a2517e984d admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:21.550197 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9bf14-b644-466b-a6ed-7622a3c20d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:21.552287 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9bf14-b644-466b-a6ed-7622a3c20d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:21.552580 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9bf14-b644-466b-a6ed-7622a3c20d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:21.552862 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9bf14-b644-466b-a6ed-7622a3c20d83 admin admin] PATH_INFO: `/v3/projects/553009ff82dd473998047ac16d2d25d7/users/b6a768ed9a4f4a9ea526cb5ed672e5e5/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:21.576250 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9bf14-b644-466b-a6ed-7622a3c20d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=553009ff82dd473998047ac16d2d25d7, user_id=b6a768ed9a4f4a9ea526cb5ed672e5e5, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:21.577918 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9bf14-b644-466b-a6ed-7622a3c20d83 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:21.593981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1202/2417] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:21 2022] PUT /identity/v3/projects/553009ff82dd473998047ac16d2d25d7/users/b6a768ed9a4f4a9ea526cb5ed672e5e5/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:21.603760 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b54336-3649-4283-8c73-ec134e55d4d4 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:21.604379 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b54336-3649-4283-8c73-ec134e55d4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:21.604600 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b54336-3649-4283-8c73-ec134e55d4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:21.636097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-16b54336-3649-4283-8c73-ec134e55d4d4 None None] MFA Rules not processed for user `b6a768ed9a4f4a9ea526cb5ed672e5e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:21.637276 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-16b54336-3649-4283-8c73-ec134e55d4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:21.725110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1216/2418] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:21 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:21.727613 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9bf14-b644-466b-a6ed-7622a3c20d83 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:21.729876 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b54336-3649-4283-8c73-ec134e55d4d4 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:21.730626 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-fbf9bf14-b644-466b-a6ed-7622a3c20d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:21.817136 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b54336-3649-4283-8c73-ec134e55d4d4 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:21.821815 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9bf14-b644-466b-a6ed-7622a3c20d83 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:21.824273 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e06f7-e6ad-4600-a599-4ca0f88907ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:21.825160 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e06f7-e6ad-4600-a599-4ca0f88907ca admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:21.825436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e06f7-e6ad-4600-a599-4ca0f88907ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:21.825713 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e06f7-e6ad-4600-a599-4ca0f88907ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:21.826460 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e06f7-e6ad-4600-a599-4ca0f88907ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:21.828755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e06f7-e6ad-4600-a599-4ca0f88907ca admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:21.829581 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467782b-27e8-4e77-bee5-333a699d0ce2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:21.830653 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467782b-27e8-4e77-bee5-333a699d0ce2 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:21.831158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467782b-27e8-4e77-bee5-333a699d0ce2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:21.831651 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467782b-27e8-4e77-bee5-333a699d0ce2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:21.833894 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-9467782b-27e8-4e77-bee5-333a699d0ce2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:21.872804 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1217/2419] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:01:21 2022] POST /identity/v3/projects => generated 405 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:21.875426 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e06f7-e6ad-4600-a599-4ca0f88907ca admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:21.962006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:21.992439 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e06f7-e6ad-4600-a599-4ca0f88907ca admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:21.993631 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9467782b-27e8-4e77-bee5-333a699d0ce2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:21.995344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9467782b-27e8-4e77-bee5-333a699d0ce2 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:22.004525 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34844e49-8bdd-4e4d-b0a3-6ff90d3e454a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:22.005695 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1203/2420] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 06:01:22.006117 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34844e49-8bdd-4e4d-b0a3-6ff90d3e454a admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:22.006613 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34844e49-8bdd-4e4d-b0a3-6ff90d3e454a admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:22.007206 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34844e49-8bdd-4e4d-b0a3-6ff90d3e454a admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:22.008489 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34844e49-8bdd-4e4d-b0a3-6ff90d3e454a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:22.013050 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34844e49-8bdd-4e4d-b0a3-6ff90d3e454a admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:22.055094 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1218/2421] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:01:21 2022] POST /identity/v3/users => generated 309 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:22.057014 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467782b-27e8-4e77-bee5-333a699d0ce2 service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:22.073009 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467782b-27e8-4e77-bee5-333a699d0ce2 service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:22.084061 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06e81e-6295-4d6f-a334-4e096788a521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:22.084977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06e81e-6295-4d6f-a334-4e096788a521 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:22.085432 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06e81e-6295-4d6f-a334-4e096788a521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:22.086039 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06e81e-6295-4d6f-a334-4e096788a521 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:22.087633 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06e81e-6295-4d6f-a334-4e096788a521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:22.093273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06e81e-6295-4d6f-a334-4e096788a521 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:22.118335 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1204/2422] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:22.122652 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34844e49-8bdd-4e4d-b0a3-6ff90d3e454a admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:22.141822 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34844e49-8bdd-4e4d-b0a3-6ff90d3e454a admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:22.154293 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff147c-9977-4b86-88af-f259a7986ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:22.155365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff147c-9977-4b86-88af-f259a7986ce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:22.155729 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff147c-9977-4b86-88af-f259a7986ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:22.156253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff147c-9977-4b86-88af-f259a7986ce9 admin admin] PATH_INFO: `/v3/projects/1e10e8db39cf471c91e0ab90246b7f2c/users/7e469a937fbb42d0bd457eb588975843/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:22.174415 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff147c-9977-4b86-88af-f259a7986ce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e10e8db39cf471c91e0ab90246b7f2c, user_id=7e469a937fbb42d0bd457eb588975843, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:22.177209 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff147c-9977-4b86-88af-f259a7986ce9 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:22.198720 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1219/2423] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:22 2022] PUT /identity/v3/projects/1e10e8db39cf471c91e0ab90246b7f2c/users/7e469a937fbb42d0bd457eb588975843/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:22.202781 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06e81e-6295-4d6f-a334-4e096788a521 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:22.214659 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06e81e-6295-4d6f-a334-4e096788a521 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:22.278820 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:22.297127 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c83e06-bfa1-497d-a52f-cea06f3b00d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:22.297798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c83e06-bfa1-497d-a52f-cea06f3b00d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:22.298549 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c83e06-bfa1-497d-a52f-cea06f3b00d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:22.298836 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c83e06-bfa1-497d-a52f-cea06f3b00d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:22.299568 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c83e06-bfa1-497d-a52f-cea06f3b00d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:22.301769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c83e06-bfa1-497d-a52f-cea06f3b00d7 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:22.319856 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1205/2424] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:22.321563 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff147c-9977-4b86-88af-f259a7986ce9 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:22.348224 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff147c-9977-4b86-88af-f259a7986ce9 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:22.356485 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2385932-d956-4fc1-9752-ece775789f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:22.357421 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2385932-d956-4fc1-9752-ece775789f66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:22.357714 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2385932-d956-4fc1-9752-ece775789f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:22.358023 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2385932-d956-4fc1-9752-ece775789f66 admin admin] PATH_INFO: `/v3/projects/1e10e8db39cf471c91e0ab90246b7f2c/users/7e469a937fbb42d0bd457eb588975843/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:22.361209 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2385932-d956-4fc1-9752-ece775789f66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e10e8db39cf471c91e0ab90246b7f2c, user_id=7e469a937fbb42d0bd457eb588975843, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:22.368935 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2385932-d956-4fc1-9752-ece775789f66 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:22.383833 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1220/2425] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:22 2022] PUT /identity/v3/projects/1e10e8db39cf471c91e0ab90246b7f2c/users/7e469a937fbb42d0bd457eb588975843/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:22.394890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562402dd-a10b-4031-945f-c0c4d874561a None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:22.395459 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562402dd-a10b-4031-945f-c0c4d874561a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:22.395833 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562402dd-a10b-4031-945f-c0c4d874561a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:22.428749 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-562402dd-a10b-4031-945f-c0c4d874561a None None] MFA Rules not processed for user `7e469a937fbb42d0bd457eb588975843`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:22.430032 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-562402dd-a10b-4031-945f-c0c4d874561a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:22.510717 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1206/2426] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:22 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:22.521785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2385932-d956-4fc1-9752-ece775789f66 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:22.582098 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2385932-d956-4fc1-9752-ece775789f66 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:22.585760 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa0d7a-a2c3-44ab-82c7-6bbe1709117c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:22.586447 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa0d7a-a2c3-44ab-82c7-6bbe1709117c service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:22.586740 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa0d7a-a2c3-44ab-82c7-6bbe1709117c service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:22.587023 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa0d7a-a2c3-44ab-82c7-6bbe1709117c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:22.597375 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa0d7a-a2c3-44ab-82c7-6bbe1709117c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:22.598869 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa0d7a-a2c3-44ab-82c7-6bbe1709117c service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:22.608368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1221/2427] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:22 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:01:22.741427 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562402dd-a10b-4031-945f-c0c4d874561a None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:22.817870 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562402dd-a10b-4031-945f-c0c4d874561a None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:22.824298 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56afc5-81ef-4946-836c-9ff2cc2c53d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:22.825480 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56afc5-81ef-4946-836c-9ff2cc2c53d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:22.825883 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56afc5-81ef-4946-836c-9ff2cc2c53d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:22.826295 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56afc5-81ef-4946-836c-9ff2cc2c53d9 admin admin] PATH_INFO: `/v3/users/b6a768ed9a4f4a9ea526cb5ed672e5e5` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:22.828721 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56afc5-81ef-4946-836c-9ff2cc2c53d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6a768ed9a4f4a9ea526cb5ed672e5e5)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:22.830902 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56afc5-81ef-4946-836c-9ff2cc2c53d9 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:22.891932 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5a56afc5-81ef-4946-836c-9ff2cc2c53d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6a768ed9a4f4a9ea526cb5ed672e5e5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:22.900032 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5a56afc5-81ef-4946-836c-9ff2cc2c53d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6a768ed9a4f4a9ea526cb5ed672e5e5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:22.900892 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5a56afc5-81ef-4946-836c-9ff2cc2c53d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6a768ed9a4f4a9ea526cb5ed672e5e5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:22.901879 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5a56afc5-81ef-4946-836c-9ff2cc2c53d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6a768ed9a4f4a9ea526cb5ed672e5e5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:22.915952 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5a56afc5-81ef-4946-836c-9ff2cc2c53d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6a768ed9a4f4a9ea526cb5ed672e5e5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:22.918264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:22.932020 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1207/2428] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:01:22 2022] DELETE /identity/v3/users/b6a768ed9a4f4a9ea526cb5ed672e5e5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:22.936900 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49516f6a-cb11-4c59-b6f0-58ebbcb81e98 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:22.937815 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49516f6a-cb11-4c59-b6f0-58ebbcb81e98 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:22.938298 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49516f6a-cb11-4c59-b6f0-58ebbcb81e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:22.959172 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-49516f6a-cb11-4c59-b6f0-58ebbcb81e98 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:22.960490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-49516f6a-cb11-4c59-b6f0-58ebbcb81e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:23.030533 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1222/2429] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:23.040507 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56afc5-81ef-4946-836c-9ff2cc2c53d9 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:23.042577 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5a56afc5-81ef-4946-836c-9ff2cc2c53d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:23.111676 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56afc5-81ef-4946-836c-9ff2cc2c53d9 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:23.115492 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446a6dc-c0a6-4bc4-8641-697967e14b79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:23.116247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446a6dc-c0a6-4bc4-8641-697967e14b79 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:23.116621 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446a6dc-c0a6-4bc4-8641-697967e14b79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:23.116970 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446a6dc-c0a6-4bc4-8641-697967e14b79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:23.126789 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446a6dc-c0a6-4bc4-8641-697967e14b79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:23.128335 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446a6dc-c0a6-4bc4-8641-697967e14b79 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:23.138414 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1208/2430] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 06:01:23.600914 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49516f6a-cb11-4c59-b6f0-58ebbcb81e98 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:23.605334 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-49516f6a-cb11-4c59-b6f0-58ebbcb81e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:23.666175 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446a6dc-c0a6-4bc4-8641-697967e14b79 service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:23.668626 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1446a6dc-c0a6-4bc4-8641-697967e14b79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:23.690124 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446a6dc-c0a6-4bc4-8641-697967e14b79 service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:23.706740 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debd4e6-c389-4849-8d94-2cd1c9b1677b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:23.707892 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debd4e6-c389-4849-8d94-2cd1c9b1677b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:23.708352 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debd4e6-c389-4849-8d94-2cd1c9b1677b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:23.708661 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debd4e6-c389-4849-8d94-2cd1c9b1677b admin admin] PATH_INFO: `/v3/users/abd380b05ae94a29bdf56c529f1d411e` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:23.713237 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debd4e6-c389-4849-8d94-2cd1c9b1677b admin admin] RBAC: Authorizing `identity:delete_user(user_id=abd380b05ae94a29bdf56c529f1d411e)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:23.714964 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debd4e6-c389-4849-8d94-2cd1c9b1677b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:23.716386 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:23.762498 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49516f6a-cb11-4c59-b6f0-58ebbcb81e98 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:23.768532 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b513f1e-8bf7-446a-9ff2-bb45811c755c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17a40bea6ba41f19c88e16f9b15cf27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:23.769203 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b513f1e-8bf7-446a-9ff2-bb45811c755c service placement] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:23.769495 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b513f1e-8bf7-446a-9ff2-bb45811c755c service placement] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:23.769785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b513f1e-8bf7-446a-9ff2-bb45811c755c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:23.771644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-2b513f1e-8bf7-446a-9ff2-bb45811c755c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:23.777278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6debd4e6-c389-4849-8d94-2cd1c9b1677b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abd380b05ae94a29bdf56c529f1d411e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:23.784741 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b513f1e-8bf7-446a-9ff2-bb45811c755c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:23.786536 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b513f1e-8bf7-446a-9ff2-bb45811c755c service placement] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:23.787428 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6debd4e6-c389-4849-8d94-2cd1c9b1677b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abd380b05ae94a29bdf56c529f1d411e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:23.788089 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6debd4e6-c389-4849-8d94-2cd1c9b1677b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abd380b05ae94a29bdf56c529f1d411e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:23.788781 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6debd4e6-c389-4849-8d94-2cd1c9b1677b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abd380b05ae94a29bdf56c529f1d411e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:23.797787 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1223/2431] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:01:23.798658 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b513f1e-8bf7-446a-9ff2-bb45811c755c service placement] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:23.799944 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-2b513f1e-8bf7-446a-9ff2-bb45811c755c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:23.805098 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6debd4e6-c389-4849-8d94-2cd1c9b1677b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abd380b05ae94a29bdf56c529f1d411e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:23.813704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b513f1e-8bf7-446a-9ff2-bb45811c755c service placement] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:23.819265 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10da40-6258-4699-b7b6-5943defa0947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:23.820133 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10da40-6258-4699-b7b6-5943defa0947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:23.820422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10da40-6258-4699-b7b6-5943defa0947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:23.820705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10da40-6258-4699-b7b6-5943defa0947 admin admin] PATH_INFO: `/v3/projects/553009ff82dd473998047ac16d2d25d7` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:23.821902 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee10da40-6258-4699-b7b6-5943defa0947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=553009ff82dd473998047ac16d2d25d7)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:23.823839 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee10da40-6258-4699-b7b6-5943defa0947 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:23.826710 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1209/2432] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:01:23 2022] DELETE /identity/v3/users/abd380b05ae94a29bdf56c529f1d411e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:23.876814 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ee10da40-6258-4699-b7b6-5943defa0947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '553009ff82dd473998047ac16d2d25d7', 'request_id': 'req-ee10da40-6258-4699-b7b6-5943defa0947'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:23.886999 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ee10da40-6258-4699-b7b6-5943defa0947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '553009ff82dd473998047ac16d2d25d7', 'request_id': 'req-ee10da40-6258-4699-b7b6-5943defa0947'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:23.893773 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ee10da40-6258-4699-b7b6-5943defa0947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '553009ff82dd473998047ac16d2d25d7', 'request_id': 'req-ee10da40-6258-4699-b7b6-5943defa0947'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:23.909592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ee10da40-6258-4699-b7b6-5943defa0947 admin admin] The token cache is being invalidate because project 553009ff82dd473998047ac16d2d25d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:01:23.910078 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ee10da40-6258-4699-b7b6-5943defa0947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:23.910782 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ee10da40-6258-4699-b7b6-5943defa0947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:23.912389 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1224/2433] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:01:23 2022] DELETE /identity/v3/projects/553009ff82dd473998047ac16d2d25d7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:23.917247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debd4e6-c389-4849-8d94-2cd1c9b1677b admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:23.918692 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-6debd4e6-c389-4849-8d94-2cd1c9b1677b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:23.992013 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debd4e6-c389-4849-8d94-2cd1c9b1677b admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:24.000725 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:24.019968 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10da40-6258-4699-b7b6-5943defa0947 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:24.021872 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ee10da40-6258-4699-b7b6-5943defa0947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:24.065507 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016d7a2-e87d-4603-a4bb-bd14da7d4a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:24.067833 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016d7a2-e87d-4603-a4bb-bd14da7d4a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:24.068944 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016d7a2-e87d-4603-a4bb-bd14da7d4a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:24.069315 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016d7a2-e87d-4603-a4bb-bd14da7d4a7e admin admin] PATH_INFO: `/v3/users/7e469a937fbb42d0bd457eb588975843` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:24.071754 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016d7a2-e87d-4603-a4bb-bd14da7d4a7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e469a937fbb42d0bd457eb588975843)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:24.075844 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016d7a2-e87d-4603-a4bb-bd14da7d4a7e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:24.120725 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10da40-6258-4699-b7b6-5943defa0947 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:24.126615 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683e728-2312-4992-9856-acfb2fb7f2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:24.127412 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683e728-2312-4992-9856-acfb2fb7f2ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:24.127702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683e728-2312-4992-9856-acfb2fb7f2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:24.127985 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683e728-2312-4992-9856-acfb2fb7f2ee admin admin] PATH_INFO: `/v3/projects/219135be95384a599a7c8e7df72175c2` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:24.129982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683e728-2312-4992-9856-acfb2fb7f2ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=219135be95384a599a7c8e7df72175c2)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:24.132109 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683e728-2312-4992-9856-acfb2fb7f2ee admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:24.143338 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7016d7a2-e87d-4603-a4bb-bd14da7d4a7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e469a937fbb42d0bd457eb588975843'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:24.153611 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7016d7a2-e87d-4603-a4bb-bd14da7d4a7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e469a937fbb42d0bd457eb588975843'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:24.154327 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7016d7a2-e87d-4603-a4bb-bd14da7d4a7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e469a937fbb42d0bd457eb588975843'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:24.155057 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7016d7a2-e87d-4603-a4bb-bd14da7d4a7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e469a937fbb42d0bd457eb588975843'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:24.170177 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7016d7a2-e87d-4603-a4bb-bd14da7d4a7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e469a937fbb42d0bd457eb588975843'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:24.183529 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1210/2434] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:01:23 2022] DELETE /identity/v3/users/7e469a937fbb42d0bd457eb588975843 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:24.191106 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e683e728-2312-4992-9856-acfb2fb7f2ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '219135be95384a599a7c8e7df72175c2', 'request_id': 'req-e683e728-2312-4992-9856-acfb2fb7f2ee'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:24.198636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:24.206283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e683e728-2312-4992-9856-acfb2fb7f2ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '219135be95384a599a7c8e7df72175c2', 'request_id': 'req-e683e728-2312-4992-9856-acfb2fb7f2ee'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:24.213628 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e683e728-2312-4992-9856-acfb2fb7f2ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '219135be95384a599a7c8e7df72175c2', 'request_id': 'req-e683e728-2312-4992-9856-acfb2fb7f2ee'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:24.227608 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e683e728-2312-4992-9856-acfb2fb7f2ee admin admin] The token cache is being invalidate because project 219135be95384a599a7c8e7df72175c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:01:24.228396 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e683e728-2312-4992-9856-acfb2fb7f2ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:24.229203 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e683e728-2312-4992-9856-acfb2fb7f2ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:24.230902 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1225/2435] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:01:24 2022] DELETE /identity/v3/projects/219135be95384a599a7c8e7df72175c2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:24.235962 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c59ef-3a5c-4db3-81a9-bff2bc8fdc03 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:24.236283 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c59ef-3a5c-4db3-81a9-bff2bc8fdc03 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:24.236571 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c59ef-3a5c-4db3-81a9-bff2bc8fdc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:24.256063 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-f75c59ef-3a5c-4db3-81a9-bff2bc8fdc03 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:24.257734 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f75c59ef-3a5c-4db3-81a9-bff2bc8fdc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:24.324873 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1211/2436] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:24.332623 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6263c2-e72f-46c8-8b52-e95fb9b84132 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:24.332918 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6263c2-e72f-46c8-8b52-e95fb9b84132 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:24.333203 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6263c2-e72f-46c8-8b52-e95fb9b84132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:24.353411 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-df6263c2-e72f-46c8-8b52-e95fb9b84132 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:24.354666 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-df6263c2-e72f-46c8-8b52-e95fb9b84132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:24.363111 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1226/2437] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:24.367635 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c59ef-3a5c-4db3-81a9-bff2bc8fdc03 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:24.379639 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c59ef-3a5c-4db3-81a9-bff2bc8fdc03 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:24.384318 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b80c0-7d4c-4ffe-a265-5ad4b080f59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:24.385550 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b80c0-7d4c-4ffe-a265-5ad4b080f59b admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:24.385835 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b80c0-7d4c-4ffe-a265-5ad4b080f59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:24.386144 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b80c0-7d4c-4ffe-a265-5ad4b080f59b admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:24.386867 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b80c0-7d4c-4ffe-a265-5ad4b080f59b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 06:01:24.387173 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b80c0-7d4c-4ffe-a265-5ad4b080f59b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:24.388781 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b80c0-7d4c-4ffe-a265-5ad4b080f59b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:24.400557 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1212/2438] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 06:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 06:01:24.404845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6263c2-e72f-46c8-8b52-e95fb9b84132 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:24.414099 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6263c2-e72f-46c8-8b52-e95fb9b84132 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:24.420126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3919c00-043c-4ded-99f2-92d47a3306a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:24.420857 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3919c00-043c-4ded-99f2-92d47a3306a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:24.421091 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3919c00-043c-4ded-99f2-92d47a3306a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:24.421373 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3919c00-043c-4ded-99f2-92d47a3306a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:24.422134 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3919c00-043c-4ded-99f2-92d47a3306a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:24.424058 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3919c00-043c-4ded-99f2-92d47a3306a8 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:24.452324 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1227/2439] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:01:24 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:24.456527 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b80c0-7d4c-4ffe-a265-5ad4b080f59b admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:24.470849 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b80c0-7d4c-4ffe-a265-5ad4b080f59b admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:24.472004 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3919c00-043c-4ded-99f2-92d47a3306a8 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:24.474360 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b3919c00-043c-4ded-99f2-92d47a3306a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:24.484594 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:24.539676 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4879aac-b7d7-4c8d-aaab-78d05281848a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:24.540347 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4879aac-b7d7-4c8d-aaab-78d05281848a admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:24.540627 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4879aac-b7d7-4c8d-aaab-78d05281848a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:24.540904 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4879aac-b7d7-4c8d-aaab-78d05281848a admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:24.541594 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4879aac-b7d7-4c8d-aaab-78d05281848a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:24.543548 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4879aac-b7d7-4c8d-aaab-78d05281848a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:24.555669 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3919c00-043c-4ded-99f2-92d47a3306a8 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:24.561495 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f549ee-d741-4c15-88a0-e9b6061d81db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:24.562694 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f549ee-d741-4c15-88a0-e9b6061d81db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:24.562979 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f549ee-d741-4c15-88a0-e9b6061d81db admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:24.563349 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f549ee-d741-4c15-88a0-e9b6061d81db admin admin] PATH_INFO: `/v3/projects/1e10e8db39cf471c91e0ab90246b7f2c` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:24.564694 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f549ee-d741-4c15-88a0-e9b6061d81db admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e10e8db39cf471c91e0ab90246b7f2c)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:24.566681 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f549ee-d741-4c15-88a0-e9b6061d81db admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:24.567750 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1213/2440] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:01:24 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:24.571745 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4879aac-b7d7-4c8d-aaab-78d05281848a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:24.583334 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4879aac-b7d7-4c8d-aaab-78d05281848a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:24.589249 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b0745-d83d-4f6a-8deb-34e457c5de0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:24.590377 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b0745-d83d-4f6a-8deb-34e457c5de0e admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:24.590883 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b0745-d83d-4f6a-8deb-34e457c5de0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:24.591480 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b0745-d83d-4f6a-8deb-34e457c5de0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:24.592443 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b0745-d83d-4f6a-8deb-34e457c5de0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:24.595355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b0745-d83d-4f6a-8deb-34e457c5de0e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:24.606929 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1214/2441] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:24.617806 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b0745-d83d-4f6a-8deb-34e457c5de0e admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:24.620602 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c0f549ee-d741-4c15-88a0-e9b6061d81db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e10e8db39cf471c91e0ab90246b7f2c', 'request_id': 'req-c0f549ee-d741-4c15-88a0-e9b6061d81db'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:24.628320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c0f549ee-d741-4c15-88a0-e9b6061d81db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e10e8db39cf471c91e0ab90246b7f2c', 'request_id': 'req-c0f549ee-d741-4c15-88a0-e9b6061d81db'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:24.629597 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b0745-d83d-4f6a-8deb-34e457c5de0e admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:24.637294 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c0f549ee-d741-4c15-88a0-e9b6061d81db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e10e8db39cf471c91e0ab90246b7f2c', 'request_id': 'req-c0f549ee-d741-4c15-88a0-e9b6061d81db'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:24.652141 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c0f549ee-d741-4c15-88a0-e9b6061d81db admin admin] The token cache is being invalidate because project 1e10e8db39cf471c91e0ab90246b7f2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:01:24.652576 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c0f549ee-d741-4c15-88a0-e9b6061d81db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:24.653416 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c0f549ee-d741-4c15-88a0-e9b6061d81db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:24.655627 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1228/2442] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:01:24 2022] DELETE /identity/v3/projects/1e10e8db39cf471c91e0ab90246b7f2c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:24.660965 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8df79-106d-4e45-8097-1812bb4d2a99 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:24.661289 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8df79-106d-4e45-8097-1812bb4d2a99 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:24.661647 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8df79-106d-4e45-8097-1812bb4d2a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:24.682853 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-60f8df79-106d-4e45-8097-1812bb4d2a99 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:24.687300 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-60f8df79-106d-4e45-8097-1812bb4d2a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:24.695181 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43082f9-242a-4dbb-8e87-5c1f8548d5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:24.695856 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43082f9-242a-4dbb-8e87-5c1f8548d5ff admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:24.696141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43082f9-242a-4dbb-8e87-5c1f8548d5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:24.696418 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43082f9-242a-4dbb-8e87-5c1f8548d5ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:24.697450 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43082f9-242a-4dbb-8e87-5c1f8548d5ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:24.698814 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43082f9-242a-4dbb-8e87-5c1f8548d5ff admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:24.709663 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1215/2443] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:24.713733 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43082f9-242a-4dbb-8e87-5c1f8548d5ff admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:24.715907 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a43082f9-242a-4dbb-8e87-5c1f8548d5ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:24.726547 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:24.739964 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43082f9-242a-4dbb-8e87-5c1f8548d5ff admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:24.745591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d56ce5-0bb5-40bf-ac75-0261f08b94c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:24.746493 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d56ce5-0bb5-40bf-ac75-0261f08b94c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:24.746783 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d56ce5-0bb5-40bf-ac75-0261f08b94c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:24.747060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d56ce5-0bb5-40bf-ac75-0261f08b94c8 admin admin] PATH_INFO: `/v3/projects/7e9541fafe1549a38b7c8112af851961/users/8e69ed7fbf6f4d0f8138d9235df45f56/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:24.751977 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1229/2444] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:01:24.759626 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58639025-2c12-4936-b9aa-68f4a92a8aae None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:24.759943 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58639025-2c12-4936-b9aa-68f4a92a8aae None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:24.760319 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58639025-2c12-4936-b9aa-68f4a92a8aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:24.764110 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d56ce5-0bb5-40bf-ac75-0261f08b94c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e9541fafe1549a38b7c8112af851961, user_id=8e69ed7fbf6f4d0f8138d9235df45f56, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:24.766865 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d56ce5-0bb5-40bf-ac75-0261f08b94c8 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:24.780493 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-58639025-2c12-4936-b9aa-68f4a92a8aae None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:24.781845 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-58639025-2c12-4936-b9aa-68f4a92a8aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:24.784455 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1216/2445] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:24 2022] PUT /identity/v3/projects/7e9541fafe1549a38b7c8112af851961/users/8e69ed7fbf6f4d0f8138d9235df45f56/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:24.795524 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0fee4-e1f7-4638-a861-0ae738479097 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:24.795823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0fee4-e1f7-4638-a861-0ae738479097 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:24.796091 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0fee4-e1f7-4638-a861-0ae738479097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:24.826166 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-83e0fee4-e1f7-4638-a861-0ae738479097 None None] MFA Rules not processed for user `8e69ed7fbf6f4d0f8138d9235df45f56`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:24.827523 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-83e0fee4-e1f7-4638-a861-0ae738479097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:24.862458 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1230/2446] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:24.866753 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58639025-2c12-4936-b9aa-68f4a92a8aae None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:24.876924 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58639025-2c12-4936-b9aa-68f4a92a8aae None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:24.883680 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4945727-49af-40c2-8382-5015ac706d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:24.883680 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4945727-49af-40c2-8382-5015ac706d17 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:24.883680 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4945727-49af-40c2-8382-5015ac706d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:24.885922 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4945727-49af-40c2-8382-5015ac706d17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:24.885922 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4945727-49af-40c2-8382-5015ac706d17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 06:01:24.885922 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4945727-49af-40c2-8382-5015ac706d17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:24.887097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4945727-49af-40c2-8382-5015ac706d17 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:24.905036 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1231/2447] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 06:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 06:01:24.906114 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:24.906550 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4945727-49af-40c2-8382-5015ac706d17 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:24.915025 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1217/2448] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:01:24.921747 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4945727-49af-40c2-8382-5015ac706d17 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:24.923264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0fee4-e1f7-4638-a861-0ae738479097 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:24.924746 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-83e0fee4-e1f7-4638-a861-0ae738479097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:24.927411 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a35b7-2d6b-40d8-ab4e-4cc21661847f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:24.928151 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a35b7-2d6b-40d8-ab4e-4cc21661847f admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:24.928523 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a35b7-2d6b-40d8-ab4e-4cc21661847f admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:24.928958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a35b7-2d6b-40d8-ab4e-4cc21661847f admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:24.930674 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a35b7-2d6b-40d8-ab4e-4cc21661847f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:24.933219 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a35b7-2d6b-40d8-ab4e-4cc21661847f admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:24.969252 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1232/2449] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:01:24 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 06:01:24.971148 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a35b7-2d6b-40d8-ab4e-4cc21661847f admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:25.015495 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0fee4-e1f7-4638-a861-0ae738479097 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:25.039372 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a35b7-2d6b-40d8-ab4e-4cc21661847f admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:25.044746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd7d3b-64f0-4fe3-90d1-e427ebe84223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:25.045498 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd7d3b-64f0-4fe3-90d1-e427ebe84223 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:25.045847 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd7d3b-64f0-4fe3-90d1-e427ebe84223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:25.046221 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd7d3b-64f0-4fe3-90d1-e427ebe84223 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:25.046991 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd7d3b-64f0-4fe3-90d1-e427ebe84223 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:25.049113 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd7d3b-64f0-4fe3-90d1-e427ebe84223 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:25.074206 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1233/2450] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:01:24 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:25.075299 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd7d3b-64f0-4fe3-90d1-e427ebe84223 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:25.081261 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db156b1-6344-428b-ba99-3b879217c7d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:25.082065 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db156b1-6344-428b-ba99-3b879217c7d5 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:25.082354 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db156b1-6344-428b-ba99-3b879217c7d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:25.082695 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db156b1-6344-428b-ba99-3b879217c7d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:25.086126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd7d3b-64f0-4fe3-90d1-e427ebe84223 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:25.092007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea0bc5-e281-4340-8630-5e438c37add2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:25.092689 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea0bc5-e281-4340-8630-5e438c37add2 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:25.092952 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea0bc5-e281-4340-8630-5e438c37add2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:25.093241 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea0bc5-e281-4340-8630-5e438c37add2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:25.093983 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea0bc5-e281-4340-8630-5e438c37add2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:25.095583 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea0bc5-e281-4340-8630-5e438c37add2 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:25.109755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1234/2451] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 06:01:25.110858 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea0bc5-e281-4340-8630-5e438c37add2 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:25.125220 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea0bc5-e281-4340-8630-5e438c37add2 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:25.130940 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9e7ad-6a12-4f41-aa2c-9a6ec03230a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:25.131733 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9e7ad-6a12-4f41-aa2c-9a6ec03230a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:25.132013 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9e7ad-6a12-4f41-aa2c-9a6ec03230a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:25.132306 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9e7ad-6a12-4f41-aa2c-9a6ec03230a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:25.133206 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9e7ad-6a12-4f41-aa2c-9a6ec03230a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:25.135016 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9e7ad-6a12-4f41-aa2c-9a6ec03230a3 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:25.148206 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1235/2452] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:25.152645 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9e7ad-6a12-4f41-aa2c-9a6ec03230a3 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:25.157204 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db156b1-6344-428b-ba99-3b879217c7d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:25.159108 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db156b1-6344-428b-ba99-3b879217c7d5 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:25.163848 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9e7ad-6a12-4f41-aa2c-9a6ec03230a3 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:25.170374 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a8e85-db6b-474a-ac4a-cf14bffc80df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:25.170717 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1218/2453] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:01:25.171294 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a8e85-db6b-474a-ac4a-cf14bffc80df admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:25.171580 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a8e85-db6b-474a-ac4a-cf14bffc80df admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:25.171858 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a8e85-db6b-474a-ac4a-cf14bffc80df admin admin] PATH_INFO: `/v3/projects/7466691468674bc0a6e1665dec64e29e/users/5051fe1b5b314f7fabdb5bb9922f6032/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:25.185320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:25.188425 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a8e85-db6b-474a-ac4a-cf14bffc80df admin admin] RBAC: Authorizing `identity:create_grant(project_id=7466691468674bc0a6e1665dec64e29e, user_id=5051fe1b5b314f7fabdb5bb9922f6032, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:25.191741 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a8e85-db6b-474a-ac4a-cf14bffc80df admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:25.205411 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1236/2454] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:25 2022] PUT /identity/v3/projects/7466691468674bc0a6e1665dec64e29e/users/5051fe1b5b314f7fabdb5bb9922f6032/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:25.216506 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8df4ab-2e74-4f22-a314-7e31867ff92b None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:25.216816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8df4ab-2e74-4f22-a314-7e31867ff92b None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:25.217068 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8df4ab-2e74-4f22-a314-7e31867ff92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:25.246164 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-1f8df4ab-2e74-4f22-a314-7e31867ff92b None None] MFA Rules not processed for user `5051fe1b5b314f7fabdb5bb9922f6032`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:25.247376 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1f8df4ab-2e74-4f22-a314-7e31867ff92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:25.267515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:25.316092 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1219/2455] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:25.320603 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a8e85-db6b-474a-ac4a-cf14bffc80df admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:25.385987 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a8e85-db6b-474a-ac4a-cf14bffc80df admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:25.390335 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9709d5-e5a5-4b15-be91-fa1b0abb825a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:25.390998 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9709d5-e5a5-4b15-be91-fa1b0abb825a admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:25.391353 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9709d5-e5a5-4b15-be91-fa1b0abb825a admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:25.391696 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9709d5-e5a5-4b15-be91-fa1b0abb825a admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:25.392495 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9709d5-e5a5-4b15-be91-fa1b0abb825a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:25.394758 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9709d5-e5a5-4b15-be91-fa1b0abb825a admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:25.423345 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1237/2456] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:01:25 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:25.427328 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8df4ab-2e74-4f22-a314-7e31867ff92b None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:25.438600 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8df4ab-2e74-4f22-a314-7e31867ff92b None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:25.511525 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751be07-d798-4900-aa8c-e6ce22828245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:25.512292 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751be07-d798-4900-aa8c-e6ce22828245 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:25.512580 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751be07-d798-4900-aa8c-e6ce22828245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:25.512908 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751be07-d798-4900-aa8c-e6ce22828245 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:25.513560 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751be07-d798-4900-aa8c-e6ce22828245 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:25.515612 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751be07-d798-4900-aa8c-e6ce22828245 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:25.542444 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1220/2457] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:01:25 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:25.547658 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9709d5-e5a5-4b15-be91-fa1b0abb825a admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:25.558638 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9709d5-e5a5-4b15-be91-fa1b0abb825a admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:25.563315 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757eee6-fc20-43c0-a97c-d13b22f7f08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:25.564055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757eee6-fc20-43c0-a97c-d13b22f7f08c admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:25.564413 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757eee6-fc20-43c0-a97c-d13b22f7f08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:25.564660 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757eee6-fc20-43c0-a97c-d13b22f7f08c admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:25.565493 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757eee6-fc20-43c0-a97c-d13b22f7f08c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:25.567333 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757eee6-fc20-43c0-a97c-d13b22f7f08c admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:25.578558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1238/2458] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:25.582752 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751be07-d798-4900-aa8c-e6ce22828245 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:25.593637 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751be07-d798-4900-aa8c-e6ce22828245 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:25.598284 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a92e9-65f9-470c-aa65-c0609ae89ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:25.599158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a92e9-65f9-470c-aa65-c0609ae89ed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:25.599442 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a92e9-65f9-470c-aa65-c0609ae89ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:25.599720 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a92e9-65f9-470c-aa65-c0609ae89ed6 admin admin] PATH_INFO: `/v3/projects/acdb5ed82281476b938be0b33f4e2d46/users/909008f62cfb486b990efbade722baff/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:25.614924 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a92e9-65f9-470c-aa65-c0609ae89ed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acdb5ed82281476b938be0b33f4e2d46, user_id=909008f62cfb486b990efbade722baff, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:25.617584 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a92e9-65f9-470c-aa65-c0609ae89ed6 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:25.629994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1221/2459] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:25 2022] PUT /identity/v3/projects/acdb5ed82281476b938be0b33f4e2d46/users/909008f62cfb486b990efbade722baff/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:25.633926 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757eee6-fc20-43c0-a97c-d13b22f7f08c admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:25.644368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757eee6-fc20-43c0-a97c-d13b22f7f08c admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:25.699329 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c021d1-a5d0-4545-af2f-8d6dce23ea6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:25.699910 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c021d1-a5d0-4545-af2f-8d6dce23ea6d admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:25.700193 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c021d1-a5d0-4545-af2f-8d6dce23ea6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:25.700468 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c021d1-a5d0-4545-af2f-8d6dce23ea6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:25.701182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c021d1-a5d0-4545-af2f-8d6dce23ea6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:25.702781 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c021d1-a5d0-4545-af2f-8d6dce23ea6d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:25.713141 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1239/2460] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:25.717627 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a92e9-65f9-470c-aa65-c0609ae89ed6 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:25.728643 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a92e9-65f9-470c-aa65-c0609ae89ed6 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:25.733728 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ddf6e3-5b97-41ac-a162-dc7375049256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:25.734634 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddf6e3-5b97-41ac-a162-dc7375049256 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:25.734915 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddf6e3-5b97-41ac-a162-dc7375049256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:25.735193 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddf6e3-5b97-41ac-a162-dc7375049256 admin admin] PATH_INFO: `/v3/projects/acdb5ed82281476b938be0b33f4e2d46/users/909008f62cfb486b990efbade722baff/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:25.737261 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ddf6e3-5b97-41ac-a162-dc7375049256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acdb5ed82281476b938be0b33f4e2d46, user_id=909008f62cfb486b990efbade722baff, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:25.740027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ddf6e3-5b97-41ac-a162-dc7375049256 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:25.751371 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1222/2461] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:25 2022] PUT /identity/v3/projects/acdb5ed82281476b938be0b33f4e2d46/users/909008f62cfb486b990efbade722baff/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:25.763795 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022f979-764d-4d2a-ba6c-a0220b78cd7e None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:25.764117 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022f979-764d-4d2a-ba6c-a0220b78cd7e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:25.764513 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022f979-764d-4d2a-ba6c-a0220b78cd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:25.791562 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-6022f979-764d-4d2a-ba6c-a0220b78cd7e None None] MFA Rules not processed for user `909008f62cfb486b990efbade722baff`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:25.792760 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6022f979-764d-4d2a-ba6c-a0220b78cd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:25.841594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:25.862936 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1240/2462] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:25 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:25.874493 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ddf6e3-5b97-41ac-a162-dc7375049256 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:25.876187 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-12ddf6e3-5b97-41ac-a162-dc7375049256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:25.935217 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ddf6e3-5b97-41ac-a162-dc7375049256 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:25.938934 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3adcec-4e8a-44e3-bd1a-e40cb45a7ab5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:25.939573 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3adcec-4e8a-44e3-bd1a-e40cb45a7ab5 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:25.939857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3adcec-4e8a-44e3-bd1a-e40cb45a7ab5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:25.940155 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3adcec-4e8a-44e3-bd1a-e40cb45a7ab5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:25.950124 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3adcec-4e8a-44e3-bd1a-e40cb45a7ab5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:25.951494 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3adcec-4e8a-44e3-bd1a-e40cb45a7ab5 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:25.961008 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1223/2463] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:25 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:01:26.079088 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022f979-764d-4d2a-ba6c-a0220b78cd7e None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:26.080499 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6022f979-764d-4d2a-ba6c-a0220b78cd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:26.160452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022f979-764d-4d2a-ba6c-a0220b78cd7e None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:26.166868 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293a500-94b4-44e5-848a-0151374c8c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:26.167685 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293a500-94b4-44e5-848a-0151374c8c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:26.167968 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293a500-94b4-44e5-848a-0151374c8c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:26.168250 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293a500-94b4-44e5-848a-0151374c8c5c admin admin] PATH_INFO: `/v3/users/26d4401bd59f4fca9c11b78b6b3ba407` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:26.169521 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293a500-94b4-44e5-848a-0151374c8c5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=26d4401bd59f4fca9c11b78b6b3ba407)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:26.171492 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293a500-94b4-44e5-848a-0151374c8c5c admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:26.224556 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-5293a500-94b4-44e5-848a-0151374c8c5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26d4401bd59f4fca9c11b78b6b3ba407'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:26.231989 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-5293a500-94b4-44e5-848a-0151374c8c5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26d4401bd59f4fca9c11b78b6b3ba407'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:26.232684 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-5293a500-94b4-44e5-848a-0151374c8c5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26d4401bd59f4fca9c11b78b6b3ba407'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:26.240799 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-5293a500-94b4-44e5-848a-0151374c8c5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26d4401bd59f4fca9c11b78b6b3ba407'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:26.254232 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-5293a500-94b4-44e5-848a-0151374c8c5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26d4401bd59f4fca9c11b78b6b3ba407'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:26.261252 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1241/2464] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:01:26 2022] DELETE /identity/v3/users/26d4401bd59f4fca9c11b78b6b3ba407 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:26.265879 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bf831-0c91-45f4-97a0-ffe869ea5595 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:26.266272 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bf831-0c91-45f4-97a0-ffe869ea5595 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:26.266618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bf831-0c91-45f4-97a0-ffe869ea5595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:26.287845 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-040bf831-0c91-45f4-97a0-ffe869ea5595 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:26.289052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-040bf831-0c91-45f4-97a0-ffe869ea5595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:26.301625 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:26.360012 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1224/2465] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:26.363046 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293a500-94b4-44e5-848a-0151374c8c5c admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:26.364474 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-5293a500-94b4-44e5-848a-0151374c8c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:26.365141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bf831-0c91-45f4-97a0-ffe869ea5595 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:26.366522 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-040bf831-0c91-45f4-97a0-ffe869ea5595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:26.377751 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293a500-94b4-44e5-848a-0151374c8c5c admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:26.382612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d96b30-47c6-4874-9e47-f4d29986bbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:26.383478 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d96b30-47c6-4874-9e47-f4d29986bbaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:26.383789 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d96b30-47c6-4874-9e47-f4d29986bbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:26.384064 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d96b30-47c6-4874-9e47-f4d29986bbaa admin admin] PATH_INFO: `/v3/users/5051fe1b5b314f7fabdb5bb9922f6032` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:26.385803 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d96b30-47c6-4874-9e47-f4d29986bbaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5051fe1b5b314f7fabdb5bb9922f6032)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:26.387778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d96b30-47c6-4874-9e47-f4d29986bbaa admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:26.426415 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bf831-0c91-45f4-97a0-ffe869ea5595 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:26.430221 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409f0fc-d4dc-4b21-8646-ccead8588419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:26.430848 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409f0fc-d4dc-4b21-8646-ccead8588419 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:26.431158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409f0fc-d4dc-4b21-8646-ccead8588419 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:26.431444 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409f0fc-d4dc-4b21-8646-ccead8588419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:26.433591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-57d96b30-47c6-4874-9e47-f4d29986bbaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5051fe1b5b314f7fabdb5bb9922f6032'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:26.440446 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-57d96b30-47c6-4874-9e47-f4d29986bbaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5051fe1b5b314f7fabdb5bb9922f6032'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:26.440805 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5409f0fc-d4dc-4b21-8646-ccead8588419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:26.441134 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-57d96b30-47c6-4874-9e47-f4d29986bbaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5051fe1b5b314f7fabdb5bb9922f6032'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:26.442220 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5409f0fc-d4dc-4b21-8646-ccead8588419 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:26.444714 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:26.449783 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-57d96b30-47c6-4874-9e47-f4d29986bbaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5051fe1b5b314f7fabdb5bb9922f6032'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:26.454468 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1225/2466] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 06:01:26.469305 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-57d96b30-47c6-4874-9e47-f4d29986bbaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5051fe1b5b314f7fabdb5bb9922f6032'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:26.475536 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1242/2467] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:01:26 2022] DELETE /identity/v3/users/5051fe1b5b314f7fabdb5bb9922f6032 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:26.480045 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce740f30-9b5c-4702-97d4-85f25a807864 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:26.480357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce740f30-9b5c-4702-97d4-85f25a807864 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:26.480641 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce740f30-9b5c-4702-97d4-85f25a807864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:26.498572 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-ce740f30-9b5c-4702-97d4-85f25a807864 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:26.499836 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ce740f30-9b5c-4702-97d4-85f25a807864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:26.566167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1226/2468] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:01:26.576544 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d96b30-47c6-4874-9e47-f4d29986bbaa admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:26.578448 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-57d96b30-47c6-4874-9e47-f4d29986bbaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:26.651985 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d96b30-47c6-4874-9e47-f4d29986bbaa admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:26.655959 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bba9e4-354e-4cac-9d46-8c1efa39bf28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:26.656705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bba9e4-354e-4cac-9d46-8c1efa39bf28 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:26.657055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bba9e4-354e-4cac-9d46-8c1efa39bf28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:26.657403 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bba9e4-354e-4cac-9d46-8c1efa39bf28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:26.669210 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bba9e4-354e-4cac-9d46-8c1efa39bf28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:26.671641 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bba9e4-354e-4cac-9d46-8c1efa39bf28 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:26.683410 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1243/2469] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:01:26.821765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce740f30-9b5c-4702-97d4-85f25a807864 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:26.823192 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ce740f30-9b5c-4702-97d4-85f25a807864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:26.840683 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce740f30-9b5c-4702-97d4-85f25a807864 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:26.858773 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6e6ca-ccd7-45c1-b9c5-04b851d5d4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:26.860141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6e6ca-ccd7-45c1-b9c5-04b851d5d4ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:26.861442 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6e6ca-ccd7-45c1-b9c5-04b851d5d4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:26.861980 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6e6ca-ccd7-45c1-b9c5-04b851d5d4ee admin admin] PATH_INFO: `/v3/projects/449735c7b5474b85b5a0ae27d13fd403` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:26.882077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6e6ca-ccd7-45c1-b9c5-04b851d5d4ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=449735c7b5474b85b5a0ae27d13fd403)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:26.884307 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6e6ca-ccd7-45c1-b9c5-04b851d5d4ee admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:26.959320 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-bed6e6ca-ccd7-45c1-b9c5-04b851d5d4ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '449735c7b5474b85b5a0ae27d13fd403', 'request_id': 'req-bed6e6ca-ccd7-45c1-b9c5-04b851d5d4ee'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:26.968795 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-bed6e6ca-ccd7-45c1-b9c5-04b851d5d4ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '449735c7b5474b85b5a0ae27d13fd403', 'request_id': 'req-bed6e6ca-ccd7-45c1-b9c5-04b851d5d4ee'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:26.970131 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:26.976512 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-bed6e6ca-ccd7-45c1-b9c5-04b851d5d4ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '449735c7b5474b85b5a0ae27d13fd403', 'request_id': 'req-bed6e6ca-ccd7-45c1-b9c5-04b851d5d4ee'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:26.989846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-bed6e6ca-ccd7-45c1-b9c5-04b851d5d4ee admin admin] The token cache is being invalidate because project 449735c7b5474b85b5a0ae27d13fd403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:01:26.990183 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-bed6e6ca-ccd7-45c1-b9c5-04b851d5d4ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:26.990867 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-bed6e6ca-ccd7-45c1-b9c5-04b851d5d4ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:26.992435 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1227/2470] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:01:26 2022] DELETE /identity/v3/projects/449735c7b5474b85b5a0ae27d13fd403 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:26.996841 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bba9e4-354e-4cac-9d46-8c1efa39bf28 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:27.006011 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bba9e4-354e-4cac-9d46-8c1efa39bf28 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:27.070299 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6e6ca-ccd7-45c1-b9c5-04b851d5d4ee admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:27.072274 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-bed6e6ca-ccd7-45c1-b9c5-04b851d5d4ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:27.087120 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59eb465-1a74-4e1e-9254-f0ca6076925f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:27.090610 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59eb465-1a74-4e1e-9254-f0ca6076925f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:27.091126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59eb465-1a74-4e1e-9254-f0ca6076925f admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:27.091439 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59eb465-1a74-4e1e-9254-f0ca6076925f admin admin] PATH_INFO: `/v3/users/d81401c34b604aa79d77263ba098a9ab` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:27.093273 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59eb465-1a74-4e1e-9254-f0ca6076925f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d81401c34b604aa79d77263ba098a9ab)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:27.095667 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59eb465-1a74-4e1e-9254-f0ca6076925f admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:27.147814 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6e6ca-ccd7-45c1-b9c5-04b851d5d4ee admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:27.148135 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c59eb465-1a74-4e1e-9254-f0ca6076925f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd81401c34b604aa79d77263ba098a9ab'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:27.153341 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfaf782-ac87-4038-b91d-ede2b9c7032e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:27.154131 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfaf782-ac87-4038-b91d-ede2b9c7032e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:27.154422 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfaf782-ac87-4038-b91d-ede2b9c7032e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:27.154705 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfaf782-ac87-4038-b91d-ede2b9c7032e admin admin] PATH_INFO: `/v3/projects/7466691468674bc0a6e1665dec64e29e` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:27.155891 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c59eb465-1a74-4e1e-9254-f0ca6076925f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd81401c34b604aa79d77263ba098a9ab'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:27.156010 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfaf782-ac87-4038-b91d-ede2b9c7032e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7466691468674bc0a6e1665dec64e29e)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:27.156555 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c59eb465-1a74-4e1e-9254-f0ca6076925f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd81401c34b604aa79d77263ba098a9ab'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:27.157814 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfaf782-ac87-4038-b91d-ede2b9c7032e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:27.164216 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c59eb465-1a74-4e1e-9254-f0ca6076925f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd81401c34b604aa79d77263ba098a9ab'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:27.178003 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c59eb465-1a74-4e1e-9254-f0ca6076925f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd81401c34b604aa79d77263ba098a9ab'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:27.180159 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:27.185050 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1244/2471] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:01:26 2022] DELETE /identity/v3/users/d81401c34b604aa79d77263ba098a9ab => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:27.208184 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7bfaf782-ac87-4038-b91d-ede2b9c7032e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7466691468674bc0a6e1665dec64e29e', 'request_id': 'req-7bfaf782-ac87-4038-b91d-ede2b9c7032e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:27.216999 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7bfaf782-ac87-4038-b91d-ede2b9c7032e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7466691468674bc0a6e1665dec64e29e', 'request_id': 'req-7bfaf782-ac87-4038-b91d-ede2b9c7032e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:27.224479 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7bfaf782-ac87-4038-b91d-ede2b9c7032e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7466691468674bc0a6e1665dec64e29e', 'request_id': 'req-7bfaf782-ac87-4038-b91d-ede2b9c7032e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:27.236136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7bfaf782-ac87-4038-b91d-ede2b9c7032e admin admin] The token cache is being invalidate because project 7466691468674bc0a6e1665dec64e29e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:01:27.236423 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7bfaf782-ac87-4038-b91d-ede2b9c7032e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:27.237208 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7bfaf782-ac87-4038-b91d-ede2b9c7032e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:27.238853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1228/2472] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:01:27 2022] DELETE /identity/v3/projects/7466691468674bc0a6e1665dec64e29e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:27.242798 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59eb465-1a74-4e1e-9254-f0ca6076925f admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:27.244889 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c59eb465-1a74-4e1e-9254-f0ca6076925f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:27.313533 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59eb465-1a74-4e1e-9254-f0ca6076925f admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:27.384269 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e58951-4697-404b-9027-b55162ba6496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:27.385816 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e58951-4697-404b-9027-b55162ba6496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:27.386139 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e58951-4697-404b-9027-b55162ba6496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:27.386420 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e58951-4697-404b-9027-b55162ba6496 admin admin] PATH_INFO: `/v3/users/909008f62cfb486b990efbade722baff` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:27.387642 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e58951-4697-404b-9027-b55162ba6496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=909008f62cfb486b990efbade722baff)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:27.389608 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e58951-4697-404b-9027-b55162ba6496 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:27.438349 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b6e58951-4697-404b-9027-b55162ba6496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '909008f62cfb486b990efbade722baff'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:27.446092 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b6e58951-4697-404b-9027-b55162ba6496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '909008f62cfb486b990efbade722baff'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:27.447423 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b6e58951-4697-404b-9027-b55162ba6496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '909008f62cfb486b990efbade722baff'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:27.455061 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b6e58951-4697-404b-9027-b55162ba6496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '909008f62cfb486b990efbade722baff'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:27.464636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfaf782-ac87-4038-b91d-ede2b9c7032e admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:27.465782 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-7bfaf782-ac87-4038-b91d-ede2b9c7032e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:27.479357 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b6e58951-4697-404b-9027-b55162ba6496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '909008f62cfb486b990efbade722baff'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:27.486002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1245/2473] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:01:27 2022] DELETE /identity/v3/users/909008f62cfb486b990efbade722baff => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:27.487108 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfaf782-ac87-4038-b91d-ede2b9c7032e admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:27.554566 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a855f-9965-4509-80da-ddbe666376aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:27.555501 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a855f-9965-4509-80da-ddbe666376aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:27.555796 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a855f-9965-4509-80da-ddbe666376aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:27.556573 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a855f-9965-4509-80da-ddbe666376aa admin admin] PATH_INFO: `/v3/projects/44e9c847dbed45cc8c6f7c4fe19a23cd` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:27.557823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a855f-9965-4509-80da-ddbe666376aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=44e9c847dbed45cc8c6f7c4fe19a23cd)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:27.559841 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a855f-9965-4509-80da-ddbe666376aa admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:27.579167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:27.612936 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-848a855f-9965-4509-80da-ddbe666376aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44e9c847dbed45cc8c6f7c4fe19a23cd', 'request_id': 'req-848a855f-9965-4509-80da-ddbe666376aa'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:27.620851 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-848a855f-9965-4509-80da-ddbe666376aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44e9c847dbed45cc8c6f7c4fe19a23cd', 'request_id': 'req-848a855f-9965-4509-80da-ddbe666376aa'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:27.628156 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-848a855f-9965-4509-80da-ddbe666376aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44e9c847dbed45cc8c6f7c4fe19a23cd', 'request_id': 'req-848a855f-9965-4509-80da-ddbe666376aa'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:27.639878 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-848a855f-9965-4509-80da-ddbe666376aa admin admin] The token cache is being invalidate because project 44e9c847dbed45cc8c6f7c4fe19a23cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:01:27.640223 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-848a855f-9965-4509-80da-ddbe666376aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:27.640831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-848a855f-9965-4509-80da-ddbe666376aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:27.642441 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1229/2474] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:01:27 2022] DELETE /identity/v3/projects/44e9c847dbed45cc8c6f7c4fe19a23cd => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:27.647169 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e58951-4697-404b-9027-b55162ba6496 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:27.651477 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b6e58951-4697-404b-9027-b55162ba6496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:27.669630 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e58951-4697-404b-9027-b55162ba6496 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:27.696535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:27.734110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2d37a-a3a1-4f3a-b7b1-8feb8869ce83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:27.734910 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2d37a-a3a1-4f3a-b7b1-8feb8869ce83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:27.735195 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2d37a-a3a1-4f3a-b7b1-8feb8869ce83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:27.735474 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2d37a-a3a1-4f3a-b7b1-8feb8869ce83 admin admin] PATH_INFO: `/v3/users/715db77108da43b8af267497ea0bc350` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:27.736715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2d37a-a3a1-4f3a-b7b1-8feb8869ce83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=715db77108da43b8af267497ea0bc350)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:27.738705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2d37a-a3a1-4f3a-b7b1-8feb8869ce83 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:27.789130 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-89a2d37a-a3a1-4f3a-b7b1-8feb8869ce83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '715db77108da43b8af267497ea0bc350'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:27.796890 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-89a2d37a-a3a1-4f3a-b7b1-8feb8869ce83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '715db77108da43b8af267497ea0bc350'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:27.797645 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-89a2d37a-a3a1-4f3a-b7b1-8feb8869ce83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '715db77108da43b8af267497ea0bc350'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:27.806836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-89a2d37a-a3a1-4f3a-b7b1-8feb8869ce83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '715db77108da43b8af267497ea0bc350'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:27.819654 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-89a2d37a-a3a1-4f3a-b7b1-8feb8869ce83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '715db77108da43b8af267497ea0bc350'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:27.825922 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1246/2475] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:01:27 2022] DELETE /identity/v3/users/715db77108da43b8af267497ea0bc350 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:28.024085 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a855f-9965-4509-80da-ddbe666376aa admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:28.025542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-848a855f-9965-4509-80da-ddbe666376aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:28.038141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a855f-9965-4509-80da-ddbe666376aa admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:28.105722 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15d4b2-3801-46f8-ade5-f02177126ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:28.106554 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15d4b2-3801-46f8-ade5-f02177126ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:28.106853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15d4b2-3801-46f8-ade5-f02177126ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:28.107131 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15d4b2-3801-46f8-ade5-f02177126ff4 admin admin] PATH_INFO: `/v3/projects/acdb5ed82281476b938be0b33f4e2d46` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:28.108355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e15d4b2-3801-46f8-ade5-f02177126ff4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acdb5ed82281476b938be0b33f4e2d46)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:28.113626 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e15d4b2-3801-46f8-ade5-f02177126ff4 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:28.136255 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2d37a-a3a1-4f3a-b7b1-8feb8869ce83 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:28.137684 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-89a2d37a-a3a1-4f3a-b7b1-8feb8869ce83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:28.153178 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2d37a-a3a1-4f3a-b7b1-8feb8869ce83 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:28.158605 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d54a0c-6739-4076-aa75-8452d0520bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:28.159847 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d54a0c-6739-4076-aa75-8452d0520bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:28.160122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d54a0c-6739-4076-aa75-8452d0520bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:28.160403 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d54a0c-6739-4076-aa75-8452d0520bbe admin admin] PATH_INFO: `/v3/projects/8f7114ecf71f4e5d954e12d97cc775ab` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:28.161958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d54a0c-6739-4076-aa75-8452d0520bbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f7114ecf71f4e5d954e12d97cc775ab)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:28.164239 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d54a0c-6739-4076-aa75-8452d0520bbe admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:28.174613 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-3e15d4b2-3801-46f8-ade5-f02177126ff4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acdb5ed82281476b938be0b33f4e2d46', 'request_id': 'req-3e15d4b2-3801-46f8-ade5-f02177126ff4'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:28.183028 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-3e15d4b2-3801-46f8-ade5-f02177126ff4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acdb5ed82281476b938be0b33f4e2d46', 'request_id': 'req-3e15d4b2-3801-46f8-ade5-f02177126ff4'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:28.189908 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-3e15d4b2-3801-46f8-ade5-f02177126ff4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acdb5ed82281476b938be0b33f4e2d46', 'request_id': 'req-3e15d4b2-3801-46f8-ade5-f02177126ff4'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:28.200833 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-3e15d4b2-3801-46f8-ade5-f02177126ff4 admin admin] The token cache is being invalidate because project acdb5ed82281476b938be0b33f4e2d46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:01:28.201232 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-3e15d4b2-3801-46f8-ade5-f02177126ff4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:28.201989 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-3e15d4b2-3801-46f8-ade5-f02177126ff4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:28.203703 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1230/2476] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:01:28 2022] DELETE /identity/v3/projects/acdb5ed82281476b938be0b33f4e2d46 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:28.208516 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61d77d-c918-46b4-a7c4-cb77606a2ab3 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:28.208877 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61d77d-c918-46b4-a7c4-cb77606a2ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:28.209230 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61d77d-c918-46b4-a7c4-cb77606a2ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:28.221909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-85d54a0c-6739-4076-aa75-8452d0520bbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f7114ecf71f4e5d954e12d97cc775ab', 'request_id': 'req-85d54a0c-6739-4076-aa75-8452d0520bbe'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:28.227963 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-85d54a0c-6739-4076-aa75-8452d0520bbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f7114ecf71f4e5d954e12d97cc775ab', 'request_id': 'req-85d54a0c-6739-4076-aa75-8452d0520bbe'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:28.229027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-0c61d77d-c918-46b4-a7c4-cb77606a2ab3 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:28.230289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-0c61d77d-c918-46b4-a7c4-cb77606a2ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:28.234812 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-85d54a0c-6739-4076-aa75-8452d0520bbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f7114ecf71f4e5d954e12d97cc775ab', 'request_id': 'req-85d54a0c-6739-4076-aa75-8452d0520bbe'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:28.247490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-85d54a0c-6739-4076-aa75-8452d0520bbe admin admin] The token cache is being invalidate because project 8f7114ecf71f4e5d954e12d97cc775ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:01:28.247780 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-85d54a0c-6739-4076-aa75-8452d0520bbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:28.248412 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-85d54a0c-6739-4076-aa75-8452d0520bbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:28.250182 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1247/2477] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:01:28 2022] DELETE /identity/v3/projects/8f7114ecf71f4e5d954e12d97cc775ab => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:28.254631 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65095eb4-f105-4942-9361-354fc12996b2 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:28.254920 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65095eb4-f105-4942-9361-354fc12996b2 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:28.255199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65095eb4-f105-4942-9361-354fc12996b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:28.262169 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:28.274211 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-65095eb4-f105-4942-9361-354fc12996b2 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:28.276035 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-65095eb4-f105-4942-9361-354fc12996b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:28.295571 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1231/2478] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:01:28.300180 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:28.303372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dfa74-50ea-4ad5-9c2b-01797e94d56c None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:28.303893 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dfa74-50ea-4ad5-9c2b-01797e94d56c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:28.304157 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dfa74-50ea-4ad5-9c2b-01797e94d56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:28.322895 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-762dfa74-50ea-4ad5-9c2b-01797e94d56c None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:28.324117 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-762dfa74-50ea-4ad5-9c2b-01797e94d56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:28.332344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1232/2479] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:28.336388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762dfa74-50ea-4ad5-9c2b-01797e94d56c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:28.339373 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1248/2480] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:01:28.346822 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae62bf3-5206-4db3-a2ab-268cffa91e71 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:28.347131 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae62bf3-5206-4db3-a2ab-268cffa91e71 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:28.347255 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762dfa74-50ea-4ad5-9c2b-01797e94d56c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:28.347398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae62bf3-5206-4db3-a2ab-268cffa91e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:28.351845 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc06766-9a2a-43f9-ab2d-b74cfb8b7757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:28.352520 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc06766-9a2a-43f9-ab2d-b74cfb8b7757 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:28.352806 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc06766-9a2a-43f9-ab2d-b74cfb8b7757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:28.353717 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc06766-9a2a-43f9-ab2d-b74cfb8b7757 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:28.354504 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc06766-9a2a-43f9-ab2d-b74cfb8b7757 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 06:01:28.354818 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc06766-9a2a-43f9-ab2d-b74cfb8b7757 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:28.356436 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc06766-9a2a-43f9-ab2d-b74cfb8b7757 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:28.366492 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-5ae62bf3-5206-4db3-a2ab-268cffa91e71 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:28.367732 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-5ae62bf3-5206-4db3-a2ab-268cffa91e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:28.371567 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1233/2481] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 06:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 06:01:28.372694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc06766-9a2a-43f9-ab2d-b74cfb8b7757 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:28.379096 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1249/2482] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:01:28.383531 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc06766-9a2a-43f9-ab2d-b74cfb8b7757 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:28.383691 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae62bf3-5206-4db3-a2ab-268cffa91e71 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:28.388579 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736cebb-a9b6-4dcd-bf0a-e4b2a58228a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:28.389232 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736cebb-a9b6-4dcd-bf0a-e4b2a58228a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:28.389522 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736cebb-a9b6-4dcd-bf0a-e4b2a58228a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:28.389809 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736cebb-a9b6-4dcd-bf0a-e4b2a58228a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:28.390538 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736cebb-a9b6-4dcd-bf0a-e4b2a58228a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:28.392459 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736cebb-a9b6-4dcd-bf0a-e4b2a58228a4 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:28.392937 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae62bf3-5206-4db3-a2ab-268cffa91e71 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:28.397550 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f843b1a-4c97-4fe7-ba86-ac39b43d73b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:28.398222 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f843b1a-4c97-4fe7-ba86-ac39b43d73b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:28.398509 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f843b1a-4c97-4fe7-ba86-ac39b43d73b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:28.398785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f843b1a-4c97-4fe7-ba86-ac39b43d73b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:28.399504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f843b1a-4c97-4fe7-ba86-ac39b43d73b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 06:01:28.400346 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f843b1a-4c97-4fe7-ba86-ac39b43d73b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:28.401926 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f843b1a-4c97-4fe7-ba86-ac39b43d73b7 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:28.415158 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1250/2483] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 06:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 06:01:28.419984 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f843b1a-4c97-4fe7-ba86-ac39b43d73b7 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:28.422747 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1234/2484] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:01:28 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 06:01:28.426562 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736cebb-a9b6-4dcd-bf0a-e4b2a58228a4 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:28.433653 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f843b1a-4c97-4fe7-ba86-ac39b43d73b7 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:28.491431 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736cebb-a9b6-4dcd-bf0a-e4b2a58228a4 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:28.491902 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7833b3-09e3-4ad5-915f-e9fd86f60523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:28.492597 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7833b3-09e3-4ad5-915f-e9fd86f60523 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:28.492887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7833b3-09e3-4ad5-915f-e9fd86f60523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:28.493161 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7833b3-09e3-4ad5-915f-e9fd86f60523 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:28.493881 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7833b3-09e3-4ad5-915f-e9fd86f60523 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:28.495823 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7833b3-09e3-4ad5-915f-e9fd86f60523 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:28.496770 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c849280-4480-42ab-bc03-58bbfe2a6e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:28.497454 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c849280-4480-42ab-bc03-58bbfe2a6e6f admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:28.497738 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c849280-4480-42ab-bc03-58bbfe2a6e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:28.498273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c849280-4480-42ab-bc03-58bbfe2a6e6f admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:28.499244 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c849280-4480-42ab-bc03-58bbfe2a6e6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:28.501483 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c849280-4480-42ab-bc03-58bbfe2a6e6f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:28.524418 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1251/2485] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:01:28 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:28.525797 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1235/2486] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:01:28 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 06:01:28.530380 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7833b3-09e3-4ad5-915f-e9fd86f60523 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:28.531071 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c849280-4480-42ab-bc03-58bbfe2a6e6f admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:28.541189 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c849280-4480-42ab-bc03-58bbfe2a6e6f admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:28.598338 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7833b3-09e3-4ad5-915f-e9fd86f60523 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:28.600609 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb22611-891e-44bd-a6ab-53292ac7a375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:28.601287 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb22611-891e-44bd-a6ab-53292ac7a375 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:28.601581 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb22611-891e-44bd-a6ab-53292ac7a375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:28.601861 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb22611-891e-44bd-a6ab-53292ac7a375 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:28.602584 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb22611-891e-44bd-a6ab-53292ac7a375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:28.603383 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df587cb-389b-4e6d-b8f7-ec67b4b246b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:28.604054 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df587cb-389b-4e6d-b8f7-ec67b4b246b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:28.604371 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df587cb-389b-4e6d-b8f7-ec67b4b246b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:28.604518 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb22611-891e-44bd-a6ab-53292ac7a375 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:28.604676 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df587cb-389b-4e6d-b8f7-ec67b4b246b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:28.605411 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df587cb-389b-4e6d-b8f7-ec67b4b246b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:28.607032 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df587cb-389b-4e6d-b8f7-ec67b4b246b1 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:28.620943 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1252/2487] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:28.622336 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df587cb-389b-4e6d-b8f7-ec67b4b246b1 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:28.628289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1236/2488] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:01:28 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 06:01:28.632180 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb22611-891e-44bd-a6ab-53292ac7a375 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:28.633887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df587cb-389b-4e6d-b8f7-ec67b4b246b1 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:28.639127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c3fa0-95cf-4d26-b5ad-edb564eb913b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:28.639787 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c3fa0-95cf-4d26-b5ad-edb564eb913b admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:28.640118 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c3fa0-95cf-4d26-b5ad-edb564eb913b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:28.640390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c3fa0-95cf-4d26-b5ad-edb564eb913b admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:28.641116 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c3fa0-95cf-4d26-b5ad-edb564eb913b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:28.642717 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb22611-891e-44bd-a6ab-53292ac7a375 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:28.642837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c3fa0-95cf-4d26-b5ad-edb564eb913b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:28.647520 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7c828-61a7-404d-9da5-bb875cb9d7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:28.648175 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7c828-61a7-404d-9da5-bb875cb9d7af admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:28.648461 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7c828-61a7-404d-9da5-bb875cb9d7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:28.648737 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7c828-61a7-404d-9da5-bb875cb9d7af admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:28.649465 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7c828-61a7-404d-9da5-bb875cb9d7af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:28.651709 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7c828-61a7-404d-9da5-bb875cb9d7af admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:28.656619 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1253/2489] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:28.658139 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c3fa0-95cf-4d26-b5ad-edb564eb913b admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:28.661838 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1237/2490] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:28.666293 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7c828-61a7-404d-9da5-bb875cb9d7af admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:28.668787 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c3fa0-95cf-4d26-b5ad-edb564eb913b admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:28.671799 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:28.673652 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6550c-aa66-4c77-b174-196ece035883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:28.674599 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6550c-aa66-4c77-b174-196ece035883 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:28.674945 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6550c-aa66-4c77-b174-196ece035883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:28.675286 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6550c-aa66-4c77-b174-196ece035883 admin admin] PATH_INFO: `/v3/projects/a1198199876847618fa9a3c5c68eaa6a/users/d08cae8d7d44408b8e51a06bf67c57de/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:28.677735 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7c828-61a7-404d-9da5-bb875cb9d7af admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:28.683769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728188b3-d862-453d-ba77-fa03ac46c67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:28.684803 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728188b3-d862-453d-ba77-fa03ac46c67c admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:28.685475 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728188b3-d862-453d-ba77-fa03ac46c67c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:28.686024 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728188b3-d862-453d-ba77-fa03ac46c67c admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:28.686844 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728188b3-d862-453d-ba77-fa03ac46c67c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:28.689511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728188b3-d862-453d-ba77-fa03ac46c67c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:28.692932 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6550c-aa66-4c77-b174-196ece035883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1198199876847618fa9a3c5c68eaa6a, user_id=d08cae8d7d44408b8e51a06bf67c57de, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:28.695705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6550c-aa66-4c77-b174-196ece035883 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:28.700279 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:28.703497 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1238/2491] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 06:01:28.708482 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728188b3-d862-453d-ba77-fa03ac46c67c admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:28.712005 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1254/2492] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:28 2022] PUT /identity/v3/projects/a1198199876847618fa9a3c5c68eaa6a/users/d08cae8d7d44408b8e51a06bf67c57de/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:28.719667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728188b3-d862-453d-ba77-fa03ac46c67c admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:28.723099 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02329453-6d72-4850-80c9-501ae6a65fc8 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:28.723606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02329453-6d72-4850-80c9-501ae6a65fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:28.723891 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02329453-6d72-4850-80c9-501ae6a65fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:28.751058 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-02329453-6d72-4850-80c9-501ae6a65fc8 None None] MFA Rules not processed for user `d08cae8d7d44408b8e51a06bf67c57de`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:28.752243 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-02329453-6d72-4850-80c9-501ae6a65fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:28.778934 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693cd34-565e-44b1-8f09-f0859320dc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:28.780005 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693cd34-565e-44b1-8f09-f0859320dc1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:28.780293 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693cd34-565e-44b1-8f09-f0859320dc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:28.780536 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693cd34-565e-44b1-8f09-f0859320dc1b admin admin] PATH_INFO: `/v3/projects/b990f39d52ad48518bb2bdc70ca09efb/users/c9d247d6152741548f55f917ab66dbd1/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:28.795545 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693cd34-565e-44b1-8f09-f0859320dc1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b990f39d52ad48518bb2bdc70ca09efb, user_id=c9d247d6152741548f55f917ab66dbd1, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:28.798248 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693cd34-565e-44b1-8f09-f0859320dc1b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:28.812739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1239/2493] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:28 2022] PUT /identity/v3/projects/b990f39d52ad48518bb2bdc70ca09efb/users/c9d247d6152741548f55f917ab66dbd1/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:28.823668 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb60622-6392-44b6-95d1-3002df44058e None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:28.823828 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1255/2494] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:01:28.824074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb60622-6392-44b6-95d1-3002df44058e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:28.824409 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb60622-6392-44b6-95d1-3002df44058e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:28.827969 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02329453-6d72-4850-80c9-501ae6a65fc8 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:28.838417 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02329453-6d72-4850-80c9-501ae6a65fc8 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:28.850275 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-ebb60622-6392-44b6-95d1-3002df44058e None None] MFA Rules not processed for user `c9d247d6152741548f55f917ab66dbd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:28.851475 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ebb60622-6392-44b6-95d1-3002df44058e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:28.896363 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcc060-83ef-4377-b66c-f7b020a4c210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:28.897033 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcc060-83ef-4377-b66c-f7b020a4c210 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:28.897316 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcc060-83ef-4377-b66c-f7b020a4c210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:28.897587 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcc060-83ef-4377-b66c-f7b020a4c210 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:28.898433 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fcc060-83ef-4377-b66c-f7b020a4c210 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:28.900838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fcc060-83ef-4377-b66c-f7b020a4c210 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:28.918159 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1240/2495] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:01:28.925846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb60622-6392-44b6-95d1-3002df44058e None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:28.933987 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1256/2496] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:01:28 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 06:01:28.937166 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb60622-6392-44b6-95d1-3002df44058e None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:28.938058 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcc060-83ef-4377-b66c-f7b020a4c210 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:29.003869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b37e9f-6345-4c0b-a10e-92024b9d443e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:29.004538 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b37e9f-6345-4c0b-a10e-92024b9d443e admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:29.004755 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b37e9f-6345-4c0b-a10e-92024b9d443e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:29.005029 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b37e9f-6345-4c0b-a10e-92024b9d443e admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:29.006166 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b37e9f-6345-4c0b-a10e-92024b9d443e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:29.007821 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b37e9f-6345-4c0b-a10e-92024b9d443e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:29.010573 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcc060-83ef-4377-b66c-f7b020a4c210 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:29.015340 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad8f54-560a-4cad-8202-c083def2de7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:29.016677 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad8f54-560a-4cad-8202-c083def2de7a admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:29.016677 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad8f54-560a-4cad-8202-c083def2de7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:29.016677 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad8f54-560a-4cad-8202-c083def2de7a admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:29.017250 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad8f54-560a-4cad-8202-c083def2de7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:29.017867 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:29.019239 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad8f54-560a-4cad-8202-c083def2de7a admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:29.035463 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:29.041681 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1241/2497] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:01:28 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:29.042174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1257/2498] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:01:28 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 06:01:29.045521 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b37e9f-6345-4c0b-a10e-92024b9d443e admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:29.045705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad8f54-560a-4cad-8202-c083def2de7a admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:29.057084 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad8f54-560a-4cad-8202-c083def2de7a admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:29.121759 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b37e9f-6345-4c0b-a10e-92024b9d443e admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:29.125533 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48017a36-cb30-41dc-bdee-a3c2e72965a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:29.126250 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48017a36-cb30-41dc-bdee-a3c2e72965a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:29.126553 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4ab75-b813-4f15-963b-d1646fd934f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:29.126748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48017a36-cb30-41dc-bdee-a3c2e72965a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:29.126890 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48017a36-cb30-41dc-bdee-a3c2e72965a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:29.127202 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4ab75-b813-4f15-963b-d1646fd934f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:29.127541 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48017a36-cb30-41dc-bdee-a3c2e72965a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:29.127737 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4ab75-b813-4f15-963b-d1646fd934f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:29.127876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4ab75-b813-4f15-963b-d1646fd934f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:29.128554 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4ab75-b813-4f15-963b-d1646fd934f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:29.129143 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48017a36-cb30-41dc-bdee-a3c2e72965a7 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:29.130519 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4ab75-b813-4f15-963b-d1646fd934f1 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:29.139760 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1258/2499] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 06:01:29.143949 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48017a36-cb30-41dc-bdee-a3c2e72965a7 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:29.153979 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1242/2500] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:01:29 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:29.154298 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48017a36-cb30-41dc-bdee-a3c2e72965a7 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:29.157245 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4ab75-b813-4f15-963b-d1646fd934f1 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:29.159874 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d99ce1-d8cd-47bd-8663-c496a0b95b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:29.160899 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d99ce1-d8cd-47bd-8663-c496a0b95b31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:29.161186 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d99ce1-d8cd-47bd-8663-c496a0b95b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:29.161464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d99ce1-d8cd-47bd-8663-c496a0b95b31 admin admin] PATH_INFO: `/v3/projects/bdb1a8521e7245dc9f200b23c76530e1/users/f4fe94afc1c84d37ac679e6650a3c583/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:29.167942 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4ab75-b813-4f15-963b-d1646fd934f1 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:29.173606 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3b303-0881-4c23-a8db-4eeb66f3e9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:29.174294 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3b303-0881-4c23-a8db-4eeb66f3e9cf admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:29.174593 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3b303-0881-4c23-a8db-4eeb66f3e9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:29.174852 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3b303-0881-4c23-a8db-4eeb66f3e9cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:29.175574 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e3b303-0881-4c23-a8db-4eeb66f3e9cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:29.177167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e3b303-0881-4c23-a8db-4eeb66f3e9cf admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:29.180568 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d99ce1-d8cd-47bd-8663-c496a0b95b31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdb1a8521e7245dc9f200b23c76530e1, user_id=f4fe94afc1c84d37ac679e6650a3c583, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:29.184397 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d99ce1-d8cd-47bd-8663-c496a0b95b31 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:29.188113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1243/2501] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:29.192549 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3b303-0881-4c23-a8db-4eeb66f3e9cf admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:29.202443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1259/2502] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:29 2022] PUT /identity/v3/projects/bdb1a8521e7245dc9f200b23c76530e1/users/f4fe94afc1c84d37ac679e6650a3c583/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:29.203262 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3b303-0881-4c23-a8db-4eeb66f3e9cf admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:29.203435 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d99ce1-d8cd-47bd-8663-c496a0b95b31 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:29.263959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316577e-af3c-45a1-b43e-75048849e936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:29.264790 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316577e-af3c-45a1-b43e-75048849e936 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:29.265084 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316577e-af3c-45a1-b43e-75048849e936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:29.265372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316577e-af3c-45a1-b43e-75048849e936 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:29.266333 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316577e-af3c-45a1-b43e-75048849e936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:29.268208 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316577e-af3c-45a1-b43e-75048849e936 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:29.269153 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d99ce1-d8cd-47bd-8663-c496a0b95b31 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:29.274823 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6aa62-395b-459a-b34c-87cae625308a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:29.275490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6aa62-395b-459a-b34c-87cae625308a admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:29.275768 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6aa62-395b-459a-b34c-87cae625308a admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:29.276049 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6aa62-395b-459a-b34c-87cae625308a admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:29.276767 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6aa62-395b-459a-b34c-87cae625308a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:29.278372 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6aa62-395b-459a-b34c-87cae625308a admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:29.279236 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1244/2503] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:29.283527 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316577e-af3c-45a1-b43e-75048849e936 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:29.288863 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1260/2504] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:29.293388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6aa62-395b-459a-b34c-87cae625308a admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:29.295500 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316577e-af3c-45a1-b43e-75048849e936 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:29.302090 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c54606-ff9f-4f23-b6b0-e8e53341d698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:29.303173 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c54606-ff9f-4f23-b6b0-e8e53341d698 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:29.303814 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c54606-ff9f-4f23-b6b0-e8e53341d698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:29.304285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c54606-ff9f-4f23-b6b0-e8e53341d698 admin admin] PATH_INFO: `/v3/projects/9c6478e0dc67487ca06ad62515d4eb04/users/59100fba193b40f980e9d079ef80d7d0/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:29.313088 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6aa62-395b-459a-b34c-87cae625308a admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:29.317814 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38ffff-0b19-43f6-af8b-01e4d4814a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:29.318748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38ffff-0b19-43f6-af8b-01e4d4814a55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:29.319034 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38ffff-0b19-43f6-af8b-01e4d4814a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:29.319317 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38ffff-0b19-43f6-af8b-01e4d4814a55 admin admin] PATH_INFO: `/v3/projects/bdb1a8521e7245dc9f200b23c76530e1/users/f4fe94afc1c84d37ac679e6650a3c583/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:29.320852 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c54606-ff9f-4f23-b6b0-e8e53341d698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c6478e0dc67487ca06ad62515d4eb04, user_id=59100fba193b40f980e9d079ef80d7d0, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:29.321335 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38ffff-0b19-43f6-af8b-01e4d4814a55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdb1a8521e7245dc9f200b23c76530e1, user_id=f4fe94afc1c84d37ac679e6650a3c583, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:29.323611 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c54606-ff9f-4f23-b6b0-e8e53341d698 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:29.324067 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38ffff-0b19-43f6-af8b-01e4d4814a55 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:29.336055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1261/2505] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:29 2022] PUT /identity/v3/projects/bdb1a8521e7245dc9f200b23c76530e1/users/f4fe94afc1c84d37ac679e6650a3c583/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:29.339848 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1245/2506] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:29 2022] PUT /identity/v3/projects/9c6478e0dc67487ca06ad62515d4eb04/users/59100fba193b40f980e9d079ef80d7d0/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:29.347481 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912ccf2-4dc2-4bc1-819d-aeea705892f1 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:29.347771 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912ccf2-4dc2-4bc1-819d-aeea705892f1 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:29.348054 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912ccf2-4dc2-4bc1-819d-aeea705892f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:29.378885 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-0912ccf2-4dc2-4bc1-819d-aeea705892f1 None None] MFA Rules not processed for user `f4fe94afc1c84d37ac679e6650a3c583`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:29.380250 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0912ccf2-4dc2-4bc1-819d-aeea705892f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:29.404936 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a5c99-42fe-4904-9936-20691a0fbbc0 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:29.405256 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a5c99-42fe-4904-9936-20691a0fbbc0 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:29.405558 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a5c99-42fe-4904-9936-20691a0fbbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:29.428833 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:29.433012 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-b60a5c99-42fe-4904-9936-20691a0fbbc0 None None] MFA Rules not processed for user `59100fba193b40f980e9d079ef80d7d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:29.434301 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b60a5c99-42fe-4904-9936-20691a0fbbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:29.455809 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1262/2507] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:01:29.466715 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912ccf2-4dc2-4bc1-819d-aeea705892f1 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:29.467189 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:29.468318 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0912ccf2-4dc2-4bc1-819d-aeea705892f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:29.508539 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1246/2508] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:29.513054 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a5c99-42fe-4904-9936-20691a0fbbc0 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:29.527044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912ccf2-4dc2-4bc1-819d-aeea705892f1 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:29.532607 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc59d1b-bda2-4df8-9a3c-deb8a2bfb192 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:29.533275 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc59d1b-bda2-4df8-9a3c-deb8a2bfb192 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:29.533556 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc59d1b-bda2-4df8-9a3c-deb8a2bfb192 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:29.533859 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc59d1b-bda2-4df8-9a3c-deb8a2bfb192 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:29.543875 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc59d1b-bda2-4df8-9a3c-deb8a2bfb192 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:29.545304 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc59d1b-bda2-4df8-9a3c-deb8a2bfb192 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:29.555316 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1263/2509] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 06:01:29.576740 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a5c99-42fe-4904-9936-20691a0fbbc0 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:29.581585 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e256d85-64ca-4541-b433-5dab61671435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:29.582297 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e256d85-64ca-4541-b433-5dab61671435 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:29.582580 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e256d85-64ca-4541-b433-5dab61671435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:29.582862 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e256d85-64ca-4541-b433-5dab61671435 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:29.583556 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e256d85-64ca-4541-b433-5dab61671435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:29.585483 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e256d85-64ca-4541-b433-5dab61671435 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:29.613677 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1247/2510] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:01:29 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 06:01:29.617728 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc59d1b-bda2-4df8-9a3c-deb8a2bfb192 service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:29.628478 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc59d1b-bda2-4df8-9a3c-deb8a2bfb192 service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:29.660132 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e256d85-64ca-4541-b433-5dab61671435 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:29.688518 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e11267-78ec-48b8-b0e2-a8e4f0e5c522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:29.689278 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e11267-78ec-48b8-b0e2-a8e4f0e5c522 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:29.689636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e11267-78ec-48b8-b0e2-a8e4f0e5c522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:29.689910 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e11267-78ec-48b8-b0e2-a8e4f0e5c522 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:29.690635 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e11267-78ec-48b8-b0e2-a8e4f0e5c522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:29.692713 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e11267-78ec-48b8-b0e2-a8e4f0e5c522 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:29.717255 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1264/2511] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:01:29 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:29.721385 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e11267-78ec-48b8-b0e2-a8e4f0e5c522 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:29.724328 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e256d85-64ca-4541-b433-5dab61671435 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:29.728838 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e805e-bd38-4960-aed7-1c4da474de33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:29.729478 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e805e-bd38-4960-aed7-1c4da474de33 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:29.729758 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e805e-bd38-4960-aed7-1c4da474de33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:29.730103 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e805e-bd38-4960-aed7-1c4da474de33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:29.732336 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e11267-78ec-48b8-b0e2-a8e4f0e5c522 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:29.738333 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733b5c4-4d49-4202-a593-cbdadfc1f8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:29.739011 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733b5c4-4d49-4202-a593-cbdadfc1f8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:29.739318 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733b5c4-4d49-4202-a593-cbdadfc1f8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:29.739598 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733b5c4-4d49-4202-a593-cbdadfc1f8b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:29.740368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733b5c4-4d49-4202-a593-cbdadfc1f8b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:29.742035 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733b5c4-4d49-4202-a593-cbdadfc1f8b9 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:29.753509 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1265/2512] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 06:01:29.757892 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733b5c4-4d49-4202-a593-cbdadfc1f8b9 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:29.768340 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733b5c4-4d49-4202-a593-cbdadfc1f8b9 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:29.774615 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d707fd3-7ab7-43b0-8910-99cad8487ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:29.776054 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d707fd3-7ab7-43b0-8910-99cad8487ee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:29.776378 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d707fd3-7ab7-43b0-8910-99cad8487ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:29.776624 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d707fd3-7ab7-43b0-8910-99cad8487ee0 admin admin] PATH_INFO: `/v3/projects/59bf3ba535e84eccbb9c3f594556d60a/users/2a1c099540a545819556364ef0690a88/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:29.796632 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d707fd3-7ab7-43b0-8910-99cad8487ee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59bf3ba535e84eccbb9c3f594556d60a, user_id=2a1c099540a545819556364ef0690a88, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:29.796944 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e805e-bd38-4960-aed7-1c4da474de33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:29.798393 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e805e-bd38-4960-aed7-1c4da474de33 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:29.806659 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d707fd3-7ab7-43b0-8910-99cad8487ee0 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:29.808473 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1248/2513] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 06:01:29.827191 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1266/2514] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:29 2022] PUT /identity/v3/projects/59bf3ba535e84eccbb9c3f594556d60a/users/2a1c099540a545819556364ef0690a88/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:29.830922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e805e-bd38-4960-aed7-1c4da474de33 service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:29.843087 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e805e-bd38-4960-aed7-1c4da474de33 service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:29.857306 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:29.931982 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b234b6-7b22-43e3-9c6f-fdf80ea064da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:29.932752 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b234b6-7b22-43e3-9c6f-fdf80ea064da admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:29.933098 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b234b6-7b22-43e3-9c6f-fdf80ea064da admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:29.933465 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b234b6-7b22-43e3-9c6f-fdf80ea064da admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:29.934232 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b234b6-7b22-43e3-9c6f-fdf80ea064da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:29.935847 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b234b6-7b22-43e3-9c6f-fdf80ea064da admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:29.947714 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1249/2515] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:29.952865 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d707fd3-7ab7-43b0-8910-99cad8487ee0 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:29.980949 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d707fd3-7ab7-43b0-8910-99cad8487ee0 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:29.988378 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929334f4-64a4-499f-8fec-d0bcc6dd0cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:29.989547 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929334f4-64a4-499f-8fec-d0bcc6dd0cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:29.989835 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929334f4-64a4-499f-8fec-d0bcc6dd0cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:29.990185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929334f4-64a4-499f-8fec-d0bcc6dd0cc1 admin admin] PATH_INFO: `/v3/projects/59bf3ba535e84eccbb9c3f594556d60a/users/2a1c099540a545819556364ef0690a88/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:29.994255 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929334f4-64a4-499f-8fec-d0bcc6dd0cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59bf3ba535e84eccbb9c3f594556d60a, user_id=2a1c099540a545819556364ef0690a88, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:29.997449 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929334f4-64a4-499f-8fec-d0bcc6dd0cc1 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:30.012514 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1267/2516] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:29 2022] PUT /identity/v3/projects/59bf3ba535e84eccbb9c3f594556d60a/users/2a1c099540a545819556364ef0690a88/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:30.022933 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaaa5d-e03d-4181-bf53-7e4148af0c1a None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:30.023671 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaaa5d-e03d-4181-bf53-7e4148af0c1a None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:30.024151 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaaa5d-e03d-4181-bf53-7e4148af0c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:30.065918 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-8edaaa5d-e03d-4181-bf53-7e4148af0c1a None None] MFA Rules not processed for user `2a1c099540a545819556364ef0690a88`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:30.068580 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8edaaa5d-e03d-4181-bf53-7e4148af0c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:30.178907 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1250/2517] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:30.191974 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929334f4-64a4-499f-8fec-d0bcc6dd0cc1 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:30.193469 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-929334f4-64a4-499f-8fec-d0bcc6dd0cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:30.231901 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:30.268237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929334f4-64a4-499f-8fec-d0bcc6dd0cc1 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:30.273230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474c186-1607-4afa-95dc-502481d1c93e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:30.275259 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474c186-1607-4afa-95dc-502481d1c93e service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:30.275785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474c186-1607-4afa-95dc-502481d1c93e service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:30.276133 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474c186-1607-4afa-95dc-502481d1c93e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:30.342391 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474c186-1607-4afa-95dc-502481d1c93e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:30.343824 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474c186-1607-4afa-95dc-502481d1c93e service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:30.353265 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1268/2518] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:01:31.871265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edaaa5d-e03d-4181-bf53-7e4148af0c1a None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:31.880908 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edaaa5d-e03d-4181-bf53-7e4148af0c1a None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:31.885016 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c83fb-3494-4e05-b3a0-8285e201ab32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:31.885651 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c83fb-3494-4e05-b3a0-8285e201ab32 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:31.885944 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c83fb-3494-4e05-b3a0-8285e201ab32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:31.886229 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c83fb-3494-4e05-b3a0-8285e201ab32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:31.945495 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c83fb-3494-4e05-b3a0-8285e201ab32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:31.947684 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c83fb-3494-4e05-b3a0-8285e201ab32 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:31.957594 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1251/2519] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:01:32.496641 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474c186-1607-4afa-95dc-502481d1c93e service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:32.497153 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c83fb-3494-4e05-b3a0-8285e201ab32 service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:32.506564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474c186-1607-4afa-95dc-502481d1c93e service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:32.512739 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fbfe1-a194-4586-bb6e-b0663ea232f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:32.513405 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fbfe1-a194-4586-bb6e-b0663ea232f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:32.513695 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fbfe1-a194-4586-bb6e-b0663ea232f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:32.514008 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fbfe1-a194-4586-bb6e-b0663ea232f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:32.526982 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fbfe1-a194-4586-bb6e-b0663ea232f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:32.528958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fbfe1-a194-4586-bb6e-b0663ea232f4 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:32.543446 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1269/2520] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:01:32.557579 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:32.644822 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c83fb-3494-4e05-b3a0-8285e201ab32 service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:32.692018 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a01ce-9766-41d2-9f43-388668d87483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:32.692940 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a01ce-9766-41d2-9f43-388668d87483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:32.693232 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a01ce-9766-41d2-9f43-388668d87483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:32.693516 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a01ce-9766-41d2-9f43-388668d87483 admin admin] PATH_INFO: `/v3/users/d08cae8d7d44408b8e51a06bf67c57de` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:32.700696 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a01ce-9766-41d2-9f43-388668d87483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d08cae8d7d44408b8e51a06bf67c57de)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:32.705861 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a01ce-9766-41d2-9f43-388668d87483 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:32.734851 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fbfe1-a194-4586-bb6e-b0663ea232f4 service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:32.736641 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1d1fbfe1-a194-4586-bb6e-b0663ea232f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:32.754556 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fbfe1-a194-4586-bb6e-b0663ea232f4 service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:32.762637 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3d589-6c64-4d24-bf54-a56c137fb490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:32.764036 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3d589-6c64-4d24-bf54-a56c137fb490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:32.764367 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3d589-6c64-4d24-bf54-a56c137fb490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:32.764791 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3d589-6c64-4d24-bf54-a56c137fb490 admin admin] PATH_INFO: `/v3/users/8e69ed7fbf6f4d0f8138d9235df45f56` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:32.769050 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3d589-6c64-4d24-bf54-a56c137fb490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e69ed7fbf6f4d0f8138d9235df45f56)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:32.772503 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3d589-6c64-4d24-bf54-a56c137fb490 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:32.831895 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b53a01ce-9766-41d2-9f43-388668d87483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd08cae8d7d44408b8e51a06bf67c57de'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:32.852383 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b53a01ce-9766-41d2-9f43-388668d87483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd08cae8d7d44408b8e51a06bf67c57de'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:32.853912 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b53a01ce-9766-41d2-9f43-388668d87483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd08cae8d7d44408b8e51a06bf67c57de'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:32.854640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b53a01ce-9766-41d2-9f43-388668d87483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd08cae8d7d44408b8e51a06bf67c57de'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:32.871812 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-b53a01ce-9766-41d2-9f43-388668d87483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd08cae8d7d44408b8e51a06bf67c57de'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:32.889268 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-34b3d589-6c64-4d24-bf54-a56c137fb490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e69ed7fbf6f4d0f8138d9235df45f56'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:32.894664 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1252/2521] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:01:32 2022] DELETE /identity/v3/users/d08cae8d7d44408b8e51a06bf67c57de => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:32.896689 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d55177-d4fc-451c-97f8-f06f0f0170c2 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:32.896995 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d55177-d4fc-451c-97f8-f06f0f0170c2 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:32.897462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d55177-d4fc-451c-97f8-f06f0f0170c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:32.908171 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-34b3d589-6c64-4d24-bf54-a56c137fb490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e69ed7fbf6f4d0f8138d9235df45f56'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:32.909097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-34b3d589-6c64-4d24-bf54-a56c137fb490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e69ed7fbf6f4d0f8138d9235df45f56'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:32.919824 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-34b3d589-6c64-4d24-bf54-a56c137fb490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e69ed7fbf6f4d0f8138d9235df45f56'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:32.928891 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-57d55177-d4fc-451c-97f8-f06f0f0170c2 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:32.931175 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-57d55177-d4fc-451c-97f8-f06f0f0170c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:32.937282 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-34b3d589-6c64-4d24-bf54-a56c137fb490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e69ed7fbf6f4d0f8138d9235df45f56'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:32.945497 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1270/2522] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:01:32 2022] DELETE /identity/v3/users/8e69ed7fbf6f4d0f8138d9235df45f56 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:32.950679 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838aabf-8e3b-43f1-981f-115815242cbf None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:32.951048 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838aabf-8e3b-43f1-981f-115815242cbf None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:32.951384 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838aabf-8e3b-43f1-981f-115815242cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:32.974764 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-0838aabf-8e3b-43f1-981f-115815242cbf None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:32.976320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0838aabf-8e3b-43f1-981f-115815242cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:33.025321 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:33.030926 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1253/2523] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:33.040996 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d55177-d4fc-451c-97f8-f06f0f0170c2 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:33.043108 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-57d55177-d4fc-451c-97f8-f06f0f0170c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:33.061491 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1271/2524] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:01:33.072646 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838aabf-8e3b-43f1-981f-115815242cbf None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:33.074389 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0838aabf-8e3b-43f1-981f-115815242cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:33.135615 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:33.143939 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d55177-d4fc-451c-97f8-f06f0f0170c2 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:33.159295 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838aabf-8e3b-43f1-981f-115815242cbf None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:33.163712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4a922-76ec-4165-85c3-155ca1c51f74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:33.164618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4a922-76ec-4165-85c3-155ca1c51f74 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:33.165012 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4a922-76ec-4165-85c3-155ca1c51f74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:33.165880 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4a922-76ec-4165-85c3-155ca1c51f74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:33.180499 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4a922-76ec-4165-85c3-155ca1c51f74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:33.182264 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4a922-76ec-4165-85c3-155ca1c51f74 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:33.199665 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1272/2525] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 06:01:33.223005 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd0c1c-f561-4062-99a4-13671377d090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:33.224184 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd0c1c-f561-4062-99a4-13671377d090 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:33.224575 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd0c1c-f561-4062-99a4-13671377d090 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:33.224865 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd0c1c-f561-4062-99a4-13671377d090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:33.237816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd0c1c-f561-4062-99a4-13671377d090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:33.240289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd0c1c-f561-4062-99a4-13671377d090 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:33.253413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1254/2526] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 06:01:33.637749 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4a922-76ec-4165-85c3-155ca1c51f74 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:33.639374 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-60e4a922-76ec-4165-85c3-155ca1c51f74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:33.653668 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4a922-76ec-4165-85c3-155ca1c51f74 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:33.659769 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09856446-82d0-4116-b61e-1e126cf981f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:33.660659 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09856446-82d0-4116-b61e-1e126cf981f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:33.660941 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09856446-82d0-4116-b61e-1e126cf981f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:33.661217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09856446-82d0-4116-b61e-1e126cf981f4 admin admin] PATH_INFO: `/v3/projects/7e9541fafe1549a38b7c8112af851961` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:33.662551 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09856446-82d0-4116-b61e-1e126cf981f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e9541fafe1549a38b7c8112af851961)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:33.666132 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09856446-82d0-4116-b61e-1e126cf981f4 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:33.717101 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd0c1c-f561-4062-99a4-13671377d090 service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:33.718966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-dbcd0c1c-f561-4062-99a4-13671377d090 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:33.731981 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-09856446-82d0-4116-b61e-1e126cf981f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e9541fafe1549a38b7c8112af851961', 'request_id': 'req-09856446-82d0-4116-b61e-1e126cf981f4'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:33.738974 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-09856446-82d0-4116-b61e-1e126cf981f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e9541fafe1549a38b7c8112af851961', 'request_id': 'req-09856446-82d0-4116-b61e-1e126cf981f4'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:33.742708 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd0c1c-f561-4062-99a4-13671377d090 service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:33.748065 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-09856446-82d0-4116-b61e-1e126cf981f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e9541fafe1549a38b7c8112af851961', 'request_id': 'req-09856446-82d0-4116-b61e-1e126cf981f4'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:33.763174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-09856446-82d0-4116-b61e-1e126cf981f4 admin admin] The token cache is being invalidate because project 7e9541fafe1549a38b7c8112af851961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:01:33.763462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-09856446-82d0-4116-b61e-1e126cf981f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:33.764087 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-09856446-82d0-4116-b61e-1e126cf981f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:33.765670 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1273/2527] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:01:33 2022] DELETE /identity/v3/projects/7e9541fafe1549a38b7c8112af851961 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:33.770679 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0ba47-7d30-476b-af88-dc116422dc9b None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:33.770974 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0ba47-7d30-476b-af88-dc116422dc9b None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:33.771425 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0ba47-7d30-476b-af88-dc116422dc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:33.791913 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-26b0ba47-7d30-476b-af88-dc116422dc9b None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:33.794402 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-26b0ba47-7d30-476b-af88-dc116422dc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:33.840724 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459bb78f-f4b2-4348-a873-d53de42f44c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:33.842236 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bb78f-f4b2-4348-a873-d53de42f44c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:33.842236 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bb78f-f4b2-4348-a873-d53de42f44c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:33.842236 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bb78f-f4b2-4348-a873-d53de42f44c2 admin admin] PATH_INFO: `/v3/projects/a1198199876847618fa9a3c5c68eaa6a` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:33.842941 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459bb78f-f4b2-4348-a873-d53de42f44c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1198199876847618fa9a3c5c68eaa6a)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:33.845268 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459bb78f-f4b2-4348-a873-d53de42f44c2 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:33.922511 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1274/2528] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:01:33.923111 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-459bb78f-f4b2-4348-a873-d53de42f44c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1198199876847618fa9a3c5c68eaa6a', 'request_id': 'req-459bb78f-f4b2-4348-a873-d53de42f44c2'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:33.930275 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa165d47-6745-4636-bb5d-b121bd5ae135 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:33.931297 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa165d47-6745-4636-bb5d-b121bd5ae135 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:33.931670 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa165d47-6745-4636-bb5d-b121bd5ae135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:33.940339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-459bb78f-f4b2-4348-a873-d53de42f44c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1198199876847618fa9a3c5c68eaa6a', 'request_id': 'req-459bb78f-f4b2-4348-a873-d53de42f44c2'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:33.946004 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:33.950521 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-459bb78f-f4b2-4348-a873-d53de42f44c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1198199876847618fa9a3c5c68eaa6a', 'request_id': 'req-459bb78f-f4b2-4348-a873-d53de42f44c2'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:33.964749 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-fa165d47-6745-4636-bb5d-b121bd5ae135 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:33.965264 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-459bb78f-f4b2-4348-a873-d53de42f44c2 admin admin] The token cache is being invalidate because project a1198199876847618fa9a3c5c68eaa6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:01:33.965644 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-459bb78f-f4b2-4348-a873-d53de42f44c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:33.966514 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-459bb78f-f4b2-4348-a873-d53de42f44c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:33.967373 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-fa165d47-6745-4636-bb5d-b121bd5ae135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:33.971384 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1255/2529] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:01:33 2022] DELETE /identity/v3/projects/a1198199876847618fa9a3c5c68eaa6a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:33.974252 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459bb78f-f4b2-4348-a873-d53de42f44c2 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:33.977296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-459bb78f-f4b2-4348-a873-d53de42f44c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:34.075666 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1275/2530] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:34.076247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:34.080482 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa165d47-6745-4636-bb5d-b121bd5ae135 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:34.091838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa165d47-6745-4636-bb5d-b121bd5ae135 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:34.106720 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d27aae-1783-40aa-880e-3a2d526d1452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:34.107566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d27aae-1783-40aa-880e-3a2d526d1452 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:34.109999 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d27aae-1783-40aa-880e-3a2d526d1452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:34.109999 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d27aae-1783-40aa-880e-3a2d526d1452 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:34.111146 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d27aae-1783-40aa-880e-3a2d526d1452 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 06:01:34.111533 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d27aae-1783-40aa-880e-3a2d526d1452 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:34.116217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d27aae-1783-40aa-880e-3a2d526d1452 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:34.130607 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1276/2531] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 06:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 06:01:34.131789 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459bb78f-f4b2-4348-a873-d53de42f44c2 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:34.135702 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d27aae-1783-40aa-880e-3a2d526d1452 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:34.143864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3a4af-d2f9-43ef-81fc-a5b7fb002757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:34.146410 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3a4af-d2f9-43ef-81fc-a5b7fb002757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:34.146706 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3a4af-d2f9-43ef-81fc-a5b7fb002757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:34.146989 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3a4af-d2f9-43ef-81fc-a5b7fb002757 admin admin] PATH_INFO: `/v3/users/f4fe94afc1c84d37ac679e6650a3c583` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:34.148870 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d27aae-1783-40aa-880e-3a2d526d1452 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:34.151546 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3a4af-d2f9-43ef-81fc-a5b7fb002757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4fe94afc1c84d37ac679e6650a3c583)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:34.153818 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3a4af-d2f9-43ef-81fc-a5b7fb002757 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:34.167918 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098c8b6-045f-4582-9596-92c5511c4bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:34.179556 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098c8b6-045f-4582-9596-92c5511c4bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:34.180148 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098c8b6-045f-4582-9596-92c5511c4bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:34.180586 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098c8b6-045f-4582-9596-92c5511c4bc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:34.181497 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098c8b6-045f-4582-9596-92c5511c4bc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:34.184576 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098c8b6-045f-4582-9596-92c5511c4bc2 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:34.231198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1277/2532] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:01:34 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:34.232475 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098c8b6-045f-4582-9596-92c5511c4bc2 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:34.259104 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-08f3a4af-d2f9-43ef-81fc-a5b7fb002757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4fe94afc1c84d37ac679e6650a3c583'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:34.278422 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-08f3a4af-d2f9-43ef-81fc-a5b7fb002757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4fe94afc1c84d37ac679e6650a3c583'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:34.279421 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-08f3a4af-d2f9-43ef-81fc-a5b7fb002757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4fe94afc1c84d37ac679e6650a3c583'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:34.280100 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-08f3a4af-d2f9-43ef-81fc-a5b7fb002757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4fe94afc1c84d37ac679e6650a3c583'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:34.298281 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-08f3a4af-d2f9-43ef-81fc-a5b7fb002757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4fe94afc1c84d37ac679e6650a3c583'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:34.335776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1256/2533] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:01:33 2022] DELETE /identity/v3/users/f4fe94afc1c84d37ac679e6650a3c583 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:34.341985 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098c8b6-045f-4582-9596-92c5511c4bc2 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:34.411477 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e53861-7070-4887-8e03-6728ad59834c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:34.412302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e53861-7070-4887-8e03-6728ad59834c admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:34.412736 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e53861-7070-4887-8e03-6728ad59834c admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:34.413193 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e53861-7070-4887-8e03-6728ad59834c admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:34.414736 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e53861-7070-4887-8e03-6728ad59834c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:34.416928 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e53861-7070-4887-8e03-6728ad59834c admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:34.439352 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1278/2534] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:01:34 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 06:01:34.443568 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3a4af-d2f9-43ef-81fc-a5b7fb002757 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:34.444902 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-08f3a4af-d2f9-43ef-81fc-a5b7fb002757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:34.460965 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3a4af-d2f9-43ef-81fc-a5b7fb002757 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:34.466666 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd25eb-740b-4a2e-88d7-f844b3c1845f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:34.467345 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd25eb-740b-4a2e-88d7-f844b3c1845f admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:34.467637 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd25eb-740b-4a2e-88d7-f844b3c1845f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:34.467918 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd25eb-740b-4a2e-88d7-f844b3c1845f admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:34.468661 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd25eb-740b-4a2e-88d7-f844b3c1845f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:34.470326 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd25eb-740b-4a2e-88d7-f844b3c1845f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:34.485776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1257/2535] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:34.489867 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e53861-7070-4887-8e03-6728ad59834c admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:34.513238 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e53861-7070-4887-8e03-6728ad59834c admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:34.518090 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b8bd8-32ac-48c8-b8ef-9b4f7e46b505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:34.518766 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b8bd8-32ac-48c8-b8ef-9b4f7e46b505 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:34.519052 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b8bd8-32ac-48c8-b8ef-9b4f7e46b505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:34.519331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b8bd8-32ac-48c8-b8ef-9b4f7e46b505 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:34.520199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b8bd8-32ac-48c8-b8ef-9b4f7e46b505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:34.521823 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b8bd8-32ac-48c8-b8ef-9b4f7e46b505 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:34.523443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:34.535524 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1279/2536] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:34.539027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd25eb-740b-4a2e-88d7-f844b3c1845f admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:34.549620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd25eb-740b-4a2e-88d7-f844b3c1845f admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:34.554560 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a918cea-7a6b-441d-8bac-e4fce8a3b2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:34.555480 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a918cea-7a6b-441d-8bac-e4fce8a3b2ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:34.555943 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a918cea-7a6b-441d-8bac-e4fce8a3b2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:34.556229 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a918cea-7a6b-441d-8bac-e4fce8a3b2ee admin admin] PATH_INFO: `/v3/projects/24b5a22b29f74b60b3d6fb8abb90b157/users/3e27d4f743e541a9896e708a722384e8/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:34.571999 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a918cea-7a6b-441d-8bac-e4fce8a3b2ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=24b5a22b29f74b60b3d6fb8abb90b157, user_id=3e27d4f743e541a9896e708a722384e8, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:34.574732 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a918cea-7a6b-441d-8bac-e4fce8a3b2ee admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:34.590574 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1258/2537] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:34 2022] PUT /identity/v3/projects/24b5a22b29f74b60b3d6fb8abb90b157/users/3e27d4f743e541a9896e708a722384e8/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:34.601440 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f93dc7-c92c-4adb-80ad-b565289a1f20 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:34.601806 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f93dc7-c92c-4adb-80ad-b565289a1f20 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:34.602180 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f93dc7-c92c-4adb-80ad-b565289a1f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:34.632082 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-40f93dc7-c92c-4adb-80ad-b565289a1f20 None None] MFA Rules not processed for user `3e27d4f743e541a9896e708a722384e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:34.634236 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-40f93dc7-c92c-4adb-80ad-b565289a1f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:34.711239 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1280/2538] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:34.722915 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a918cea-7a6b-441d-8bac-e4fce8a3b2ee admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:34.724655 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8a918cea-7a6b-441d-8bac-e4fce8a3b2ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:34.739401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f93dc7-c92c-4adb-80ad-b565289a1f20 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:34.741001 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-40f93dc7-c92c-4adb-80ad-b565289a1f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:34.825579 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a918cea-7a6b-441d-8bac-e4fce8a3b2ee admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:34.832454 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f9707-cae4-44a5-b0b9-e3570ac96cf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:34.833113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f9707-cae4-44a5-b0b9-e3570ac96cf4 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:34.833391 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f9707-cae4-44a5-b0b9-e3570ac96cf4 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:34.836487 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f9707-cae4-44a5-b0b9-e3570ac96cf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:34.836696 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f93dc7-c92c-4adb-80ad-b565289a1f20 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:34.839965 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b286042-bf24-404c-99f2-4428906ff293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:34.840997 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b286042-bf24-404c-99f2-4428906ff293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:34.841292 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b286042-bf24-404c-99f2-4428906ff293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:34.841571 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b286042-bf24-404c-99f2-4428906ff293 admin admin] PATH_INFO: `/v3/projects/bdb1a8521e7245dc9f200b23c76530e1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:34.843778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b286042-bf24-404c-99f2-4428906ff293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdb1a8521e7245dc9f200b23c76530e1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:34.845704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b286042-bf24-404c-99f2-4428906ff293 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:34.854637 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f9707-cae4-44a5-b0b9-e3570ac96cf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:34.856302 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f9707-cae4-44a5-b0b9-e3570ac96cf4 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:34.870402 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1259/2539] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:01:34.907580 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1b286042-bf24-404c-99f2-4428906ff293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdb1a8521e7245dc9f200b23c76530e1', 'request_id': 'req-1b286042-bf24-404c-99f2-4428906ff293'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:34.925909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1b286042-bf24-404c-99f2-4428906ff293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdb1a8521e7245dc9f200b23c76530e1', 'request_id': 'req-1b286042-bf24-404c-99f2-4428906ff293'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:34.933875 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1b286042-bf24-404c-99f2-4428906ff293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdb1a8521e7245dc9f200b23c76530e1', 'request_id': 'req-1b286042-bf24-404c-99f2-4428906ff293'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:34.954100 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1b286042-bf24-404c-99f2-4428906ff293 admin admin] The token cache is being invalidate because project bdb1a8521e7245dc9f200b23c76530e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:01:34.954461 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1b286042-bf24-404c-99f2-4428906ff293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:34.955199 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1b286042-bf24-404c-99f2-4428906ff293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:34.962035 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1281/2540] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:01:34 2022] DELETE /identity/v3/projects/bdb1a8521e7245dc9f200b23c76530e1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:34.963820 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc62b41-43ce-49ed-bd9b-76685b8b6e69 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:34.964321 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc62b41-43ce-49ed-bd9b-76685b8b6e69 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:34.964429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc62b41-43ce-49ed-bd9b-76685b8b6e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:34.982010 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:34.988015 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-9fc62b41-43ce-49ed-bd9b-76685b8b6e69 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:34.991366 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-9fc62b41-43ce-49ed-bd9b-76685b8b6e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:35.076111 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1260/2541] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:35.084264 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed889e-8d1a-4333-9429-6aff8c4b33e7 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:35.084554 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed889e-8d1a-4333-9429-6aff8c4b33e7 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:35.084872 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed889e-8d1a-4333-9429-6aff8c4b33e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:35.109580 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-84ed889e-8d1a-4333-9429-6aff8c4b33e7 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:35.110720 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-84ed889e-8d1a-4333-9429-6aff8c4b33e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:35.115069 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc62b41-43ce-49ed-bd9b-76685b8b6e69 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:35.117020 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-9fc62b41-43ce-49ed-bd9b-76685b8b6e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:35.119885 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1282/2542] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:35.124275 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed889e-8d1a-4333-9429-6aff8c4b33e7 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:35.131583 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc62b41-43ce-49ed-bd9b-76685b8b6e69 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:35.133695 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed889e-8d1a-4333-9429-6aff8c4b33e7 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:35.137345 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773ded2-1a50-4e4a-a56c-e55dd390014d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:35.138253 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773ded2-1a50-4e4a-a56c-e55dd390014d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:35.138539 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773ded2-1a50-4e4a-a56c-e55dd390014d admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:35.138816 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773ded2-1a50-4e4a-a56c-e55dd390014d admin admin] PATH_INFO: `/v3/users/3e27d4f743e541a9896e708a722384e8` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:35.138991 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fa0e1-3af5-4b6a-819d-38a37a6aaba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:35.139664 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fa0e1-3af5-4b6a-819d-38a37a6aaba1 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:35.139951 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fa0e1-3af5-4b6a-819d-38a37a6aaba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:35.140060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6773ded2-1a50-4e4a-a56c-e55dd390014d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e27d4f743e541a9896e708a722384e8)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:35.140210 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fa0e1-3af5-4b6a-819d-38a37a6aaba1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:35.140956 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96fa0e1-3af5-4b6a-819d-38a37a6aaba1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 06:01:35.141278 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96fa0e1-3af5-4b6a-819d-38a37a6aaba1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:35.142204 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6773ded2-1a50-4e4a-a56c-e55dd390014d admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:35.142963 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96fa0e1-3af5-4b6a-819d-38a37a6aaba1 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:35.145538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:35.158720 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1283/2543] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 06:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 06:01:35.162399 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fa0e1-3af5-4b6a-819d-38a37a6aaba1 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:35.173215 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fa0e1-3af5-4b6a-819d-38a37a6aaba1 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:35.178801 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950c4ef-5265-4158-8ce1-f68acb4590c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:35.179497 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950c4ef-5265-4158-8ce1-f68acb4590c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:35.179786 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950c4ef-5265-4158-8ce1-f68acb4590c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:35.180086 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950c4ef-5265-4158-8ce1-f68acb4590c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:35.181437 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950c4ef-5265-4158-8ce1-f68acb4590c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:35.183517 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950c4ef-5265-4158-8ce1-f68acb4590c7 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:35.194114 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6773ded2-1a50-4e4a-a56c-e55dd390014d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e27d4f743e541a9896e708a722384e8'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:35.201606 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6773ded2-1a50-4e4a-a56c-e55dd390014d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e27d4f743e541a9896e708a722384e8'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:35.202352 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6773ded2-1a50-4e4a-a56c-e55dd390014d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e27d4f743e541a9896e708a722384e8'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:35.202978 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6773ded2-1a50-4e4a-a56c-e55dd390014d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e27d4f743e541a9896e708a722384e8'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:35.213150 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1284/2544] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:01:35 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 06:01:35.214900 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950c4ef-5265-4158-8ce1-f68acb4590c7 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:35.216579 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0950c4ef-5265-4158-8ce1-f68acb4590c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:35.219209 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6773ded2-1a50-4e4a-a56c-e55dd390014d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e27d4f743e541a9896e708a722384e8'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:35.232753 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1261/2545] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:01:35 2022] DELETE /identity/v3/users/3e27d4f743e541a9896e708a722384e8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:35.237289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4074a-12a5-4505-bcd6-9cb40242d3f8 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:35.237580 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4074a-12a5-4505-bcd6-9cb40242d3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:35.237864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4074a-12a5-4505-bcd6-9cb40242d3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:35.254898 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-75b4074a-12a5-4505-bcd6-9cb40242d3f8 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:35.256155 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-75b4074a-12a5-4505-bcd6-9cb40242d3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:35.282364 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950c4ef-5265-4158-8ce1-f68acb4590c7 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:35.321376 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1262/2546] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:01:35.332670 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4074a-12a5-4505-bcd6-9cb40242d3f8 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:35.334573 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-75b4074a-12a5-4505-bcd6-9cb40242d3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:35.342398 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1c9eb-c6ce-407b-b89b-6dbaf3b237df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:35.343081 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1c9eb-c6ce-407b-b89b-6dbaf3b237df admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:35.343368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1c9eb-c6ce-407b-b89b-6dbaf3b237df admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:35.343679 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1c9eb-c6ce-407b-b89b-6dbaf3b237df admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:35.344471 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1c9eb-c6ce-407b-b89b-6dbaf3b237df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:35.346422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1c9eb-c6ce-407b-b89b-6dbaf3b237df admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:35.370484 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1285/2547] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:01:35 2022] POST /identity/v3/users => generated 290 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 06:01:35.374447 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:35.375939 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1c9eb-c6ce-407b-b89b-6dbaf3b237df admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:35.388366 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1c9eb-c6ce-407b-b89b-6dbaf3b237df admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:35.393978 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a432fd7-2a45-4601-a6d9-a0a464a9b31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:35.394651 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a432fd7-2a45-4601-a6d9-a0a464a9b31a admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:35.400533 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a432fd7-2a45-4601-a6d9-a0a464a9b31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:35.400533 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a432fd7-2a45-4601-a6d9-a0a464a9b31a admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:35.400533 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a432fd7-2a45-4601-a6d9-a0a464a9b31a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:35.400533 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a432fd7-2a45-4601-a6d9-a0a464a9b31a admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:35.410464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1286/2548] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 06:01:35.415947 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a432fd7-2a45-4601-a6d9-a0a464a9b31a admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:35.418202 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4074a-12a5-4505-bcd6-9cb40242d3f8 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:35.422133 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e16ca2-3c9c-4a0e-9c15-4651b7d6c527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:35.422777 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e16ca2-3c9c-4a0e-9c15-4651b7d6c527 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:35.423061 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e16ca2-3c9c-4a0e-9c15-4651b7d6c527 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:35.423340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e16ca2-3c9c-4a0e-9c15-4651b7d6c527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:35.426652 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a432fd7-2a45-4601-a6d9-a0a464a9b31a admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:35.432170 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449a369-f415-482a-a76f-9fc3ece09656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:35.432852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449a369-f415-482a-a76f-9fc3ece09656 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:35.433113 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449a369-f415-482a-a76f-9fc3ece09656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:35.433387 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449a369-f415-482a-a76f-9fc3ece09656 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:35.434146 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449a369-f415-482a-a76f-9fc3ece09656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:35.435270 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e16ca2-3c9c-4a0e-9c15-4651b7d6c527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:35.435732 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449a369-f415-482a-a76f-9fc3ece09656 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:35.437346 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e16ca2-3c9c-4a0e-9c15-4651b7d6c527 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:35.455467 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1287/2549] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 06:01:35.455629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1263/2550] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:01:35.455731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449a369-f415-482a-a76f-9fc3ece09656 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:35.465788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449a369-f415-482a-a76f-9fc3ece09656 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:35.470825 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d03fea-366b-4379-bc08-3277a45b2978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:35.472311 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d03fea-366b-4379-bc08-3277a45b2978 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:35.472804 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d03fea-366b-4379-bc08-3277a45b2978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:35.473283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d03fea-366b-4379-bc08-3277a45b2978 admin admin] PATH_INFO: `/v3/projects/a6c4b7df153a4bf79cad85cf00dc7e4e/users/f92ac025e7da45608e6885ba6644de09/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:35.494452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d03fea-366b-4379-bc08-3277a45b2978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c4b7df153a4bf79cad85cf00dc7e4e, user_id=f92ac025e7da45608e6885ba6644de09, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:35.497663 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d03fea-366b-4379-bc08-3277a45b2978 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:35.514029 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1288/2551] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:35 2022] PUT /identity/v3/projects/a6c4b7df153a4bf79cad85cf00dc7e4e/users/f92ac025e7da45608e6885ba6644de09/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:35.524908 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fb901-cbfd-46b1-be33-ac60915bfb06 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:35.525267 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fb901-cbfd-46b1-be33-ac60915bfb06 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:35.525611 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fb901-cbfd-46b1-be33-ac60915bfb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:35.563236 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-c91fb901-cbfd-46b1-be33-ac60915bfb06 None None] MFA Rules not processed for user `f92ac025e7da45608e6885ba6644de09`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:35.564467 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c91fb901-cbfd-46b1-be33-ac60915bfb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:35.653714 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1264/2552] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:35.659482 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d03fea-366b-4379-bc08-3277a45b2978 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:35.714019 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:35.757463 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d03fea-366b-4379-bc08-3277a45b2978 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:35.759908 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91fb901-cbfd-46b1-be33-ac60915bfb06 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:35.761458 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c91fb901-cbfd-46b1-be33-ac60915bfb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:35.763300 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ed8a0-a18a-4686-9cc5-0a720c7067cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:35.764106 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ed8a0-a18a-4686-9cc5-0a720c7067cc admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:35.764459 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ed8a0-a18a-4686-9cc5-0a720c7067cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:35.765404 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ed8a0-a18a-4686-9cc5-0a720c7067cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:35.766209 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ed8a0-a18a-4686-9cc5-0a720c7067cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:35.768624 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ed8a0-a18a-4686-9cc5-0a720c7067cc admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:35.778404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91fb901-cbfd-46b1-be33-ac60915bfb06 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:35.785354 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb41aa-36dc-4703-91aa-ea2c34dfb4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:35.786422 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb41aa-36dc-4703-91aa-ea2c34dfb4d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:35.786744 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb41aa-36dc-4703-91aa-ea2c34dfb4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:35.786994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb41aa-36dc-4703-91aa-ea2c34dfb4d2 admin admin] PATH_INFO: `/v3/projects/24b5a22b29f74b60b3d6fb8abb90b157` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:35.789052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb41aa-36dc-4703-91aa-ea2c34dfb4d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24b5a22b29f74b60b3d6fb8abb90b157)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:35.791939 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb41aa-36dc-4703-91aa-ea2c34dfb4d2 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:35.802483 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1289/2553] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:01:35 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 06:01:35.807869 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ed8a0-a18a-4686-9cc5-0a720c7067cc admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:35.844746 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1bfb41aa-36dc-4703-91aa-ea2c34dfb4d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24b5a22b29f74b60b3d6fb8abb90b157', 'request_id': 'req-1bfb41aa-36dc-4703-91aa-ea2c34dfb4d2'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:35.853898 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1bfb41aa-36dc-4703-91aa-ea2c34dfb4d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24b5a22b29f74b60b3d6fb8abb90b157', 'request_id': 'req-1bfb41aa-36dc-4703-91aa-ea2c34dfb4d2'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:35.862447 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1bfb41aa-36dc-4703-91aa-ea2c34dfb4d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24b5a22b29f74b60b3d6fb8abb90b157', 'request_id': 'req-1bfb41aa-36dc-4703-91aa-ea2c34dfb4d2'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:35.874348 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1bfb41aa-36dc-4703-91aa-ea2c34dfb4d2 admin admin] The token cache is being invalidate because project 24b5a22b29f74b60b3d6fb8abb90b157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:01:35.874670 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1bfb41aa-36dc-4703-91aa-ea2c34dfb4d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:35.875346 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1bfb41aa-36dc-4703-91aa-ea2c34dfb4d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:35.876946 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1265/2554] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:01:35 2022] DELETE /identity/v3/projects/24b5a22b29f74b60b3d6fb8abb90b157 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:35.881011 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ed8a0-a18a-4686-9cc5-0a720c7067cc admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:35.882035 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b431d-0f48-4d18-aa7f-52299f66abc8 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:35.882399 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b431d-0f48-4d18-aa7f-52299f66abc8 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:35.882693 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b431d-0f48-4d18-aa7f-52299f66abc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:35.902523 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-381b431d-0f48-4d18-aa7f-52299f66abc8 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:35.903838 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-381b431d-0f48-4d18-aa7f-52299f66abc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:35.936686 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:35.943218 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0810505-2596-41eb-8281-043ae786cd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:35.944042 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0810505-2596-41eb-8281-043ae786cd2d admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:35.944327 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0810505-2596-41eb-8281-043ae786cd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:35.944602 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0810505-2596-41eb-8281-043ae786cd2d admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:35.945298 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0810505-2596-41eb-8281-043ae786cd2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:35.947818 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0810505-2596-41eb-8281-043ae786cd2d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:35.969557 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1266/2555] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:01:35.973225 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1290/2556] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:01:35 2022] POST /identity/v3/users => generated 290 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 06:01:35.974149 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b431d-0f48-4d18-aa7f-52299f66abc8 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:35.975542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-381b431d-0f48-4d18-aa7f-52299f66abc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:35.978461 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4dbb7-5f0d-44b8-acf4-fe4470bca373 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:35.978806 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4dbb7-5f0d-44b8-acf4-fe4470bca373 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:35.979102 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4dbb7-5f0d-44b8-acf4-fe4470bca373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:35.987998 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b431d-0f48-4d18-aa7f-52299f66abc8 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:35.992817 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6baaacd-91e3-4d33-b1af-5ecfc87d2fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:35.993514 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6baaacd-91e3-4d33-b1af-5ecfc87d2fba admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:35.993798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6baaacd-91e3-4d33-b1af-5ecfc87d2fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:35.994107 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6baaacd-91e3-4d33-b1af-5ecfc87d2fba admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:35.994835 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6baaacd-91e3-4d33-b1af-5ecfc87d2fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:35.996446 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6baaacd-91e3-4d33-b1af-5ecfc87d2fba admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:36.003082 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-b6a4dbb7-5f0d-44b8-acf4-fe4470bca373 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:36.004460 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b6a4dbb7-5f0d-44b8-acf4-fe4470bca373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:36.007128 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1267/2557] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 06:01:36.011563 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6baaacd-91e3-4d33-b1af-5ecfc87d2fba admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:36.014791 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1291/2558] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:01:36.018851 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4dbb7-5f0d-44b8-acf4-fe4470bca373 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:36.030212 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6baaacd-91e3-4d33-b1af-5ecfc87d2fba admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:36.030899 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4dbb7-5f0d-44b8-acf4-fe4470bca373 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:36.035306 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ab2c6-68f3-44b0-94cb-8c9acfbcf911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:36.035922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ab2c6-68f3-44b0-94cb-8c9acfbcf911 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:36.036205 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ab2c6-68f3-44b0-94cb-8c9acfbcf911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:36.036515 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ab2c6-68f3-44b0-94cb-8c9acfbcf911 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:36.037354 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ab2c6-68f3-44b0-94cb-8c9acfbcf911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:36.038882 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ab2c6-68f3-44b0-94cb-8c9acfbcf911 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:36.048846 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d11dd-6722-465b-9be8-d4c00fa2671c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:36.049887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d11dd-6722-465b-9be8-d4c00fa2671c admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:36.050204 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d11dd-6722-465b-9be8-d4c00fa2671c admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:36.050570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d11dd-6722-465b-9be8-d4c00fa2671c admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:36.054838 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d11dd-6722-465b-9be8-d4c00fa2671c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 06:01:36.054973 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1268/2559] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 06:01:36.055164 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d11dd-6722-465b-9be8-d4c00fa2671c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:36.057039 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d11dd-6722-465b-9be8-d4c00fa2671c admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:36.059184 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ab2c6-68f3-44b0-94cb-8c9acfbcf911 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:36.073112 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ab2c6-68f3-44b0-94cb-8c9acfbcf911 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:36.074636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1292/2560] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 06:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 06:01:36.078430 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d11dd-6722-465b-9be8-d4c00fa2671c admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:36.082150 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6081a4-169d-4c29-909c-55ae2dbc8c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:36.083049 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6081a4-169d-4c29-909c-55ae2dbc8c92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:36.083334 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6081a4-169d-4c29-909c-55ae2dbc8c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:36.083609 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6081a4-169d-4c29-909c-55ae2dbc8c92 admin admin] PATH_INFO: `/v3/projects/acd09a63551e4fedaa8d60b8e2190a56/users/bc79767798ad46ac925fbd44e6208d97/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:36.090440 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d11dd-6722-465b-9be8-d4c00fa2671c admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:36.095795 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56b3ba-439a-464d-9f5f-2330fc866159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:36.096523 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56b3ba-439a-464d-9f5f-2330fc866159 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:36.098307 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56b3ba-439a-464d-9f5f-2330fc866159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:36.099015 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56b3ba-439a-464d-9f5f-2330fc866159 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:36.100087 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56b3ba-439a-464d-9f5f-2330fc866159 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:36.100860 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6081a4-169d-4c29-909c-55ae2dbc8c92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd09a63551e4fedaa8d60b8e2190a56, user_id=bc79767798ad46ac925fbd44e6208d97, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:36.102610 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56b3ba-439a-464d-9f5f-2330fc866159 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:36.108851 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6081a4-169d-4c29-909c-55ae2dbc8c92 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:36.121340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1269/2561] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:36 2022] PUT /identity/v3/projects/acd09a63551e4fedaa8d60b8e2190a56/users/bc79767798ad46ac925fbd44e6208d97/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:36.132989 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d5805-5fa7-46a4-95b7-96727f5b40b2 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:36.133281 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d5805-5fa7-46a4-95b7-96727f5b40b2 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:36.134299 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d5805-5fa7-46a4-95b7-96727f5b40b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:36.142583 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1293/2562] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:01:36 2022] POST /identity/v3/projects => generated 357 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:36.143915 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56b3ba-439a-464d-9f5f-2330fc866159 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:36.151020 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:36.169896 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-cb4d5805-5fa7-46a4-95b7-96727f5b40b2 None None] MFA Rules not processed for user `bc79767798ad46ac925fbd44e6208d97`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:36.171323 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-cb4d5805-5fa7-46a4-95b7-96727f5b40b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:36.218723 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56b3ba-439a-464d-9f5f-2330fc866159 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:36.226603 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f43fa-6353-4f12-9c65-d7c7333e811a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:36.227383 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f43fa-6353-4f12-9c65-d7c7333e811a admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:36.227754 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f43fa-6353-4f12-9c65-d7c7333e811a admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:36.228079 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f43fa-6353-4f12-9c65-d7c7333e811a admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:36.228840 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f43fa-6353-4f12-9c65-d7c7333e811a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:36.230778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f43fa-6353-4f12-9c65-d7c7333e811a admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:36.254533 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1294/2563] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:01:36 2022] POST /identity/v3/users => generated 279 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:36.255803 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f43fa-6353-4f12-9c65-d7c7333e811a admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:36.258121 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1270/2564] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:36.263011 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d5805-5fa7-46a4-95b7-96727f5b40b2 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:36.266833 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f43fa-6353-4f12-9c65-d7c7333e811a admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:36.271804 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1707cee-d96c-410e-a20f-bfc5c518dcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:36.272237 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1707cee-d96c-410e-a20f-bfc5c518dcd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:36.272525 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1707cee-d96c-410e-a20f-bfc5c518dcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:36.272810 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1707cee-d96c-410e-a20f-bfc5c518dcd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:36.273271 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d5805-5fa7-46a4-95b7-96727f5b40b2 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:36.273746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1707cee-d96c-410e-a20f-bfc5c518dcd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:36.276116 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1707cee-d96c-410e-a20f-bfc5c518dcd2 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:36.278560 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ff9c3-f08d-4b72-aae5-c3f72b99edb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:36.279212 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ff9c3-f08d-4b72-aae5-c3f72b99edb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:36.279477 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ff9c3-f08d-4b72-aae5-c3f72b99edb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:36.279751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ff9c3-f08d-4b72-aae5-c3f72b99edb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:36.280441 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ff9c3-f08d-4b72-aae5-c3f72b99edb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:36.282635 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ff9c3-f08d-4b72-aae5-c3f72b99edb1 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:36.287046 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1295/2565] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:36.291209 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1707cee-d96c-410e-a20f-bfc5c518dcd2 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:36.301274 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1707cee-d96c-410e-a20f-bfc5c518dcd2 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:36.307167 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a2261-4d63-4033-baba-6f5bb1e6c1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:36.307837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a2261-4d63-4033-baba-6f5bb1e6c1bf admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:36.308127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a2261-4d63-4033-baba-6f5bb1e6c1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:36.308413 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a2261-4d63-4033-baba-6f5bb1e6c1bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:36.309139 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a2261-4d63-4033-baba-6f5bb1e6c1bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:36.310762 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a2261-4d63-4033-baba-6f5bb1e6c1bf admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:36.317529 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1271/2566] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:01:36 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:36.318261 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ff9c3-f08d-4b72-aae5-c3f72b99edb1 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:36.322988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1296/2567] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 06:01:36.327426 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a2261-4d63-4033-baba-6f5bb1e6c1bf admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:36.337573 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a2261-4d63-4033-baba-6f5bb1e6c1bf admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:36.387322 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:36.392076 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ff9c3-f08d-4b72-aae5-c3f72b99edb1 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:36.399749 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f82d38-0903-483d-9791-7597be612fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:36.400511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f82d38-0903-483d-9791-7597be612fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:36.400645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f82d38-0903-483d-9791-7597be612fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:36.400925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f82d38-0903-483d-9791-7597be612fd1 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:36.401619 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f82d38-0903-483d-9791-7597be612fd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:36.403528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e792b3-6c79-4f00-9a46-57c7a991eb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:36.403855 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f82d38-0903-483d-9791-7597be612fd1 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:36.404438 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e792b3-6c79-4f00-9a46-57c7a991eb74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:36.404763 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e792b3-6c79-4f00-9a46-57c7a991eb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:36.405172 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e792b3-6c79-4f00-9a46-57c7a991eb74 admin admin] PATH_INFO: `/v3/projects/747e93adea9c49a8b706803451ebee05/users/8b14b1855c634af88b9e298bb7db9f28/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:36.420966 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e792b3-6c79-4f00-9a46-57c7a991eb74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=747e93adea9c49a8b706803451ebee05, user_id=8b14b1855c634af88b9e298bb7db9f28, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:36.423625 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1272/2568] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:01:36 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 06:01:36.425899 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e792b3-6c79-4f00-9a46-57c7a991eb74 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:36.427659 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f82d38-0903-483d-9791-7597be612fd1 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:36.439129 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f82d38-0903-483d-9791-7597be612fd1 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:36.440473 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1297/2569] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:36 2022] PUT /identity/v3/projects/747e93adea9c49a8b706803451ebee05/users/8b14b1855c634af88b9e298bb7db9f28/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:36.451272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c683bd0-c046-465c-952b-1aa2bc297930 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:36.451563 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c683bd0-c046-465c-952b-1aa2bc297930 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:36.451843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c683bd0-c046-465c-952b-1aa2bc297930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:36.477769 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-2c683bd0-c046-465c-952b-1aa2bc297930 None None] MFA Rules not processed for user `8b14b1855c634af88b9e298bb7db9f28`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:36.479284 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-2c683bd0-c046-465c-952b-1aa2bc297930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:36.502225 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f987ca3-4468-4d39-899c-8b075bbe580d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:36.502899 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f987ca3-4468-4d39-899c-8b075bbe580d admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:36.503190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f987ca3-4468-4d39-899c-8b075bbe580d admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:36.503469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f987ca3-4468-4d39-899c-8b075bbe580d admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:36.504190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f987ca3-4468-4d39-899c-8b075bbe580d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:36.505819 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f987ca3-4468-4d39-899c-8b075bbe580d admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:36.516248 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1273/2570] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 06:01:36.520768 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f987ca3-4468-4d39-899c-8b075bbe580d admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:36.526099 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:36.531396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f987ca3-4468-4d39-899c-8b075bbe580d admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:36.536488 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3172ff-2215-43a1-a89b-dd4eab483acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:36.537630 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3172ff-2215-43a1-a89b-dd4eab483acf admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:36.537832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3172ff-2215-43a1-a89b-dd4eab483acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:36.538269 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3172ff-2215-43a1-a89b-dd4eab483acf admin admin] PATH_INFO: `/v3/projects/b8ced928b778484c8c8e2f391f7f85eb/users/a313a0fb32a44d808671514ca5a9b43c/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:36.547986 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1298/2571] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:36 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:36.552387 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c683bd0-c046-465c-952b-1aa2bc297930 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:36.553685 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3172ff-2215-43a1-a89b-dd4eab483acf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8ced928b778484c8c8e2f391f7f85eb, user_id=a313a0fb32a44d808671514ca5a9b43c, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:36.559340 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3172ff-2215-43a1-a89b-dd4eab483acf admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:36.565532 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c683bd0-c046-465c-952b-1aa2bc297930 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:36.570618 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa5f50-a2f8-4cb8-bb63-2305b546c605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:36.571857 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa5f50-a2f8-4cb8-bb63-2305b546c605 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:36.572175 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa5f50-a2f8-4cb8-bb63-2305b546c605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:36.572415 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa5f50-a2f8-4cb8-bb63-2305b546c605 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:36.573102 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa5f50-a2f8-4cb8-bb63-2305b546c605 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:36.574870 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1274/2572] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:36 2022] PUT /identity/v3/projects/b8ced928b778484c8c8e2f391f7f85eb/users/a313a0fb32a44d808671514ca5a9b43c/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:36.578371 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa5f50-a2f8-4cb8-bb63-2305b546c605 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:36.579287 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3172ff-2215-43a1-a89b-dd4eab483acf admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:36.605524 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1299/2573] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:01:36 2022] POST /identity/v3/projects => generated 357 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 06:01:36.606487 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa5f50-a2f8-4cb8-bb63-2305b546c605 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:36.643556 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3172ff-2215-43a1-a89b-dd4eab483acf admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:36.672628 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa5f50-a2f8-4cb8-bb63-2305b546c605 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:36.677411 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375126a-ecc9-4f41-a901-005772b702eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:36.678114 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375126a-ecc9-4f41-a901-005772b702eb admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:36.678400 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375126a-ecc9-4f41-a901-005772b702eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:36.678677 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375126a-ecc9-4f41-a901-005772b702eb admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:36.679369 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375126a-ecc9-4f41-a901-005772b702eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:36.681849 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375126a-ecc9-4f41-a901-005772b702eb admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:36.702413 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1300/2574] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:01:36 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 06:01:36.705060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b49a7-b1b1-498f-86af-35c931b3002c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:36.705732 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b49a7-b1b1-498f-86af-35c931b3002c admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:36.706042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b49a7-b1b1-498f-86af-35c931b3002c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:36.706318 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b49a7-b1b1-498f-86af-35c931b3002c admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:36.706420 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375126a-ecc9-4f41-a901-005772b702eb admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:36.707041 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b49a7-b1b1-498f-86af-35c931b3002c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:36.708644 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b49a7-b1b1-498f-86af-35c931b3002c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:36.716389 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375126a-ecc9-4f41-a901-005772b702eb admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:36.719527 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1275/2575] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 06:01:36.721224 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585f34e-133c-4c02-9b97-8e8bdb80bbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:36.721887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585f34e-133c-4c02-9b97-8e8bdb80bbdb admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:36.722208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585f34e-133c-4c02-9b97-8e8bdb80bbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:36.722490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585f34e-133c-4c02-9b97-8e8bdb80bbdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:36.723217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585f34e-133c-4c02-9b97-8e8bdb80bbdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:36.723864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b49a7-b1b1-498f-86af-35c931b3002c admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:36.724821 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585f34e-133c-4c02-9b97-8e8bdb80bbdb admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:36.729649 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:36.735723 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b49a7-b1b1-498f-86af-35c931b3002c admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:36.736627 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1301/2576] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 06:01:36.740876 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585f34e-133c-4c02-9b97-8e8bdb80bbdb admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:36.744863 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755cc69-f522-470c-aca2-9347d37575fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:36.745758 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755cc69-f522-470c-aca2-9347d37575fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:36.746533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755cc69-f522-470c-aca2-9347d37575fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:36.746823 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755cc69-f522-470c-aca2-9347d37575fe admin admin] PATH_INFO: `/v3/projects/b8ced928b778484c8c8e2f391f7f85eb/users/a313a0fb32a44d808671514ca5a9b43c/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:36.749122 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755cc69-f522-470c-aca2-9347d37575fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8ced928b778484c8c8e2f391f7f85eb, user_id=a313a0fb32a44d808671514ca5a9b43c, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:36.752341 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755cc69-f522-470c-aca2-9347d37575fe admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:36.752482 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585f34e-133c-4c02-9b97-8e8bdb80bbdb admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:36.757063 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4d29a-808c-40a9-8303-0695592b6e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:36.758009 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4d29a-808c-40a9-8303-0695592b6e58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:36.758470 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4d29a-808c-40a9-8303-0695592b6e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:36.758828 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4d29a-808c-40a9-8303-0695592b6e58 admin admin] PATH_INFO: `/v3/projects/177f243ac12c41b79784bfe52704d416/users/9b1d3d9b2ad044a1a66606a58a8c9684/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:36.765607 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1276/2577] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:36 2022] PUT /identity/v3/projects/b8ced928b778484c8c8e2f391f7f85eb/users/a313a0fb32a44d808671514ca5a9b43c/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:36.775696 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063cd28-e650-4b10-9626-8b2a290b33ef None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:36.775988 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063cd28-e650-4b10-9626-8b2a290b33ef None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:36.776275 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063cd28-e650-4b10-9626-8b2a290b33ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:36.777209 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4d29a-808c-40a9-8303-0695592b6e58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=177f243ac12c41b79784bfe52704d416, user_id=9b1d3d9b2ad044a1a66606a58a8c9684, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:36.780094 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4d29a-808c-40a9-8303-0695592b6e58 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:36.799364 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1302/2578] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:36 2022] PUT /identity/v3/projects/177f243ac12c41b79784bfe52704d416/users/9b1d3d9b2ad044a1a66606a58a8c9684/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:36.801767 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4d29a-808c-40a9-8303-0695592b6e58 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:36.809475 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-f063cd28-e650-4b10-9626-8b2a290b33ef None None] MFA Rules not processed for user `a313a0fb32a44d808671514ca5a9b43c`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:36.810828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f063cd28-e650-4b10-9626-8b2a290b33ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:36.864899 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4d29a-808c-40a9-8303-0695592b6e58 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:36.870151 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29494dc9-e235-43c0-803f-eaa34a4cdfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:36.870814 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29494dc9-e235-43c0-803f-eaa34a4cdfcc admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:36.871094 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29494dc9-e235-43c0-803f-eaa34a4cdfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:36.871375 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29494dc9-e235-43c0-803f-eaa34a4cdfcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:36.872089 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29494dc9-e235-43c0-803f-eaa34a4cdfcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:36.873665 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29494dc9-e235-43c0-803f-eaa34a4cdfcc admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:36.880257 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1277/2579] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:36.882341 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063cd28-e650-4b10-9626-8b2a290b33ef None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:36.887474 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1303/2580] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:36.888427 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29494dc9-e235-43c0-803f-eaa34a4cdfcc admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:36.888600 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f063cd28-e650-4b10-9626-8b2a290b33ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:36.898947 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29494dc9-e235-43c0-803f-eaa34a4cdfcc admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:36.902471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063cd28-e650-4b10-9626-8b2a290b33ef None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:36.904795 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aab34e-9f98-4cfd-a8e4-83a4b5c442c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:36.905897 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aab34e-9f98-4cfd-a8e4-83a4b5c442c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:36.906227 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aab34e-9f98-4cfd-a8e4-83a4b5c442c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:36.906656 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aab34e-9f98-4cfd-a8e4-83a4b5c442c0 admin admin] PATH_INFO: `/v3/projects/177f243ac12c41b79784bfe52704d416/users/9b1d3d9b2ad044a1a66606a58a8c9684/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:36.908620 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031a79a-69f2-4043-9b19-db49ed70a3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:36.908761 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aab34e-9f98-4cfd-a8e4-83a4b5c442c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=177f243ac12c41b79784bfe52704d416, user_id=9b1d3d9b2ad044a1a66606a58a8c9684, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:36.909487 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031a79a-69f2-4043-9b19-db49ed70a3bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:36.909768 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031a79a-69f2-4043-9b19-db49ed70a3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:36.910084 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031a79a-69f2-4043-9b19-db49ed70a3bd admin admin] PATH_INFO: `/v3/users/c9d247d6152741548f55f917ab66dbd1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:36.911305 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031a79a-69f2-4043-9b19-db49ed70a3bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9d247d6152741548f55f917ab66dbd1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:36.911423 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aab34e-9f98-4cfd-a8e4-83a4b5c442c0 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:36.913233 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031a79a-69f2-4043-9b19-db49ed70a3bd admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:36.918662 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:36.923785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1304/2581] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:36 2022] PUT /identity/v3/projects/177f243ac12c41b79784bfe52704d416/users/9b1d3d9b2ad044a1a66606a58a8c9684/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:36.924509 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aab34e-9f98-4cfd-a8e4-83a4b5c442c0 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:36.934675 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a0aab34e-9f98-4cfd-a8e4-83a4b5c442c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:36.961648 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6031a79a-69f2-4043-9b19-db49ed70a3bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9d247d6152741548f55f917ab66dbd1'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:36.972230 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6031a79a-69f2-4043-9b19-db49ed70a3bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9d247d6152741548f55f917ab66dbd1'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:36.972942 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6031a79a-69f2-4043-9b19-db49ed70a3bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9d247d6152741548f55f917ab66dbd1'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:36.973578 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6031a79a-69f2-4043-9b19-db49ed70a3bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9d247d6152741548f55f917ab66dbd1'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:36.987412 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6031a79a-69f2-4043-9b19-db49ed70a3bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9d247d6152741548f55f917ab66dbd1'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:36.996885 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aab34e-9f98-4cfd-a8e4-83a4b5c442c0 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:37.000735 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964d411-9b3e-4ac2-a265-5e8619954212 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:37.001389 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964d411-9b3e-4ac2-a265-5e8619954212 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:37.001669 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964d411-9b3e-4ac2-a265-5e8619954212 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:37.001957 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964d411-9b3e-4ac2-a265-5e8619954212 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:37.002448 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1278/2582] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:01:36 2022] DELETE /identity/v3/users/c9d247d6152741548f55f917ab66dbd1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:37.004018 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c673454-2878-40dd-a1d3-e34d632bafc7 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:37.004138 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-5964d411-9b3e-4ac2-a265-5e8619954212 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:37.004312 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c673454-2878-40dd-a1d3-e34d632bafc7 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:37.004590 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c673454-2878-40dd-a1d3-e34d632bafc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:37.036481 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-3c673454-2878-40dd-a1d3-e34d632bafc7 None None] MFA Rules not processed for user `9b1d3d9b2ad044a1a66606a58a8c9684`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:37.042848 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3c673454-2878-40dd-a1d3-e34d632bafc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:37.072476 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964d411-9b3e-4ac2-a265-5e8619954212 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:37.074694 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964d411-9b3e-4ac2-a265-5e8619954212 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:37.082453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:37.087301 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1305/2583] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:01:37.088867 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174595e3-3ba0-4e19-a41b-7d701c657a75 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:37.089158 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174595e3-3ba0-4e19-a41b-7d701c657a75 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:37.089991 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174595e3-3ba0-4e19-a41b-7d701c657a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:37.115054 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-174595e3-3ba0-4e19-a41b-7d701c657a75 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:37.116385 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-174595e3-3ba0-4e19-a41b-7d701c657a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:37.132362 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1279/2584] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:37 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:37.138709 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c673454-2878-40dd-a1d3-e34d632bafc7 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:37.140615 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3c673454-2878-40dd-a1d3-e34d632bafc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:37.179143 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1306/2585] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:37.179941 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174595e3-3ba0-4e19-a41b-7d701c657a75 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:37.181397 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-174595e3-3ba0-4e19-a41b-7d701c657a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:37.204370 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c673454-2878-40dd-a1d3-e34d632bafc7 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:37.208028 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac6c7a-bcd8-4139-a02a-44ee85f0fc44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:37.208681 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac6c7a-bcd8-4139-a02a-44ee85f0fc44 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:37.208968 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac6c7a-bcd8-4139-a02a-44ee85f0fc44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:37.209249 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac6c7a-bcd8-4139-a02a-44ee85f0fc44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:37.211080 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-44ac6c7a-bcd8-4139-a02a-44ee85f0fc44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:37.242036 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174595e3-3ba0-4e19-a41b-7d701c657a75 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:37.245846 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836cfe3-ebfb-4e62-8f0b-2672cc8e854f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:37.246591 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836cfe3-ebfb-4e62-8f0b-2672cc8e854f service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:37.247019 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836cfe3-ebfb-4e62-8f0b-2672cc8e854f service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:37.247316 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836cfe3-ebfb-4e62-8f0b-2672cc8e854f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:37.253486 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:37.257887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836cfe3-ebfb-4e62-8f0b-2672cc8e854f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:37.259420 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836cfe3-ebfb-4e62-8f0b-2672cc8e854f service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:37.269078 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1307/2586] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:37 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:01:37.269958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836cfe3-ebfb-4e62-8f0b-2672cc8e854f service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:37.271267 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3836cfe3-ebfb-4e62-8f0b-2672cc8e854f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:37.271750 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac6c7a-bcd8-4139-a02a-44ee85f0fc44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:37.273366 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac6c7a-bcd8-4139-a02a-44ee85f0fc44 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:37.283539 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1280/2587] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 06:01:37.334596 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836cfe3-ebfb-4e62-8f0b-2672cc8e854f service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:37.339433 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4c993-ddc3-4e52-af56-5ce949498b03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:37.340149 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4c993-ddc3-4e52-af56-5ce949498b03 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:37.340468 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4c993-ddc3-4e52-af56-5ce949498b03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:37.340758 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4c993-ddc3-4e52-af56-5ce949498b03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:37.359542 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4c993-ddc3-4e52-af56-5ce949498b03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:37.359797 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac6c7a-bcd8-4139-a02a-44ee85f0fc44 service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:37.361181 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4c993-ddc3-4e52-af56-5ce949498b03 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:37.375789 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac6c7a-bcd8-4139-a02a-44ee85f0fc44 service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:37.377620 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1308/2588] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:01:37.381750 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba2bd3-548a-4bd0-96a9-63600b9cc6af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:37.381750 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba2bd3-548a-4bd0-96a9-63600b9cc6af service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:37.381750 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba2bd3-548a-4bd0-96a9-63600b9cc6af service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:37.381750 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba2bd3-548a-4bd0-96a9-63600b9cc6af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:37.387002 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5cba2bd3-548a-4bd0-96a9-63600b9cc6af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:37.433259 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4c993-ddc3-4e52-af56-5ce949498b03 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:37.434841 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b1c4c993-ddc3-4e52-af56-5ce949498b03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:37.448440 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4c993-ddc3-4e52-af56-5ce949498b03 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:37.455653 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0276c0-50cc-4887-8a95-4bded018f4ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:37.456312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0276c0-50cc-4887-8a95-4bded018f4ff service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:37.456600 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0276c0-50cc-4887-8a95-4bded018f4ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:37.456881 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0276c0-50cc-4887-8a95-4bded018f4ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:37.474423 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba2bd3-548a-4bd0-96a9-63600b9cc6af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:37.476025 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba2bd3-548a-4bd0-96a9-63600b9cc6af service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:37.476599 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-2c0276c0-50cc-4887-8a95-4bded018f4ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:37.491693 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1281/2589] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:37 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:01:37.499312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0276c0-50cc-4887-8a95-4bded018f4ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:37.501333 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0276c0-50cc-4887-8a95-4bded018f4ff service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:37.514620 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1309/2590] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 06:01:37.865066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba2bd3-548a-4bd0-96a9-63600b9cc6af service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:37.866551 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5cba2bd3-548a-4bd0-96a9-63600b9cc6af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:37.880713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba2bd3-548a-4bd0-96a9-63600b9cc6af service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:37.885846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d501b7-98c9-4da2-b5cb-7136499628e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:37.886739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d501b7-98c9-4da2-b5cb-7136499628e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:37.887026 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d501b7-98c9-4da2-b5cb-7136499628e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:37.887308 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d501b7-98c9-4da2-b5cb-7136499628e8 admin admin] PATH_INFO: `/v3/projects/b990f39d52ad48518bb2bdc70ca09efb` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:37.888509 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d501b7-98c9-4da2-b5cb-7136499628e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b990f39d52ad48518bb2bdc70ca09efb)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:37.890547 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d501b7-98c9-4da2-b5cb-7136499628e8 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:37.915167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:37.943952 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-72d501b7-98c9-4da2-b5cb-7136499628e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b990f39d52ad48518bb2bdc70ca09efb', 'request_id': 'req-72d501b7-98c9-4da2-b5cb-7136499628e8'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:37.952335 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-72d501b7-98c9-4da2-b5cb-7136499628e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b990f39d52ad48518bb2bdc70ca09efb', 'request_id': 'req-72d501b7-98c9-4da2-b5cb-7136499628e8'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:37.959158 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-72d501b7-98c9-4da2-b5cb-7136499628e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b990f39d52ad48518bb2bdc70ca09efb', 'request_id': 'req-72d501b7-98c9-4da2-b5cb-7136499628e8'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:37.971050 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-72d501b7-98c9-4da2-b5cb-7136499628e8 admin admin] The token cache is being invalidate because project b990f39d52ad48518bb2bdc70ca09efb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:01:37.971400 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-72d501b7-98c9-4da2-b5cb-7136499628e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:37.972128 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-72d501b7-98c9-4da2-b5cb-7136499628e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:37.973911 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1282/2591] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:01:37 2022] DELETE /identity/v3/projects/b990f39d52ad48518bb2bdc70ca09efb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:37.977956 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0276c0-50cc-4887-8a95-4bded018f4ff service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:37.988004 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0276c0-50cc-4887-8a95-4bded018f4ff service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:38.054228 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef42cea-acc7-4e64-aa78-84e04709a957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:38.055311 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef42cea-acc7-4e64-aa78-84e04709a957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:38.056128 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef42cea-acc7-4e64-aa78-84e04709a957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:38.056410 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef42cea-acc7-4e64-aa78-84e04709a957 admin admin] PATH_INFO: `/v3/users/59100fba193b40f980e9d079ef80d7d0` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:38.057651 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef42cea-acc7-4e64-aa78-84e04709a957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59100fba193b40f980e9d079ef80d7d0)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:38.059644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef42cea-acc7-4e64-aa78-84e04709a957 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:38.123867 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-2ef42cea-acc7-4e64-aa78-84e04709a957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59100fba193b40f980e9d079ef80d7d0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:38.132747 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-2ef42cea-acc7-4e64-aa78-84e04709a957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59100fba193b40f980e9d079ef80d7d0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:38.133485 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-2ef42cea-acc7-4e64-aa78-84e04709a957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59100fba193b40f980e9d079ef80d7d0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:38.143264 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-2ef42cea-acc7-4e64-aa78-84e04709a957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59100fba193b40f980e9d079ef80d7d0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:38.156267 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-2ef42cea-acc7-4e64-aa78-84e04709a957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59100fba193b40f980e9d079ef80d7d0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:38.163029 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1310/2592] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:01:37 2022] DELETE /identity/v3/users/59100fba193b40f980e9d079ef80d7d0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:38.594915 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d501b7-98c9-4da2-b5cb-7136499628e8 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:38.597029 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-72d501b7-98c9-4da2-b5cb-7136499628e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:38.617013 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d501b7-98c9-4da2-b5cb-7136499628e8 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:38.695420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44ee9e-e0f8-439f-a6ea-113e8ba9aff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:38.696708 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44ee9e-e0f8-439f-a6ea-113e8ba9aff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:38.697079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44ee9e-e0f8-439f-a6ea-113e8ba9aff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:38.697430 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44ee9e-e0f8-439f-a6ea-113e8ba9aff2 admin admin] PATH_INFO: `/v3/projects/9c6478e0dc67487ca06ad62515d4eb04` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:38.699227 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a44ee9e-e0f8-439f-a6ea-113e8ba9aff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c6478e0dc67487ca06ad62515d4eb04)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:38.701285 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a44ee9e-e0f8-439f-a6ea-113e8ba9aff2 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:38.799539 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-2a44ee9e-e0f8-439f-a6ea-113e8ba9aff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c6478e0dc67487ca06ad62515d4eb04', 'request_id': 'req-2a44ee9e-e0f8-439f-a6ea-113e8ba9aff2'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:38.810274 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-2a44ee9e-e0f8-439f-a6ea-113e8ba9aff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c6478e0dc67487ca06ad62515d4eb04', 'request_id': 'req-2a44ee9e-e0f8-439f-a6ea-113e8ba9aff2'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:38.823869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-2a44ee9e-e0f8-439f-a6ea-113e8ba9aff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c6478e0dc67487ca06ad62515d4eb04', 'request_id': 'req-2a44ee9e-e0f8-439f-a6ea-113e8ba9aff2'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:38.835865 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-2a44ee9e-e0f8-439f-a6ea-113e8ba9aff2 admin admin] The token cache is being invalidate because project 9c6478e0dc67487ca06ad62515d4eb04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:01:38.835865 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-2a44ee9e-e0f8-439f-a6ea-113e8ba9aff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:38.837155 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-2a44ee9e-e0f8-439f-a6ea-113e8ba9aff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:38.839238 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1283/2593] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:01:38 2022] DELETE /identity/v3/projects/9c6478e0dc67487ca06ad62515d4eb04 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:38.843290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef42cea-acc7-4e64-aa78-84e04709a957 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:38.844735 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-2ef42cea-acc7-4e64-aa78-84e04709a957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:38.854516 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:38.861588 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef42cea-acc7-4e64-aa78-84e04709a957 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:38.968401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbaef2f-b65b-463a-8ff0-2ed5132d975b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:38.969317 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbaef2f-b65b-463a-8ff0-2ed5132d975b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:38.969604 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbaef2f-b65b-463a-8ff0-2ed5132d975b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:38.969882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbaef2f-b65b-463a-8ff0-2ed5132d975b admin admin] PATH_INFO: `/v3/users/2a1c099540a545819556364ef0690a88` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:38.971340 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbaef2f-b65b-463a-8ff0-2ed5132d975b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a1c099540a545819556364ef0690a88)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:38.973430 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbaef2f-b65b-463a-8ff0-2ed5132d975b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:39.042574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-fbbaef2f-b65b-463a-8ff0-2ed5132d975b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a1c099540a545819556364ef0690a88'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:39.052676 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-fbbaef2f-b65b-463a-8ff0-2ed5132d975b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a1c099540a545819556364ef0690a88'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:39.053926 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-fbbaef2f-b65b-463a-8ff0-2ed5132d975b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a1c099540a545819556364ef0690a88'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:39.064032 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-fbbaef2f-b65b-463a-8ff0-2ed5132d975b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a1c099540a545819556364ef0690a88'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:39.085510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-fbbaef2f-b65b-463a-8ff0-2ed5132d975b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a1c099540a545819556364ef0690a88'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:39.100935 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1311/2594] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:01:38 2022] DELETE /identity/v3/users/2a1c099540a545819556364ef0690a88 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:39.940547 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44ee9e-e0f8-439f-a6ea-113e8ba9aff2 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:39.942321 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-2a44ee9e-e0f8-439f-a6ea-113e8ba9aff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:39.955876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44ee9e-e0f8-439f-a6ea-113e8ba9aff2 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:40.002283 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:40.038103 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b391dd-db2d-405c-9e75-d0288fed68cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:40.040486 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b391dd-db2d-405c-9e75-d0288fed68cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:40.040880 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b391dd-db2d-405c-9e75-d0288fed68cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:40.041256 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b391dd-db2d-405c-9e75-d0288fed68cc admin admin] PATH_INFO: `/v3/projects/59bf3ba535e84eccbb9c3f594556d60a` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:40.042812 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b391dd-db2d-405c-9e75-d0288fed68cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=59bf3ba535e84eccbb9c3f594556d60a)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:40.045703 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b391dd-db2d-405c-9e75-d0288fed68cc admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:40.147479 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c3b391dd-db2d-405c-9e75-d0288fed68cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59bf3ba535e84eccbb9c3f594556d60a', 'request_id': 'req-c3b391dd-db2d-405c-9e75-d0288fed68cc'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:40.156483 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c3b391dd-db2d-405c-9e75-d0288fed68cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59bf3ba535e84eccbb9c3f594556d60a', 'request_id': 'req-c3b391dd-db2d-405c-9e75-d0288fed68cc'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:40.166628 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c3b391dd-db2d-405c-9e75-d0288fed68cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59bf3ba535e84eccbb9c3f594556d60a', 'request_id': 'req-c3b391dd-db2d-405c-9e75-d0288fed68cc'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:40.181775 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c3b391dd-db2d-405c-9e75-d0288fed68cc admin admin] The token cache is being invalidate because project 59bf3ba535e84eccbb9c3f594556d60a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:01:40.182170 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c3b391dd-db2d-405c-9e75-d0288fed68cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:40.182906 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c3b391dd-db2d-405c-9e75-d0288fed68cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:40.184728 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1284/2595] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:01:39 2022] DELETE /identity/v3/projects/59bf3ba535e84eccbb9c3f594556d60a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:40.189578 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a54d8-36f1-4a03-b847-9a0db9ec780c None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:40.190138 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a54d8-36f1-4a03-b847-9a0db9ec780c None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:40.190243 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a54d8-36f1-4a03-b847-9a0db9ec780c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:40.209900 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-735a54d8-36f1-4a03-b847-9a0db9ec780c None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:40.212427 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-735a54d8-36f1-4a03-b847-9a0db9ec780c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:40.301460 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1312/2596] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:01:40.303621 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7815e44-3a92-4da4-bb0e-211b9aa7df9c None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:40.303938 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7815e44-3a92-4da4-bb0e-211b9aa7df9c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:40.304220 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7815e44-3a92-4da4-bb0e-211b9aa7df9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:40.328307 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-c7815e44-3a92-4da4-bb0e-211b9aa7df9c None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:40.329634 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c7815e44-3a92-4da4-bb0e-211b9aa7df9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:40.341407 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1285/2597] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:01:40.346337 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a54d8-36f1-4a03-b847-9a0db9ec780c None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:40.361705 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a54d8-36f1-4a03-b847-9a0db9ec780c None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:40.378306 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f226ea-cecb-42b0-b231-9e820a6f76ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:40.379125 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f226ea-cecb-42b0-b231-9e820a6f76ee admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:40.379415 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f226ea-cecb-42b0-b231-9e820a6f76ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:40.379692 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f226ea-cecb-42b0-b231-9e820a6f76ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:40.380436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f226ea-cecb-42b0-b231-9e820a6f76ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 06:01:40.380761 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f226ea-cecb-42b0-b231-9e820a6f76ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:40.382468 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f226ea-cecb-42b0-b231-9e820a6f76ee admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:40.409772 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1313/2598] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 06:01:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 06:01:40.411569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7815e44-3a92-4da4-bb0e-211b9aa7df9c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:40.423201 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7815e44-3a92-4da4-bb0e-211b9aa7df9c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:40.431651 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d1048-b8ed-460d-b56c-0b0815f267ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:40.431651 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d1048-b8ed-460d-b56c-0b0815f267ae admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:40.431994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d1048-b8ed-460d-b56c-0b0815f267ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:40.432163 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d1048-b8ed-460d-b56c-0b0815f267ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:40.433434 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d1048-b8ed-460d-b56c-0b0815f267ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:40.435078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d1048-b8ed-460d-b56c-0b0815f267ae admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:40.525976 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f226ea-cecb-42b0-b231-9e820a6f76ee admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:40.528250 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-36f226ea-cecb-42b0-b231-9e820a6f76ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:40.541437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1286/2599] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:01:40 2022] POST /identity/v3/projects => generated 389 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:40.545189 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d1048-b8ed-460d-b56c-0b0815f267ae admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:40.561699 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f226ea-cecb-42b0-b231-9e820a6f76ee admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:40.582882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:40.663762 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d1048-b8ed-460d-b56c-0b0815f267ae admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:40.668994 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1331e87-5193-4952-80df-02fffcb6baa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:40.669695 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1331e87-5193-4952-80df-02fffcb6baa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:40.670012 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1331e87-5193-4952-80df-02fffcb6baa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:40.670300 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1331e87-5193-4952-80df-02fffcb6baa5 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:40.671015 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1331e87-5193-4952-80df-02fffcb6baa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:40.673039 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1331e87-5193-4952-80df-02fffcb6baa5 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:40.673667 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5095a-3845-4091-ae37-b333240692c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:40.675258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5095a-3845-4091-ae37-b333240692c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:40.675781 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5095a-3845-4091-ae37-b333240692c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:40.676264 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5095a-3845-4091-ae37-b333240692c7 admin admin] PATH_INFO: `/v3/users/f92ac025e7da45608e6885ba6644de09` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:40.677920 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5095a-3845-4091-ae37-b333240692c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f92ac025e7da45608e6885ba6644de09)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:40.681836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5095a-3845-4091-ae37-b333240692c7 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:40.698762 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1287/2600] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:01:40 2022] POST /identity/v3/users => generated 295 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:40.702684 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1331e87-5193-4952-80df-02fffcb6baa5 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:40.713896 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1331e87-5193-4952-80df-02fffcb6baa5 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:40.719723 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fb427-8dbe-4d3f-bee5-3fbcdd00645a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:40.720569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fb427-8dbe-4d3f-bee5-3fbcdd00645a admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:40.720694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fb427-8dbe-4d3f-bee5-3fbcdd00645a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:40.720985 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fb427-8dbe-4d3f-bee5-3fbcdd00645a admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:40.721833 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096fb427-8dbe-4d3f-bee5-3fbcdd00645a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:40.723566 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096fb427-8dbe-4d3f-bee5-3fbcdd00645a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:40.739754 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1288/2601] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 06:01:40.744029 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fb427-8dbe-4d3f-bee5-3fbcdd00645a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:40.751141 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-86a5095a-3845-4091-ae37-b333240692c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f92ac025e7da45608e6885ba6644de09'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:40.755049 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fb427-8dbe-4d3f-bee5-3fbcdd00645a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:40.760542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b21db0-6980-4fa0-8e04-1831a665392c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:40.760781 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-86a5095a-3845-4091-ae37-b333240692c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f92ac025e7da45608e6885ba6644de09'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:40.761257 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b21db0-6980-4fa0-8e04-1831a665392c admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:40.761549 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b21db0-6980-4fa0-8e04-1831a665392c admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:40.761655 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-86a5095a-3845-4091-ae37-b333240692c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f92ac025e7da45608e6885ba6644de09'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:40.761824 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b21db0-6980-4fa0-8e04-1831a665392c admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:40.762592 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b21db0-6980-4fa0-8e04-1831a665392c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:40.764240 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b21db0-6980-4fa0-8e04-1831a665392c admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:40.772087 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-86a5095a-3845-4091-ae37-b333240692c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f92ac025e7da45608e6885ba6644de09'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:40.777011 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1289/2602] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:40.781088 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b21db0-6980-4fa0-8e04-1831a665392c admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:40.791315 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-86a5095a-3845-4091-ae37-b333240692c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f92ac025e7da45608e6885ba6644de09'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:40.792408 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b21db0-6980-4fa0-8e04-1831a665392c admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:40.797395 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1118c-c011-4c64-8607-9788bb81e3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:40.798333 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1118c-c011-4c64-8607-9788bb81e3b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:40.798618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1118c-c011-4c64-8607-9788bb81e3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:40.798893 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1118c-c011-4c64-8607-9788bb81e3b6 admin admin] PATH_INFO: `/v3/projects/fbbc98a3e63f42e29cccc0e61380eaed/users/907ff8cdc93348408d089480cd24e9c9/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:40.803724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1314/2603] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:01:40 2022] DELETE /identity/v3/users/f92ac025e7da45608e6885ba6644de09 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:40.803890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:40.808162 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b1b0c-9d3e-4dc5-aa34-0e73ee7b4887 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:40.808597 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b1b0c-9d3e-4dc5-aa34-0e73ee7b4887 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:40.808879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b1b0c-9d3e-4dc5-aa34-0e73ee7b4887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:40.822070 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1118c-c011-4c64-8607-9788bb81e3b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbbc98a3e63f42e29cccc0e61380eaed, user_id=907ff8cdc93348408d089480cd24e9c9, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:40.824795 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1118c-c011-4c64-8607-9788bb81e3b6 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:40.830412 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-901b1b0c-9d3e-4dc5-aa34-0e73ee7b4887 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:40.832054 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-901b1b0c-9d3e-4dc5-aa34-0e73ee7b4887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:40.841998 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1290/2604] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:40 2022] PUT /identity/v3/projects/fbbc98a3e63f42e29cccc0e61380eaed/users/907ff8cdc93348408d089480cd24e9c9/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:40.854785 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8637743-e7fc-47ee-bb87-05356c526fe5 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:40.855095 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8637743-e7fc-47ee-bb87-05356c526fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:40.855382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8637743-e7fc-47ee-bb87-05356c526fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:40.888225 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-c8637743-e7fc-47ee-bb87-05356c526fe5 None None] MFA Rules not processed for user `907ff8cdc93348408d089480cd24e9c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:40.889649 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c8637743-e7fc-47ee-bb87-05356c526fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:40.907494 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1315/2605] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:40.924195 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b1b0c-9d3e-4dc5-aa34-0e73ee7b4887 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:40.925801 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-901b1b0c-9d3e-4dc5-aa34-0e73ee7b4887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:40.968671 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:40.980374 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1291/2606] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:01:40.992013 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8637743-e7fc-47ee-bb87-05356c526fe5 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:40.994610 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c8637743-e7fc-47ee-bb87-05356c526fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:41.010260 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b1b0c-9d3e-4dc5-aa34-0e73ee7b4887 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:41.073911 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8637743-e7fc-47ee-bb87-05356c526fe5 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:41.074289 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e51ad2-1037-47f1-957c-acd9a5127dd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:41.075718 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e51ad2-1037-47f1-957c-acd9a5127dd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:41.075956 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e51ad2-1037-47f1-957c-acd9a5127dd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:41.076247 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e51ad2-1037-47f1-957c-acd9a5127dd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:41.081873 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba74107-9857-4752-b2be-cf31f4d029ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:41.082922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba74107-9857-4752-b2be-cf31f4d029ef service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:41.083591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba74107-9857-4752-b2be-cf31f4d029ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:41.083890 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba74107-9857-4752-b2be-cf31f4d029ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:41.104895 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba74107-9857-4752-b2be-cf31f4d029ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:41.113978 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba74107-9857-4752-b2be-cf31f4d029ef service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:41.122868 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1292/2607] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:01:41.166712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e51ad2-1037-47f1-957c-acd9a5127dd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:41.168596 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e51ad2-1037-47f1-957c-acd9a5127dd5 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:41.178816 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1316/2608] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:01:41.671562 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba74107-9857-4752-b2be-cf31f4d029ef service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:41.673479 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-aba74107-9857-4752-b2be-cf31f4d029ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:41.697696 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba74107-9857-4752-b2be-cf31f4d029ef service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:41.712868 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd4f53-549d-40cb-baf2-3598dff4ca6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:41.714339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd4f53-549d-40cb-baf2-3598dff4ca6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:41.714870 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd4f53-549d-40cb-baf2-3598dff4ca6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:41.715778 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd4f53-549d-40cb-baf2-3598dff4ca6e admin admin] PATH_INFO: `/v3/projects/a6c4b7df153a4bf79cad85cf00dc7e4e` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:41.717372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd4f53-549d-40cb-baf2-3598dff4ca6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6c4b7df153a4bf79cad85cf00dc7e4e)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:41.720630 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd4f53-549d-40cb-baf2-3598dff4ca6e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:41.809134 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d7fd4f53-549d-40cb-baf2-3598dff4ca6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6c4b7df153a4bf79cad85cf00dc7e4e', 'request_id': 'req-d7fd4f53-549d-40cb-baf2-3598dff4ca6e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:41.819980 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d7fd4f53-549d-40cb-baf2-3598dff4ca6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6c4b7df153a4bf79cad85cf00dc7e4e', 'request_id': 'req-d7fd4f53-549d-40cb-baf2-3598dff4ca6e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:41.832148 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d7fd4f53-549d-40cb-baf2-3598dff4ca6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6c4b7df153a4bf79cad85cf00dc7e4e', 'request_id': 'req-d7fd4f53-549d-40cb-baf2-3598dff4ca6e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:41.845713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:41.851702 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d7fd4f53-549d-40cb-baf2-3598dff4ca6e admin admin] The token cache is being invalidate because project a6c4b7df153a4bf79cad85cf00dc7e4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:01:41.852139 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d7fd4f53-549d-40cb-baf2-3598dff4ca6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:41.854346 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d7fd4f53-549d-40cb-baf2-3598dff4ca6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:41.858045 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1293/2609] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:01:41 2022] DELETE /identity/v3/projects/a6c4b7df153a4bf79cad85cf00dc7e4e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:41.861017 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e51ad2-1037-47f1-957c-acd9a5127dd5 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:41.871411 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e51ad2-1037-47f1-957c-acd9a5127dd5 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:41.943421 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895df954-dd9d-45c5-bdf0-4f76adb94043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:41.944298 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895df954-dd9d-45c5-bdf0-4f76adb94043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:41.944635 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895df954-dd9d-45c5-bdf0-4f76adb94043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:41.944920 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895df954-dd9d-45c5-bdf0-4f76adb94043 admin admin] PATH_INFO: `/v3/users/bc79767798ad46ac925fbd44e6208d97` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:41.947033 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895df954-dd9d-45c5-bdf0-4f76adb94043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc79767798ad46ac925fbd44e6208d97)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:41.948954 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895df954-dd9d-45c5-bdf0-4f76adb94043 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:42.001767 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:42.006137 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-895df954-dd9d-45c5-bdf0-4f76adb94043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc79767798ad46ac925fbd44e6208d97'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:42.018002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-895df954-dd9d-45c5-bdf0-4f76adb94043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc79767798ad46ac925fbd44e6208d97'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:42.018748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-895df954-dd9d-45c5-bdf0-4f76adb94043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc79767798ad46ac925fbd44e6208d97'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:42.029891 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-895df954-dd9d-45c5-bdf0-4f76adb94043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc79767798ad46ac925fbd44e6208d97'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:42.049688 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-895df954-dd9d-45c5-bdf0-4f76adb94043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc79767798ad46ac925fbd44e6208d97'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:42.068044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1317/2610] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:01:41 2022] DELETE /identity/v3/users/bc79767798ad46ac925fbd44e6208d97 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:42.103232 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd4f53-549d-40cb-baf2-3598dff4ca6e admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:42.106346 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d7fd4f53-549d-40cb-baf2-3598dff4ca6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:42.129413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd4f53-549d-40cb-baf2-3598dff4ca6e admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:42.243013 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e586b3-8b67-4696-a1b3-c9f08e05498f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:42.245038 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e586b3-8b67-4696-a1b3-c9f08e05498f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:42.245323 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e586b3-8b67-4696-a1b3-c9f08e05498f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:42.245633 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e586b3-8b67-4696-a1b3-c9f08e05498f admin admin] PATH_INFO: `/v3/users/7e3e3935d57a48f195a568f90ed25a8a` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:42.247663 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e586b3-8b67-4696-a1b3-c9f08e05498f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e3e3935d57a48f195a568f90ed25a8a)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:42.249879 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e586b3-8b67-4696-a1b3-c9f08e05498f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:42.332810 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-12e586b3-8b67-4696-a1b3-c9f08e05498f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e3e3935d57a48f195a568f90ed25a8a'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:42.345280 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-12e586b3-8b67-4696-a1b3-c9f08e05498f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e3e3935d57a48f195a568f90ed25a8a'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:42.346064 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-12e586b3-8b67-4696-a1b3-c9f08e05498f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e3e3935d57a48f195a568f90ed25a8a'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:42.346691 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-12e586b3-8b67-4696-a1b3-c9f08e05498f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e3e3935d57a48f195a568f90ed25a8a'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:42.360887 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-12e586b3-8b67-4696-a1b3-c9f08e05498f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e3e3935d57a48f195a568f90ed25a8a'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:42.376180 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1294/2611] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:01:42 2022] DELETE /identity/v3/users/7e3e3935d57a48f195a568f90ed25a8a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:42.490372 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895df954-dd9d-45c5-bdf0-4f76adb94043 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:42.492453 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-895df954-dd9d-45c5-bdf0-4f76adb94043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:42.522183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895df954-dd9d-45c5-bdf0-4f76adb94043 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:42.606242 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bd54c-2442-46a4-9fc6-3f5bf63ff1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:42.607177 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bd54c-2442-46a4-9fc6-3f5bf63ff1e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:42.607536 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bd54c-2442-46a4-9fc6-3f5bf63ff1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:42.607759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bd54c-2442-46a4-9fc6-3f5bf63ff1e8 admin admin] PATH_INFO: `/v3/projects/acd09a63551e4fedaa8d60b8e2190a56` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:42.609976 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699bd54c-2442-46a4-9fc6-3f5bf63ff1e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acd09a63551e4fedaa8d60b8e2190a56)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:42.611429 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699bd54c-2442-46a4-9fc6-3f5bf63ff1e8 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:42.634558 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e586b3-8b67-4696-a1b3-c9f08e05498f admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:42.636325 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-12e586b3-8b67-4696-a1b3-c9f08e05498f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:42.655134 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e586b3-8b67-4696-a1b3-c9f08e05498f admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:42.660718 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315f90e-4e3f-4f7c-92fa-61bfad1fbc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:42.661841 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315f90e-4e3f-4f7c-92fa-61bfad1fbc6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:42.662274 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315f90e-4e3f-4f7c-92fa-61bfad1fbc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:42.662617 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315f90e-4e3f-4f7c-92fa-61bfad1fbc6b admin admin] PATH_INFO: `/v3/projects/d71c895fde074698b9717d2a770ef5bf` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:42.664224 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7315f90e-4e3f-4f7c-92fa-61bfad1fbc6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d71c895fde074698b9717d2a770ef5bf)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:42.667201 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7315f90e-4e3f-4f7c-92fa-61bfad1fbc6b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:42.681423 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-699bd54c-2442-46a4-9fc6-3f5bf63ff1e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acd09a63551e4fedaa8d60b8e2190a56', 'request_id': 'req-699bd54c-2442-46a4-9fc6-3f5bf63ff1e8'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:42.688947 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-699bd54c-2442-46a4-9fc6-3f5bf63ff1e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acd09a63551e4fedaa8d60b8e2190a56', 'request_id': 'req-699bd54c-2442-46a4-9fc6-3f5bf63ff1e8'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:42.699261 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-699bd54c-2442-46a4-9fc6-3f5bf63ff1e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acd09a63551e4fedaa8d60b8e2190a56', 'request_id': 'req-699bd54c-2442-46a4-9fc6-3f5bf63ff1e8'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:42.715086 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-699bd54c-2442-46a4-9fc6-3f5bf63ff1e8 admin admin] The token cache is being invalidate because project acd09a63551e4fedaa8d60b8e2190a56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:01:42.715507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-699bd54c-2442-46a4-9fc6-3f5bf63ff1e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:42.716308 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-699bd54c-2442-46a4-9fc6-3f5bf63ff1e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:42.718509 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1318/2612] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:01:42 2022] DELETE /identity/v3/projects/acd09a63551e4fedaa8d60b8e2190a56 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:42.722444 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bd54c-2442-46a4-9fc6-3f5bf63ff1e8 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:42.723776 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-699bd54c-2442-46a4-9fc6-3f5bf63ff1e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:42.731571 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7315f90e-4e3f-4f7c-92fa-61bfad1fbc6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd71c895fde074698b9717d2a770ef5bf', 'request_id': 'req-7315f90e-4e3f-4f7c-92fa-61bfad1fbc6b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:42.745854 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7315f90e-4e3f-4f7c-92fa-61bfad1fbc6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd71c895fde074698b9717d2a770ef5bf', 'request_id': 'req-7315f90e-4e3f-4f7c-92fa-61bfad1fbc6b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:42.760655 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7315f90e-4e3f-4f7c-92fa-61bfad1fbc6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd71c895fde074698b9717d2a770ef5bf', 'request_id': 'req-7315f90e-4e3f-4f7c-92fa-61bfad1fbc6b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:42.777084 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:42.780141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7315f90e-4e3f-4f7c-92fa-61bfad1fbc6b admin admin] The token cache is being invalidate because project d71c895fde074698b9717d2a770ef5bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:01:42.780434 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7315f90e-4e3f-4f7c-92fa-61bfad1fbc6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:42.781183 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7315f90e-4e3f-4f7c-92fa-61bfad1fbc6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:42.783407 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1295/2613] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:01:42 2022] DELETE /identity/v3/projects/d71c895fde074698b9717d2a770ef5bf => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:42.790168 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14261f18-161c-4a61-bbba-dc2c535ae7b6 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:42.790696 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14261f18-161c-4a61-bbba-dc2c535ae7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:42.791488 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14261f18-161c-4a61-bbba-dc2c535ae7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:42.795886 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:42.825271 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-14261f18-161c-4a61-bbba-dc2c535ae7b6 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:42.826547 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-14261f18-161c-4a61-bbba-dc2c535ae7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:42.828581 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bd54c-2442-46a4-9fc6-3f5bf63ff1e8 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:42.897157 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f13ca-bdb4-4917-a4e0-7af49764a69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:42.898095 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f13ca-bdb4-4917-a4e0-7af49764a69b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:42.898347 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f13ca-bdb4-4917-a4e0-7af49764a69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:42.898618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1296/2614] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:42.898728 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f13ca-bdb4-4917-a4e0-7af49764a69b admin admin] PATH_INFO: `/v3/users/a313a0fb32a44d808671514ca5a9b43c` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:42.901443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f13ca-bdb4-4917-a4e0-7af49764a69b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a313a0fb32a44d808671514ca5a9b43c)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:42.903414 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f13ca-bdb4-4917-a4e0-7af49764a69b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:42.908615 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779fb0d-c82f-43a1-b4f7-ce7f5c00a100 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:42.908979 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779fb0d-c82f-43a1-b4f7-ce7f5c00a100 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:42.909270 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779fb0d-c82f-43a1-b4f7-ce7f5c00a100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:42.931258 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-5779fb0d-c82f-43a1-b4f7-ce7f5c00a100 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:42.932475 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5779fb0d-c82f-43a1-b4f7-ce7f5c00a100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:42.941672 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1297/2615] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:42.946990 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779fb0d-c82f-43a1-b4f7-ce7f5c00a100 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:42.956061 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779fb0d-c82f-43a1-b4f7-ce7f5c00a100 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:42.957730 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-9d9f13ca-bdb4-4917-a4e0-7af49764a69b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a313a0fb32a44d808671514ca5a9b43c'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:42.961013 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8cb0b-2f47-44d6-8668-9ad99780a5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:42.962329 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8cb0b-2f47-44d6-8668-9ad99780a5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:42.962643 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8cb0b-2f47-44d6-8668-9ad99780a5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:42.963035 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8cb0b-2f47-44d6-8668-9ad99780a5c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:42.964022 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8cb0b-2f47-44d6-8668-9ad99780a5c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 06:01:42.964321 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8cb0b-2f47-44d6-8668-9ad99780a5c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:42.965789 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-9d9f13ca-bdb4-4917-a4e0-7af49764a69b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a313a0fb32a44d808671514ca5a9b43c'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:42.965938 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8cb0b-2f47-44d6-8668-9ad99780a5c0 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:42.966582 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-9d9f13ca-bdb4-4917-a4e0-7af49764a69b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a313a0fb32a44d808671514ca5a9b43c'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:42.974547 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-9d9f13ca-bdb4-4917-a4e0-7af49764a69b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a313a0fb32a44d808671514ca5a9b43c'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:42.981757 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1298/2616] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 06:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 06:01:42.983017 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8cb0b-2f47-44d6-8668-9ad99780a5c0 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:42.988331 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-9d9f13ca-bdb4-4917-a4e0-7af49764a69b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a313a0fb32a44d808671514ca5a9b43c'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:42.993393 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8cb0b-2f47-44d6-8668-9ad99780a5c0 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:42.995620 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1319/2617] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:01:42 2022] DELETE /identity/v3/users/a313a0fb32a44d808671514ca5a9b43c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:43.060763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2b6fe-1db9-4977-9deb-8db64cbf92ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:43.061670 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2b6fe-1db9-4977-9deb-8db64cbf92ca admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:43.062236 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2b6fe-1db9-4977-9deb-8db64cbf92ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:43.062627 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2b6fe-1db9-4977-9deb-8db64cbf92ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:43.063479 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2b6fe-1db9-4977-9deb-8db64cbf92ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:43.065547 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2b6fe-1db9-4977-9deb-8db64cbf92ca admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:43.102688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1299/2618] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:01:42 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:43.107604 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f13ca-bdb4-4917-a4e0-7af49764a69b admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:43.107604 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9d9f13ca-bdb4-4917-a4e0-7af49764a69b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:43.123651 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f13ca-bdb4-4917-a4e0-7af49764a69b admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:43.191473 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ce663-6217-4f57-86ee-e34c7a3a5ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:43.192171 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ce663-6217-4f57-86ee-e34c7a3a5ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:43.192452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ce663-6217-4f57-86ee-e34c7a3a5ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:43.192733 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ce663-6217-4f57-86ee-e34c7a3a5ca9 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:43.193428 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ce663-6217-4f57-86ee-e34c7a3a5ca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:43.195393 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ce663-6217-4f57-86ee-e34c7a3a5ca9 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:43.215923 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:43.225364 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1320/2619] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:01:43 2022] POST /identity/v3/users => generated 284 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:43.226241 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2b6fe-1db9-4977-9deb-8db64cbf92ca admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:43.239267 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2b6fe-1db9-4977-9deb-8db64cbf92ca admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:43.244778 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e195f58-70fc-4ee8-a3f1-17fc88a73c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:43.245828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e195f58-70fc-4ee8-a3f1-17fc88a73c56 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:43.246356 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e195f58-70fc-4ee8-a3f1-17fc88a73c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:43.246757 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e195f58-70fc-4ee8-a3f1-17fc88a73c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:43.247533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e195f58-70fc-4ee8-a3f1-17fc88a73c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:43.249735 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e195f58-70fc-4ee8-a3f1-17fc88a73c56 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:43.263482 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1300/2620] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 06:01:43.267608 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ce663-6217-4f57-86ee-e34c7a3a5ca9 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:43.280433 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ce663-6217-4f57-86ee-e34c7a3a5ca9 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:43.285306 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5dd4e3-6a7d-4068-9927-b3e5aa34c03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:43.286041 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dd4e3-6a7d-4068-9927-b3e5aa34c03e admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:43.286325 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dd4e3-6a7d-4068-9927-b3e5aa34c03e admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:43.286598 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dd4e3-6a7d-4068-9927-b3e5aa34c03e admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:43.287325 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5dd4e3-6a7d-4068-9927-b3e5aa34c03e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:43.288913 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5dd4e3-6a7d-4068-9927-b3e5aa34c03e admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:43.305786 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1321/2621] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 06:01:43.314377 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e195f58-70fc-4ee8-a3f1-17fc88a73c56 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:43.315417 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5dd4e3-6a7d-4068-9927-b3e5aa34c03e admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:43.317960 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-cb5dd4e3-6a7d-4068-9927-b3e5aa34c03e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:43.327538 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e195f58-70fc-4ee8-a3f1-17fc88a73c56 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:43.339613 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9da0e-a14a-4cbd-bf2d-64bfcb1327a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:43.340873 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9da0e-a14a-4cbd-bf2d-64bfcb1327a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:43.341330 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9da0e-a14a-4cbd-bf2d-64bfcb1327a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:43.341999 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9da0e-a14a-4cbd-bf2d-64bfcb1327a7 admin admin] PATH_INFO: `/v3/projects/08d817d88a64428c8e07f73581d4343e/users/9b9b46ce31b64559a2229b4d6b028150/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:43.342718 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5dd4e3-6a7d-4068-9927-b3e5aa34c03e admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:43.351110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b1448-1db8-4e10-83ea-8f4437062fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:43.353142 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b1448-1db8-4e10-83ea-8f4437062fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:43.353979 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b1448-1db8-4e10-83ea-8f4437062fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:43.354397 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b1448-1db8-4e10-83ea-8f4437062fb3 admin admin] PATH_INFO: `/v3/projects/b8ced928b778484c8c8e2f391f7f85eb` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:43.356568 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b1448-1db8-4e10-83ea-8f4437062fb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8ced928b778484c8c8e2f391f7f85eb)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:43.358130 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b1448-1db8-4e10-83ea-8f4437062fb3 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:43.361500 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c9da0e-a14a-4cbd-bf2d-64bfcb1327a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08d817d88a64428c8e07f73581d4343e, user_id=9b9b46ce31b64559a2229b4d6b028150, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:43.364564 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c9da0e-a14a-4cbd-bf2d-64bfcb1327a7 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:43.381602 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1301/2622] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:43 2022] PUT /identity/v3/projects/08d817d88a64428c8e07f73581d4343e/users/9b9b46ce31b64559a2229b4d6b028150/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:43.392073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f114f1-cc88-4c10-8f2f-174d9e9e198e None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:43.392366 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f114f1-cc88-4c10-8f2f-174d9e9e198e None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:43.392647 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f114f1-cc88-4c10-8f2f-174d9e9e198e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:43.426818 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-08f114f1-cc88-4c10-8f2f-174d9e9e198e None None] MFA Rules not processed for user `9b9b46ce31b64559a2229b4d6b028150`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:43.427859 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c92b1448-1db8-4e10-83ea-8f4437062fb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8ced928b778484c8c8e2f391f7f85eb', 'request_id': 'req-c92b1448-1db8-4e10-83ea-8f4437062fb3'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:43.428764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-08f114f1-cc88-4c10-8f2f-174d9e9e198e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:43.437850 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c92b1448-1db8-4e10-83ea-8f4437062fb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8ced928b778484c8c8e2f391f7f85eb', 'request_id': 'req-c92b1448-1db8-4e10-83ea-8f4437062fb3'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:43.450800 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:43.452662 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c92b1448-1db8-4e10-83ea-8f4437062fb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8ced928b778484c8c8e2f391f7f85eb', 'request_id': 'req-c92b1448-1db8-4e10-83ea-8f4437062fb3'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:43.474187 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c92b1448-1db8-4e10-83ea-8f4437062fb3 admin admin] The token cache is being invalidate because project b8ced928b778484c8c8e2f391f7f85eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:01:43.474658 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c92b1448-1db8-4e10-83ea-8f4437062fb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:43.475485 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c92b1448-1db8-4e10-83ea-8f4437062fb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:43.477685 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1322/2623] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:01:43 2022] DELETE /identity/v3/projects/b8ced928b778484c8c8e2f391f7f85eb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:43.483833 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00adff-d1a4-4a10-a754-16a8711ebc38 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:43.484202 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00adff-d1a4-4a10-a754-16a8711ebc38 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:43.484525 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00adff-d1a4-4a10-a754-16a8711ebc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:43.505279 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-0b00adff-d1a4-4a10-a754-16a8711ebc38 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:43.506520 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0b00adff-d1a4-4a10-a754-16a8711ebc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:43.509613 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1302/2624] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:43 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:01:43.521764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f114f1-cc88-4c10-8f2f-174d9e9e198e None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:43.523348 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-08f114f1-cc88-4c10-8f2f-174d9e9e198e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:43.571499 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1323/2625] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:01:43.581328 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56674f4e-82df-4864-8ff1-d0488d4df6df None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:43.581619 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56674f4e-82df-4864-8ff1-d0488d4df6df None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:43.581902 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56674f4e-82df-4864-8ff1-d0488d4df6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:43.593559 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f114f1-cc88-4c10-8f2f-174d9e9e198e None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:43.597957 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606df8e-f9ab-4fca-8577-2f09c713e722 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:43.598779 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606df8e-f9ab-4fca-8577-2f09c713e722 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:43.599058 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606df8e-f9ab-4fca-8577-2f09c713e722 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:43.599335 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606df8e-f9ab-4fca-8577-2f09c713e722 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:43.600778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-56674f4e-82df-4864-8ff1-d0488d4df6df None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:43.602068 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-56674f4e-82df-4864-8ff1-d0488d4df6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:43.609475 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606df8e-f9ab-4fca-8577-2f09c713e722 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:43.610950 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606df8e-f9ab-4fca-8577-2f09c713e722 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:43.612326 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1324/2626] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:01:43.616685 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56674f4e-82df-4864-8ff1-d0488d4df6df None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:43.624135 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1303/2627] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:43 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:01:43.626805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56674f4e-82df-4864-8ff1-d0488d4df6df None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:43.631885 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d05bb-60aa-4eb2-b428-b121f82e40de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:43.632564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d05bb-60aa-4eb2-b428-b121f82e40de admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:43.632851 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d05bb-60aa-4eb2-b428-b121f82e40de admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:43.633131 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d05bb-60aa-4eb2-b428-b121f82e40de admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:43.634408 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d05bb-60aa-4eb2-b428-b121f82e40de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 06:01:43.634720 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d05bb-60aa-4eb2-b428-b121f82e40de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:43.636344 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d05bb-60aa-4eb2-b428-b121f82e40de admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:43.655355 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1325/2628] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 06:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 06:01:43.656587 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606df8e-f9ab-4fca-8577-2f09c713e722 service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:43.669534 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606df8e-f9ab-4fca-8577-2f09c713e722 service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:43.674270 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316c8b3-f708-4163-99da-45330468db6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:43.674997 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316c8b3-f708-4163-99da-45330468db6a admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:43.675408 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316c8b3-f708-4163-99da-45330468db6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:43.675699 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316c8b3-f708-4163-99da-45330468db6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:43.676463 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316c8b3-f708-4163-99da-45330468db6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:43.678486 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316c8b3-f708-4163-99da-45330468db6a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:43.711250 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1304/2629] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:01:43 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:43.716742 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d05bb-60aa-4eb2-b428-b121f82e40de admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:43.727612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d05bb-60aa-4eb2-b428-b121f82e40de admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:43.784380 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:43.797607 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd54a7-0716-42de-b0a9-94bbf3b85b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:43.798532 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd54a7-0716-42de-b0a9-94bbf3b85b74 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:43.798998 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd54a7-0716-42de-b0a9-94bbf3b85b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:43.799526 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd54a7-0716-42de-b0a9-94bbf3b85b74 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:43.800386 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd54a7-0716-42de-b0a9-94bbf3b85b74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:43.802532 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd54a7-0716-42de-b0a9-94bbf3b85b74 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:43.830061 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1326/2630] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:01:43 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:43.832549 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316c8b3-f708-4163-99da-45330468db6a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:43.854650 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316c8b3-f708-4163-99da-45330468db6a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:43.860442 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efb292-31ae-46de-8a33-2be554f1ac3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:43.861142 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efb292-31ae-46de-8a33-2be554f1ac3a admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:43.861464 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efb292-31ae-46de-8a33-2be554f1ac3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:43.861718 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efb292-31ae-46de-8a33-2be554f1ac3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:43.862672 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7efb292-31ae-46de-8a33-2be554f1ac3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:43.864612 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7efb292-31ae-46de-8a33-2be554f1ac3a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:43.877838 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1305/2631] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:43.882109 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd54a7-0716-42de-b0a9-94bbf3b85b74 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:43.900507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd54a7-0716-42de-b0a9-94bbf3b85b74 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:43.906804 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82252444-0cb2-477f-8164-65695bb43fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:43.907682 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82252444-0cb2-477f-8164-65695bb43fec admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:43.908131 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82252444-0cb2-477f-8164-65695bb43fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:43.908424 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82252444-0cb2-477f-8164-65695bb43fec admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:43.909145 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82252444-0cb2-477f-8164-65695bb43fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:43.910784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82252444-0cb2-477f-8164-65695bb43fec admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:43.922425 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1327/2632] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:43.927985 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efb292-31ae-46de-8a33-2be554f1ac3a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:43.943886 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efb292-31ae-46de-8a33-2be554f1ac3a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:43.956978 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5b574-deb2-4d13-9b40-9f96824e30ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:43.956978 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5b574-deb2-4d13-9b40-9f96824e30ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:43.956978 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5b574-deb2-4d13-9b40-9f96824e30ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:43.956978 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5b574-deb2-4d13-9b40-9f96824e30ea admin admin] PATH_INFO: `/v3/projects/b8d1e81c7f9e4f58b0eead19a3bae6b1/users/43719cef31b84bd0bd7e229176fce212/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:43.970185 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5b574-deb2-4d13-9b40-9f96824e30ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8d1e81c7f9e4f58b0eead19a3bae6b1, user_id=43719cef31b84bd0bd7e229176fce212, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:43.973506 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5b574-deb2-4d13-9b40-9f96824e30ea admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:43.989362 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1306/2633] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:43 2022] PUT /identity/v3/projects/b8d1e81c7f9e4f58b0eead19a3bae6b1/users/43719cef31b84bd0bd7e229176fce212/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:44.002655 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20947c4f-3c65-41c3-9c72-f5151190442d None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:44.002954 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20947c4f-3c65-41c3-9c72-f5151190442d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:44.003238 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20947c4f-3c65-41c3-9c72-f5151190442d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:44.033821 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-20947c4f-3c65-41c3-9c72-f5151190442d None None] MFA Rules not processed for user `43719cef31b84bd0bd7e229176fce212`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:44.035207 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-20947c4f-3c65-41c3-9c72-f5151190442d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:44.112044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1328/2634] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:44.114920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5b574-deb2-4d13-9b40-9f96824e30ea admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:44.187703 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5b574-deb2-4d13-9b40-9f96824e30ea admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:44.192716 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73cf04-a72c-40a0-9a2a-7c18cf46bf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:44.193365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73cf04-a72c-40a0-9a2a-7c18cf46bf2d admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:44.193649 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73cf04-a72c-40a0-9a2a-7c18cf46bf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:44.193927 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73cf04-a72c-40a0-9a2a-7c18cf46bf2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:44.194652 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73cf04-a72c-40a0-9a2a-7c18cf46bf2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:44.196603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73cf04-a72c-40a0-9a2a-7c18cf46bf2d admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:44.206640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:44.222685 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1307/2635] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:01:44 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 06:01:44.226855 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20947c4f-3c65-41c3-9c72-f5151190442d None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:44.237886 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20947c4f-3c65-41c3-9c72-f5151190442d None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:44.292722 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe4764-be47-471d-bdc5-1db3aa0b76e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:44.293387 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe4764-be47-471d-bdc5-1db3aa0b76e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:44.293672 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe4764-be47-471d-bdc5-1db3aa0b76e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:44.293970 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe4764-be47-471d-bdc5-1db3aa0b76e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:44.294677 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe4764-be47-471d-bdc5-1db3aa0b76e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:44.296579 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe4764-be47-471d-bdc5-1db3aa0b76e3 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:44.324351 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1329/2636] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:01:44 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:44.328861 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73cf04-a72c-40a0-9a2a-7c18cf46bf2d admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:44.339316 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73cf04-a72c-40a0-9a2a-7c18cf46bf2d admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:44.343878 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df1ad0-6876-4eff-b339-d648d63b5d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:44.344526 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df1ad0-6876-4eff-b339-d648d63b5d3a admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:44.344807 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df1ad0-6876-4eff-b339-d648d63b5d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:44.345081 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df1ad0-6876-4eff-b339-d648d63b5d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:44.345861 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df1ad0-6876-4eff-b339-d648d63b5d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:44.347477 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df1ad0-6876-4eff-b339-d648d63b5d3a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:44.358337 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1308/2637] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:44.362406 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe4764-be47-471d-bdc5-1db3aa0b76e3 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:44.373116 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe4764-be47-471d-bdc5-1db3aa0b76e3 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:44.377690 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56378f48-0091-436d-b275-5532a42613be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:44.378595 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56378f48-0091-436d-b275-5532a42613be admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:44.378882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56378f48-0091-436d-b275-5532a42613be admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:44.379188 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56378f48-0091-436d-b275-5532a42613be admin admin] PATH_INFO: `/v3/projects/b78e0bee1ce54dba8f327efb78b54f09/users/12afc1cb2e704a9ab80d37d99f3062a4/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:44.393658 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56378f48-0091-436d-b275-5532a42613be admin admin] RBAC: Authorizing `identity:create_grant(project_id=b78e0bee1ce54dba8f327efb78b54f09, user_id=12afc1cb2e704a9ab80d37d99f3062a4, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:44.396326 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56378f48-0091-436d-b275-5532a42613be admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:44.409527 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1330/2638] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:44 2022] PUT /identity/v3/projects/b78e0bee1ce54dba8f327efb78b54f09/users/12afc1cb2e704a9ab80d37d99f3062a4/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:44.413566 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df1ad0-6876-4eff-b339-d648d63b5d3a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:44.424307 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df1ad0-6876-4eff-b339-d648d63b5d3a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:44.479827 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d773b63-b1c8-452f-9a47-d346804c993f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:44.480407 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d773b63-b1c8-452f-9a47-d346804c993f admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:44.480685 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d773b63-b1c8-452f-9a47-d346804c993f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:44.480961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d773b63-b1c8-452f-9a47-d346804c993f admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:44.481758 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d773b63-b1c8-452f-9a47-d346804c993f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:44.483382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d773b63-b1c8-452f-9a47-d346804c993f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:44.497606 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1309/2639] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 06:01:44.498930 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56378f48-0091-436d-b275-5532a42613be admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:44.509082 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56378f48-0091-436d-b275-5532a42613be admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:44.514480 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0193b5-61f8-4826-acfa-ef7667a249cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:44.514846 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0193b5-61f8-4826-acfa-ef7667a249cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:44.515124 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0193b5-61f8-4826-acfa-ef7667a249cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:44.515401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0193b5-61f8-4826-acfa-ef7667a249cb admin admin] PATH_INFO: `/v3/projects/b78e0bee1ce54dba8f327efb78b54f09/users/12afc1cb2e704a9ab80d37d99f3062a4/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:44.517395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0193b5-61f8-4826-acfa-ef7667a249cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b78e0bee1ce54dba8f327efb78b54f09, user_id=12afc1cb2e704a9ab80d37d99f3062a4, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:44.520084 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0193b5-61f8-4826-acfa-ef7667a249cb admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:44.531945 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1331/2640] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:44 2022] PUT /identity/v3/projects/b78e0bee1ce54dba8f327efb78b54f09/users/12afc1cb2e704a9ab80d37d99f3062a4/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:44.542772 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bb793-caa4-4b86-9a5c-fd9c97078a43 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:44.543068 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bb793-caa4-4b86-9a5c-fd9c97078a43 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:44.543360 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bb793-caa4-4b86-9a5c-fd9c97078a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:44.570420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-579bb793-caa4-4b86-9a5c-fd9c97078a43 None None] MFA Rules not processed for user `12afc1cb2e704a9ab80d37d99f3062a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:44.571652 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-579bb793-caa4-4b86-9a5c-fd9c97078a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:44.646663 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1310/2641] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:44.657767 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0193b5-61f8-4826-acfa-ef7667a249cb admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:44.659457 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-da0193b5-61f8-4826-acfa-ef7667a249cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:44.678296 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:44.735547 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0193b5-61f8-4826-acfa-ef7667a249cb admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:44.739203 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518cae5f-2af1-4236-94a5-08d6723f25f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:44.739866 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cae5f-2af1-4236-94a5-08d6723f25f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:44.740129 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cae5f-2af1-4236-94a5-08d6723f25f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:44.740409 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cae5f-2af1-4236-94a5-08d6723f25f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:44.802218 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518cae5f-2af1-4236-94a5-08d6723f25f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:44.803647 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518cae5f-2af1-4236-94a5-08d6723f25f7 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:44.813677 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1332/2642] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:01:51.431269 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579bb793-caa4-4b86-9a5c-fd9c97078a43 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:51.441170 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579bb793-caa4-4b86-9a5c-fd9c97078a43 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:51.444714 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb7344-7cfd-45fa-818a-196f7232ff35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:51.445978 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb7344-7cfd-45fa-818a-196f7232ff35 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:51.446267 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb7344-7cfd-45fa-818a-196f7232ff35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:51.446540 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb7344-7cfd-45fa-818a-196f7232ff35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:51.456016 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb7344-7cfd-45fa-818a-196f7232ff35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:51.457496 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb7344-7cfd-45fa-818a-196f7232ff35 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:51.467774 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1311/2643] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 06:01:54.809449 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=42 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:55.171317 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518cae5f-2af1-4236-94a5-08d6723f25f7 service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:55.172753 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-518cae5f-2af1-4236-94a5-08d6723f25f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:55.250656 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518cae5f-2af1-4236-94a5-08d6723f25f7 service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:55.256431 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4430d-7494-4f53-914f-ff6cef1f8df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:55.257314 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4430d-7494-4f53-914f-ff6cef1f8df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:55.257634 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4430d-7494-4f53-914f-ff6cef1f8df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:55.257911 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4430d-7494-4f53-914f-ff6cef1f8df6 admin admin] PATH_INFO: `/v3/users/8b14b1855c634af88b9e298bb7db9f28` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:55.259177 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4430d-7494-4f53-914f-ff6cef1f8df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b14b1855c634af88b9e298bb7db9f28)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:55.261105 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4430d-7494-4f53-914f-ff6cef1f8df6 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:55.315480 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-34a4430d-7494-4f53-914f-ff6cef1f8df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b14b1855c634af88b9e298bb7db9f28'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:55.324307 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-34a4430d-7494-4f53-914f-ff6cef1f8df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b14b1855c634af88b9e298bb7db9f28'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:55.325194 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-34a4430d-7494-4f53-914f-ff6cef1f8df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b14b1855c634af88b9e298bb7db9f28'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:55.333183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-34a4430d-7494-4f53-914f-ff6cef1f8df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b14b1855c634af88b9e298bb7db9f28'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:55.351853 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-34a4430d-7494-4f53-914f-ff6cef1f8df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b14b1855c634af88b9e298bb7db9f28'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:55.358738 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1333/2644] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:01:55 2022] DELETE /identity/v3/users/8b14b1855c634af88b9e298bb7db9f28 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:55.363376 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdf9e7-f7c0-489b-9934-94feca5242c8 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:55.364034 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdf9e7-f7c0-489b-9934-94feca5242c8 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:55.364034 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdf9e7-f7c0-489b-9934-94feca5242c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:55.386326 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-cfbdf9e7-f7c0-489b-9934-94feca5242c8 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:55.387761 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-cfbdf9e7-f7c0-489b-9934-94feca5242c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:55.448315 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:55.466967 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1312/2645] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:55.476893 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4430d-7494-4f53-914f-ff6cef1f8df6 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:55.478420 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-34a4430d-7494-4f53-914f-ff6cef1f8df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:55.539351 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4430d-7494-4f53-914f-ff6cef1f8df6 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:55.542956 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd52c5-2ff5-4312-b605-23d71e4b568d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:55.543610 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd52c5-2ff5-4312-b605-23d71e4b568d service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:55.543896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd52c5-2ff5-4312-b605-23d71e4b568d service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:55.544174 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd52c5-2ff5-4312-b605-23d71e4b568d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:55.553694 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd52c5-2ff5-4312-b605-23d71e4b568d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:55.555227 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd52c5-2ff5-4312-b605-23d71e4b568d service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:55.565269 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1334/2646] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:01:55.852505 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdf9e7-f7c0-489b-9934-94feca5242c8 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:55.854082 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-cfbdf9e7-f7c0-489b-9934-94feca5242c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:55.866632 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdf9e7-f7c0-489b-9934-94feca5242c8 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:55.871885 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e04861-d25d-4fe7-b571-b4e5421984d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:55.872747 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e04861-d25d-4fe7-b571-b4e5421984d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:55.873024 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e04861-d25d-4fe7-b571-b4e5421984d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:55.873327 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e04861-d25d-4fe7-b571-b4e5421984d5 admin admin] PATH_INFO: `/v3/projects/747e93adea9c49a8b706803451ebee05` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:55.874531 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e04861-d25d-4fe7-b571-b4e5421984d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=747e93adea9c49a8b706803451ebee05)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:55.876456 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e04861-d25d-4fe7-b571-b4e5421984d5 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:55.926036 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-29e04861-d25d-4fe7-b571-b4e5421984d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '747e93adea9c49a8b706803451ebee05', 'request_id': 'req-29e04861-d25d-4fe7-b571-b4e5421984d5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:55.934393 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-29e04861-d25d-4fe7-b571-b4e5421984d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '747e93adea9c49a8b706803451ebee05', 'request_id': 'req-29e04861-d25d-4fe7-b571-b4e5421984d5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:55.943035 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-29e04861-d25d-4fe7-b571-b4e5421984d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '747e93adea9c49a8b706803451ebee05', 'request_id': 'req-29e04861-d25d-4fe7-b571-b4e5421984d5'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:55.954282 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-29e04861-d25d-4fe7-b571-b4e5421984d5 admin admin] The token cache is being invalidate because project 747e93adea9c49a8b706803451ebee05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:01:55.954576 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-29e04861-d25d-4fe7-b571-b4e5421984d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:55.955234 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-29e04861-d25d-4fe7-b571-b4e5421984d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:55.956805 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1313/2647] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:01:55 2022] DELETE /identity/v3/projects/747e93adea9c49a8b706803451ebee05 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:55.960935 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd52c5-2ff5-4312-b605-23d71e4b568d service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:55.970743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd52c5-2ff5-4312-b605-23d71e4b568d service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:55.988760 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:56.030150 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a3c3a-6bcc-425f-a532-1abb9f784080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:56.031014 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a3c3a-6bcc-425f-a532-1abb9f784080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:56.031297 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a3c3a-6bcc-425f-a532-1abb9f784080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:56.031570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a3c3a-6bcc-425f-a532-1abb9f784080 admin admin] PATH_INFO: `/v3/users/9b1d3d9b2ad044a1a66606a58a8c9684` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:56.032743 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a3c3a-6bcc-425f-a532-1abb9f784080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b1d3d9b2ad044a1a66606a58a8c9684)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:56.034689 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a3c3a-6bcc-425f-a532-1abb9f784080 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:56.081521 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-df1a3c3a-6bcc-425f-a532-1abb9f784080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b1d3d9b2ad044a1a66606a58a8c9684'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:56.088646 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-df1a3c3a-6bcc-425f-a532-1abb9f784080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b1d3d9b2ad044a1a66606a58a8c9684'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:56.090118 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-df1a3c3a-6bcc-425f-a532-1abb9f784080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b1d3d9b2ad044a1a66606a58a8c9684'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:56.098281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-df1a3c3a-6bcc-425f-a532-1abb9f784080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b1d3d9b2ad044a1a66606a58a8c9684'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:56.111090 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-df1a3c3a-6bcc-425f-a532-1abb9f784080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b1d3d9b2ad044a1a66606a58a8c9684'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:56.117721 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1335/2648] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:01:55 2022] DELETE /identity/v3/users/9b1d3d9b2ad044a1a66606a58a8c9684 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:56.394321 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e04861-d25d-4fe7-b571-b4e5421984d5 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:56.395773 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-29e04861-d25d-4fe7-b571-b4e5421984d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:56.409678 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e04861-d25d-4fe7-b571-b4e5421984d5 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:56.458789 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a3c3a-6bcc-425f-a532-1abb9f784080 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:56.460488 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-df1a3c3a-6bcc-425f-a532-1abb9f784080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:56.472883 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51e5eb-3ed4-4945-bb49-83d131e7330e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:56.473753 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51e5eb-3ed4-4945-bb49-83d131e7330e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:56.474073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51e5eb-3ed4-4945-bb49-83d131e7330e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:56.474348 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51e5eb-3ed4-4945-bb49-83d131e7330e admin admin] PATH_INFO: `/v3/projects/177f243ac12c41b79784bfe52704d416` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:56.475765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51e5eb-3ed4-4945-bb49-83d131e7330e admin admin] RBAC: Authorizing `identity:delete_project(project_id=177f243ac12c41b79784bfe52704d416)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:56.478248 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51e5eb-3ed4-4945-bb49-83d131e7330e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:56.540746 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-9c51e5eb-3ed4-4945-bb49-83d131e7330e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '177f243ac12c41b79784bfe52704d416', 'request_id': 'req-9c51e5eb-3ed4-4945-bb49-83d131e7330e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:56.553786 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-9c51e5eb-3ed4-4945-bb49-83d131e7330e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '177f243ac12c41b79784bfe52704d416', 'request_id': 'req-9c51e5eb-3ed4-4945-bb49-83d131e7330e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:56.559030 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a3c3a-6bcc-425f-a532-1abb9f784080 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:56.571418 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-9c51e5eb-3ed4-4945-bb49-83d131e7330e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '177f243ac12c41b79784bfe52704d416', 'request_id': 'req-9c51e5eb-3ed4-4945-bb49-83d131e7330e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:56.584358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-9c51e5eb-3ed4-4945-bb49-83d131e7330e admin admin] The token cache is being invalidate because project 177f243ac12c41b79784bfe52704d416 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:01:56.584732 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-9c51e5eb-3ed4-4945-bb49-83d131e7330e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:56.586540 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-9c51e5eb-3ed4-4945-bb49-83d131e7330e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:56.588641 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1314/2649] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:01:56 2022] DELETE /identity/v3/projects/177f243ac12c41b79784bfe52704d416 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:56.594798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ec306-503e-463b-b545-d018cdb56784 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:56.595208 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ec306-503e-463b-b545-d018cdb56784 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:56.595628 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ec306-503e-463b-b545-d018cdb56784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:56.603096 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:56.617799 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-910ec306-503e-463b-b545-d018cdb56784 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:56.619063 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-910ec306-503e-463b-b545-d018cdb56784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:56.621741 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:56.635882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7cd6cb-8622-42b7-9231-f986e216ef13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:56.636799 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cd6cb-8622-42b7-9231-f986e216ef13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:56.637088 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cd6cb-8622-42b7-9231-f986e216ef13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:56.637368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cd6cb-8622-42b7-9231-f986e216ef13 admin admin] PATH_INFO: `/v3/users/9b9b46ce31b64559a2229b4d6b028150` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:56.639063 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7cd6cb-8622-42b7-9231-f986e216ef13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b9b46ce31b64559a2229b4d6b028150)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:56.641099 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7cd6cb-8622-42b7-9231-f986e216ef13 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:56.683464 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1315/2650] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:01:56.690655 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-7f7cd6cb-8622-42b7-9231-f986e216ef13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b9b46ce31b64559a2229b4d6b028150'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:56.691450 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb2caf-ed56-47d5-8c6e-b79c32700fdf None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:56.691756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb2caf-ed56-47d5-8c6e-b79c32700fdf None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:56.692044 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb2caf-ed56-47d5-8c6e-b79c32700fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:56.700115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-7f7cd6cb-8622-42b7-9231-f986e216ef13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b9b46ce31b64559a2229b4d6b028150'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:56.700942 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-7f7cd6cb-8622-42b7-9231-f986e216ef13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b9b46ce31b64559a2229b4d6b028150'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:56.709225 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-7f7cd6cb-8622-42b7-9231-f986e216ef13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b9b46ce31b64559a2229b4d6b028150'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:56.711697 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-00cb2caf-ed56-47d5-8c6e-b79c32700fdf None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:56.713567 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-00cb2caf-ed56-47d5-8c6e-b79c32700fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:56.722365 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1316/2651] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:01:56.725444 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-7f7cd6cb-8622-42b7-9231-f986e216ef13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b9b46ce31b64559a2229b4d6b028150'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:56.727276 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb2caf-ed56-47d5-8c6e-b79c32700fdf None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:56.732243 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1336/2652] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:01:56 2022] DELETE /identity/v3/users/9b9b46ce31b64559a2229b4d6b028150 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:56.736640 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01c3eb-4c79-47c1-b4ec-918b3da1e274 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:56.736935 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01c3eb-4c79-47c1-b4ec-918b3da1e274 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:56.737222 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01c3eb-4c79-47c1-b4ec-918b3da1e274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:56.738291 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb2caf-ed56-47d5-8c6e-b79c32700fdf None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:56.754877 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-6b01c3eb-4c79-47c1-b4ec-918b3da1e274 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:56.756089 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6b01c3eb-4c79-47c1-b4ec-918b3da1e274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:56.796916 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75215ec2-1916-4bd6-8b6e-a9a6a0d274a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:56.797577 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75215ec2-1916-4bd6-8b6e-a9a6a0d274a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:56.797859 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75215ec2-1916-4bd6-8b6e-a9a6a0d274a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:56.798166 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75215ec2-1916-4bd6-8b6e-a9a6a0d274a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:56.798884 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75215ec2-1916-4bd6-8b6e-a9a6a0d274a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 06:01:56.799239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75215ec2-1916-4bd6-8b6e-a9a6a0d274a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:56.800805 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75215ec2-1916-4bd6-8b6e-a9a6a0d274a4 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:56.816050 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1317/2653] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 06:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 06:01:56.817277 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75215ec2-1916-4bd6-8b6e-a9a6a0d274a4 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:56.819067 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-75215ec2-1916-4bd6-8b6e-a9a6a0d274a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:56.820283 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1337/2654] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:01:56.830153 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01c3eb-4c79-47c1-b4ec-918b3da1e274 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:56.831581 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6b01c3eb-4c79-47c1-b4ec-918b3da1e274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:56.831707 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75215ec2-1916-4bd6-8b6e-a9a6a0d274a4 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:56.836822 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07978309-f450-4df2-8938-959e5836a242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:56.837478 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07978309-f450-4df2-8938-959e5836a242 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:56.837758 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07978309-f450-4df2-8938-959e5836a242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:56.838333 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07978309-f450-4df2-8938-959e5836a242 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:56.839002 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07978309-f450-4df2-8938-959e5836a242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:56.840901 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07978309-f450-4df2-8938-959e5836a242 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:56.871663 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1318/2655] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:01:56 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 06:01:56.872963 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07978309-f450-4df2-8938-959e5836a242 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:56.892842 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01c3eb-4c79-47c1-b4ec-918b3da1e274 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:56.915561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:56.937751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07978309-f450-4df2-8938-959e5836a242 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:56.942749 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd8ec8-1990-4add-a208-4ab26502f942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:56.943422 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd8ec8-1990-4add-a208-4ab26502f942 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:56.943715 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd8ec8-1990-4add-a208-4ab26502f942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:56.943998 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd8ec8-1990-4add-a208-4ab26502f942 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:56.944697 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd8ec8-1990-4add-a208-4ab26502f942 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:56.947380 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd8ec8-1990-4add-a208-4ab26502f942 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:56.949310 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd543d74-1c0d-4c7f-964c-8ff086359503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:56.950070 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd543d74-1c0d-4c7f-964c-8ff086359503 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:56.950364 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd543d74-1c0d-4c7f-964c-8ff086359503 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:56.950644 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd543d74-1c0d-4c7f-964c-8ff086359503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:56.960327 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd543d74-1c0d-4c7f-964c-8ff086359503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:56.962426 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd543d74-1c0d-4c7f-964c-8ff086359503 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:56.963224 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:56.973181 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1338/2656] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 06:01:56.973421 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1319/2657] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:01:56 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 06:01:56.974041 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd543d74-1c0d-4c7f-964c-8ff086359503 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:56.983410 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd543d74-1c0d-4c7f-964c-8ff086359503 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:56.988217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200edd35-03bb-4e75-afe5-a66b7ca8a869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:56.988875 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200edd35-03bb-4e75-afe5-a66b7ca8a869 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:56.989164 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200edd35-03bb-4e75-afe5-a66b7ca8a869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:56.989804 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200edd35-03bb-4e75-afe5-a66b7ca8a869 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:56.990196 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200edd35-03bb-4e75-afe5-a66b7ca8a869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:56.991777 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200edd35-03bb-4e75-afe5-a66b7ca8a869 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:57.001834 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1339/2658] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:57.005756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd8ec8-1990-4add-a208-4ab26502f942 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:57.017247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd8ec8-1990-4add-a208-4ab26502f942 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:57.022751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13025c-5e50-4482-b3d9-1bbab31580e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:57.023674 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13025c-5e50-4482-b3d9-1bbab31580e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:57.023959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13025c-5e50-4482-b3d9-1bbab31580e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:57.024324 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13025c-5e50-4482-b3d9-1bbab31580e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:57.025165 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13025c-5e50-4482-b3d9-1bbab31580e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:57.026875 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13025c-5e50-4482-b3d9-1bbab31580e1 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:57.038319 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1320/2659] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:57.042686 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200edd35-03bb-4e75-afe5-a66b7ca8a869 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:57.053803 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200edd35-03bb-4e75-afe5-a66b7ca8a869 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:57.060106 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc6aa0-2652-4fc4-820d-dbd372378100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:57.061007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc6aa0-2652-4fc4-820d-dbd372378100 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:57.061290 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc6aa0-2652-4fc4-820d-dbd372378100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:57.061566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc6aa0-2652-4fc4-820d-dbd372378100 admin admin] PATH_INFO: `/v3/projects/ad5c7c9ba0864e2e994f3f56deb55964/users/9b758c1c3eaa4b4da6889d4d360bdd3c/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:57.078450 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc6aa0-2652-4fc4-820d-dbd372378100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad5c7c9ba0864e2e994f3f56deb55964, user_id=9b758c1c3eaa4b4da6889d4d360bdd3c, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:57.081110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc6aa0-2652-4fc4-820d-dbd372378100 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:57.096091 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1340/2660] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:57 2022] PUT /identity/v3/projects/ad5c7c9ba0864e2e994f3f56deb55964/users/9b758c1c3eaa4b4da6889d4d360bdd3c/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:57.106663 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18884188-57cd-4ea0-bb58-e1ac3e2dd83f None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:57.107037 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18884188-57cd-4ea0-bb58-e1ac3e2dd83f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:57.107382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18884188-57cd-4ea0-bb58-e1ac3e2dd83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:57.139733 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-18884188-57cd-4ea0-bb58-e1ac3e2dd83f None None] MFA Rules not processed for user `9b758c1c3eaa4b4da6889d4d360bdd3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:57.141039 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-18884188-57cd-4ea0-bb58-e1ac3e2dd83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:57.209531 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1321/2661] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:01:57.214634 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc6aa0-2652-4fc4-820d-dbd372378100 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:57.251783 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18884188-57cd-4ea0-bb58-e1ac3e2dd83f None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:57.253234 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-18884188-57cd-4ea0-bb58-e1ac3e2dd83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:57.285270 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc6aa0-2652-4fc4-820d-dbd372378100 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:57.291091 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c48ed5-fdc8-41b8-a75a-46e5631629de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:57.291906 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c48ed5-fdc8-41b8-a75a-46e5631629de admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:57.292270 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c48ed5-fdc8-41b8-a75a-46e5631629de admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:57.292691 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c48ed5-fdc8-41b8-a75a-46e5631629de admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:57.293390 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c48ed5-fdc8-41b8-a75a-46e5631629de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:57.295507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c48ed5-fdc8-41b8-a75a-46e5631629de admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:57.331147 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18884188-57cd-4ea0-bb58-e1ac3e2dd83f None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:57.333983 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1341/2662] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:01:57 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:57.336147 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c48ed5-fdc8-41b8-a75a-46e5631629de admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:57.393991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae1d29-a5d6-44d2-bb55-bb4069cfdbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:57.394787 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae1d29-a5d6-44d2-bb55-bb4069cfdbfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:57.395363 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae1d29-a5d6-44d2-bb55-bb4069cfdbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:57.395363 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae1d29-a5d6-44d2-bb55-bb4069cfdbfa admin admin] PATH_INFO: `/v3/projects/08d817d88a64428c8e07f73581d4343e` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:57.396706 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae1d29-a5d6-44d2-bb55-bb4069cfdbfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=08d817d88a64428c8e07f73581d4343e)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:57.399286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae1d29-a5d6-44d2-bb55-bb4069cfdbfa admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:57.404282 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c48ed5-fdc8-41b8-a75a-46e5631629de admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:57.409123 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04b6d9-ad52-4081-a1ee-b34b58299aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:57.409806 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04b6d9-ad52-4081-a1ee-b34b58299aea admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:57.410126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04b6d9-ad52-4081-a1ee-b34b58299aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:57.410411 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04b6d9-ad52-4081-a1ee-b34b58299aea admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:57.411110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04b6d9-ad52-4081-a1ee-b34b58299aea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:57.413040 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04b6d9-ad52-4081-a1ee-b34b58299aea admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:57.435452 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:57.439884 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1342/2663] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:01:57 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 06:01:57.443500 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04b6d9-ad52-4081-a1ee-b34b58299aea admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:57.456656 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04b6d9-ad52-4081-a1ee-b34b58299aea admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:57.460056 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:57.460868 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-76ae1d29-a5d6-44d2-bb55-bb4069cfdbfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08d817d88a64428c8e07f73581d4343e', 'request_id': 'req-76ae1d29-a5d6-44d2-bb55-bb4069cfdbfa'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:57.470449 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-76ae1d29-a5d6-44d2-bb55-bb4069cfdbfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08d817d88a64428c8e07f73581d4343e', 'request_id': 'req-76ae1d29-a5d6-44d2-bb55-bb4069cfdbfa'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:57.478585 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-76ae1d29-a5d6-44d2-bb55-bb4069cfdbfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08d817d88a64428c8e07f73581d4343e', 'request_id': 'req-76ae1d29-a5d6-44d2-bb55-bb4069cfdbfa'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:57.495458 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-76ae1d29-a5d6-44d2-bb55-bb4069cfdbfa admin admin] The token cache is being invalidate because project 08d817d88a64428c8e07f73581d4343e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:01:57.496003 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-76ae1d29-a5d6-44d2-bb55-bb4069cfdbfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:57.498792 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-76ae1d29-a5d6-44d2-bb55-bb4069cfdbfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:57.503608 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1322/2664] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:01:57 2022] DELETE /identity/v3/projects/08d817d88a64428c8e07f73581d4343e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:57.503608 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae1d29-a5d6-44d2-bb55-bb4069cfdbfa admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:57.503608 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-76ae1d29-a5d6-44d2-bb55-bb4069cfdbfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:57.525501 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c858e-e904-456d-b375-881784637ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:57.526376 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c858e-e904-456d-b375-881784637ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:57.526764 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c858e-e904-456d-b375-881784637ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:57.527263 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c858e-e904-456d-b375-881784637ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:57.528077 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c858e-e904-456d-b375-881784637ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:57.529978 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c858e-e904-456d-b375-881784637ad5 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:57.543205 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1343/2665] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 06:01:57.548221 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241309b-68f7-41c3-8bcf-1fb7e7f28efd None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:57.548528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241309b-68f7-41c3-8bcf-1fb7e7f28efd None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:57.548815 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241309b-68f7-41c3-8bcf-1fb7e7f28efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:57.571646 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-e241309b-68f7-41c3-8bcf-1fb7e7f28efd None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:57.573003 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e241309b-68f7-41c3-8bcf-1fb7e7f28efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:57.592488 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1344/2666] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:57.592488 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241309b-68f7-41c3-8bcf-1fb7e7f28efd None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:57.592796 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae1d29-a5d6-44d2-bb55-bb4069cfdbfa admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:57.594086 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e241309b-68f7-41c3-8bcf-1fb7e7f28efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:57.596936 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cff94-78b0-4201-be99-34ab603b97d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:57.597829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cff94-78b0-4201-be99-34ab603b97d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:57.598097 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cff94-78b0-4201-be99-34ab603b97d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:57.598371 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cff94-78b0-4201-be99-34ab603b97d8 admin admin] PATH_INFO: `/v3/users/43719cef31b84bd0bd7e229176fce212` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:57.600598 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cff94-78b0-4201-be99-34ab603b97d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43719cef31b84bd0bd7e229176fce212)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:57.602759 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cff94-78b0-4201-be99-34ab603b97d8 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:57.608258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241309b-68f7-41c3-8bcf-1fb7e7f28efd None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:57.614840 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e1141-ab6d-43a9-8226-6bfb2470d8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:57.615877 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e1141-ab6d-43a9-8226-6bfb2470d8ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:57.616334 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e1141-ab6d-43a9-8226-6bfb2470d8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:57.616632 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e1141-ab6d-43a9-8226-6bfb2470d8ae admin admin] PATH_INFO: `/v3/projects/63604e78a78e483f96a2922ac7f36adc/users/13abc49178714815be2f6bf0bafaee24/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:57.636416 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e1141-ab6d-43a9-8226-6bfb2470d8ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=63604e78a78e483f96a2922ac7f36adc, user_id=13abc49178714815be2f6bf0bafaee24, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:57.638054 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e1141-ab6d-43a9-8226-6bfb2470d8ae admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:57.657723 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1345/2667] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:57 2022] PUT /identity/v3/projects/63604e78a78e483f96a2922ac7f36adc/users/13abc49178714815be2f6bf0bafaee24/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:57.659416 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c979bf-4b82-4a67-b9c2-6452e9addd99 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:57.659909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c979bf-4b82-4a67-b9c2-6452e9addd99 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:57.660408 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c979bf-4b82-4a67-b9c2-6452e9addd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:57.674502 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-263cff94-78b0-4201-be99-34ab603b97d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43719cef31b84bd0bd7e229176fce212'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:57.682140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-56c979bf-4b82-4a67-b9c2-6452e9addd99 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:57.683677 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-56c979bf-4b82-4a67-b9c2-6452e9addd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:57.705440 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-263cff94-78b0-4201-be99-34ab603b97d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43719cef31b84bd0bd7e229176fce212'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:57.706504 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-263cff94-78b0-4201-be99-34ab603b97d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43719cef31b84bd0bd7e229176fce212'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:57.708043 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-263cff94-78b0-4201-be99-34ab603b97d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43719cef31b84bd0bd7e229176fce212'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:57.731573 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-263cff94-78b0-4201-be99-34ab603b97d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43719cef31b84bd0bd7e229176fce212'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:57.757050 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1323/2668] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:01:57 2022] DELETE /identity/v3/users/43719cef31b84bd0bd7e229176fce212 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:57.759549 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cff94-78b0-4201-be99-34ab603b97d8 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:57.761740 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-263cff94-78b0-4201-be99-34ab603b97d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:57.771070 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1346/2669] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:57.772575 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd514f9-54cb-41e6-a4ec-d00247ca53e6 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:57.773139 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd514f9-54cb-41e6-a4ec-d00247ca53e6 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:57.773626 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd514f9-54cb-41e6-a4ec-d00247ca53e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:57.794512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-9cd514f9-54cb-41e6-a4ec-d00247ca53e6 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:57.795977 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9cd514f9-54cb-41e6-a4ec-d00247ca53e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:57.808790 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:57.855374 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cff94-78b0-4201-be99-34ab603b97d8 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:57.861691 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75064c81-813f-43db-80f3-53f98ca8ebe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:57.862557 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75064c81-813f-43db-80f3-53f98ca8ebe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:57.862825 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75064c81-813f-43db-80f3-53f98ca8ebe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:57.863096 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75064c81-813f-43db-80f3-53f98ca8ebe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:57.863865 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75064c81-813f-43db-80f3-53f98ca8ebe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:57.865643 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75064c81-813f-43db-80f3-53f98ca8ebe2 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:57.878846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1324/2670] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:57.880099 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75064c81-813f-43db-80f3-53f98ca8ebe2 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:57.892520 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75064c81-813f-43db-80f3-53f98ca8ebe2 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:57.894556 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1347/2671] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:57.895500 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd514f9-54cb-41e6-a4ec-d00247ca53e6 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:57.902140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1136fcd-4545-4dc4-97a8-9c9064ced5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:57.903458 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1136fcd-4545-4dc4-97a8-9c9064ced5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:57.903458 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1136fcd-4545-4dc4-97a8-9c9064ced5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:57.903849 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1136fcd-4545-4dc4-97a8-9c9064ced5b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:57.904607 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1136fcd-4545-4dc4-97a8-9c9064ced5b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 06:01:57.905338 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1136fcd-4545-4dc4-97a8-9c9064ced5b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:57.906646 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1136fcd-4545-4dc4-97a8-9c9064ced5b8 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:57.909087 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd514f9-54cb-41e6-a4ec-d00247ca53e6 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:57.915827 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34848e3e-d63c-4881-8fc4-3ef0c707ba7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:57.916984 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34848e3e-d63c-4881-8fc4-3ef0c707ba7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:57.917110 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34848e3e-d63c-4881-8fc4-3ef0c707ba7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:57.917420 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34848e3e-d63c-4881-8fc4-3ef0c707ba7c admin admin] PATH_INFO: `/v3/projects/63604e78a78e483f96a2922ac7f36adc/users/13abc49178714815be2f6bf0bafaee24/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:57.920332 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34848e3e-d63c-4881-8fc4-3ef0c707ba7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=63604e78a78e483f96a2922ac7f36adc, user_id=13abc49178714815be2f6bf0bafaee24, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:57.923374 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1325/2672] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 06:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 06:01:57.923512 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34848e3e-d63c-4881-8fc4-3ef0c707ba7c admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:57.924764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1136fcd-4545-4dc4-97a8-9c9064ced5b8 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:57.928037 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a1136fcd-4545-4dc4-97a8-9c9064ced5b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:57.933032 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:57.939014 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1348/2673] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:57 2022] PUT /identity/v3/projects/63604e78a78e483f96a2922ac7f36adc/users/13abc49178714815be2f6bf0bafaee24/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:57.950347 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34848e3e-d63c-4881-8fc4-3ef0c707ba7c admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:57.995933 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1136fcd-4545-4dc4-97a8-9c9064ced5b8 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:58.025911 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34848e3e-d63c-4881-8fc4-3ef0c707ba7c admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:58.031511 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4f32a-8eac-4cd5-928b-921f994daa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:58.032172 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4f32a-8eac-4cd5-928b-921f994daa4b admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:58.032466 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4f32a-8eac-4cd5-928b-921f994daa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:58.032744 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4f32a-8eac-4cd5-928b-921f994daa4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:58.033427 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4f32a-8eac-4cd5-928b-921f994daa4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:58.035360 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4f32a-8eac-4cd5-928b-921f994daa4b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:58.047246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f512bf-2883-477f-8852-05a340cf8b47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:58.047843 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f512bf-2883-477f-8852-05a340cf8b47 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:58.048129 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f512bf-2883-477f-8852-05a340cf8b47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:58.048410 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f512bf-2883-477f-8852-05a340cf8b47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:58.059306 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f512bf-2883-477f-8852-05a340cf8b47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:58.060804 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f512bf-2883-477f-8852-05a340cf8b47 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:58.066053 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1349/2674] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:01:57 2022] POST /identity/v3/projects => generated 369 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:58.067280 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abbab8-6e55-48a4-b21b-a2931bd717c1 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:58.067570 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abbab8-6e55-48a4-b21b-a2931bd717c1 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:58.067855 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abbab8-6e55-48a4-b21b-a2931bd717c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:58.071491 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1326/2675] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:01:58.077434 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f512bf-2883-477f-8852-05a340cf8b47 service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:58.089215 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f512bf-2883-477f-8852-05a340cf8b47 service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:58.103357 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-f5abbab8-6e55-48a4-b21b-a2931bd717c1 None None] MFA Rules not processed for user `13abc49178714815be2f6bf0bafaee24`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:58.104693 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f5abbab8-6e55-48a4-b21b-a2931bd717c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:58.174698 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ca2bd-1d45-4c8f-b015-654931b75b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:58.175927 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ca2bd-1d45-4c8f-b015-654931b75b6b admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:58.176460 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ca2bd-1d45-4c8f-b015-654931b75b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:58.176848 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ca2bd-1d45-4c8f-b015-654931b75b6b admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:58.177663 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ca2bd-1d45-4c8f-b015-654931b75b6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:58.180356 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ca2bd-1d45-4c8f-b015-654931b75b6b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:58.219761 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1327/2676] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:01:58 2022] POST /identity/v3/users => generated 285 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:58.221609 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ca2bd-1d45-4c8f-b015-654931b75b6b admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:58.230400 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:58.234772 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1350/2677] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:58.234961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ca2bd-1d45-4c8f-b015-654931b75b6b admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:58.240386 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffa971-99c3-4880-b931-2d22cb17c340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:58.242109 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffa971-99c3-4880-b931-2d22cb17c340 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:58.242109 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffa971-99c3-4880-b931-2d22cb17c340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:58.242109 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffa971-99c3-4880-b931-2d22cb17c340 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:58.242518 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ffa971-99c3-4880-b931-2d22cb17c340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:58.245061 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ffa971-99c3-4880-b931-2d22cb17c340 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:58.246977 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5abbab8-6e55-48a4-b21b-a2931bd717c1 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:58.255854 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f5abbab8-6e55-48a4-b21b-a2931bd717c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:58.262415 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1328/2678] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:58.267699 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffa971-99c3-4880-b931-2d22cb17c340 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:58.281124 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffa971-99c3-4880-b931-2d22cb17c340 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:58.286922 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa048c6-601a-4206-ab6f-05f0d90e1397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:58.287600 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa048c6-601a-4206-ab6f-05f0d90e1397 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:58.287892 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa048c6-601a-4206-ab6f-05f0d90e1397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:58.288418 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa048c6-601a-4206-ab6f-05f0d90e1397 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:58.290361 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa048c6-601a-4206-ab6f-05f0d90e1397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:58.292014 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa048c6-601a-4206-ab6f-05f0d90e1397 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:58.308395 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1329/2679] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:58.310545 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa048c6-601a-4206-ab6f-05f0d90e1397 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:58.324380 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa048c6-601a-4206-ab6f-05f0d90e1397 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:58.333780 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed944f91-fbc6-421f-802a-f2dee730c512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:58.334889 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed944f91-fbc6-421f-802a-f2dee730c512 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:58.335181 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed944f91-fbc6-421f-802a-f2dee730c512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:58.337141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed944f91-fbc6-421f-802a-f2dee730c512 admin admin] PATH_INFO: `/v3/projects/cc2ba508fa8544e48751b020d2f6d1eb/users/daac25fd5e194ef0a2f8f9a869e287a7/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:58.348735 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5abbab8-6e55-48a4-b21b-a2931bd717c1 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:58.354540 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033a9dc-4073-4d5b-a628-6e936235bd3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:58.355670 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033a9dc-4073-4d5b-a628-6e936235bd3c service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:58.355963 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033a9dc-4073-4d5b-a628-6e936235bd3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:58.356495 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033a9dc-4073-4d5b-a628-6e936235bd3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:58.358765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed944f91-fbc6-421f-802a-f2dee730c512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc2ba508fa8544e48751b020d2f6d1eb, user_id=daac25fd5e194ef0a2f8f9a869e287a7, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:58.362554 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed944f91-fbc6-421f-802a-f2dee730c512 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:58.368271 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033a9dc-4073-4d5b-a628-6e936235bd3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:58.370286 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033a9dc-4073-4d5b-a628-6e936235bd3c service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:58.382806 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1330/2680] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:58 2022] PUT /identity/v3/projects/cc2ba508fa8544e48751b020d2f6d1eb/users/daac25fd5e194ef0a2f8f9a869e287a7/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:58.384566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1351/2681] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:01:58.395185 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc8ac5-24e9-4387-88a4-91aeabc170ce None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:58.395661 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc8ac5-24e9-4387-88a4-91aeabc170ce None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:58.395812 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc8ac5-24e9-4387-88a4-91aeabc170ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:58.422944 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033a9dc-4073-4d5b-a628-6e936235bd3c service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:58.425463 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9033a9dc-4073-4d5b-a628-6e936235bd3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:58.428179 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-fadc8ac5-24e9-4387-88a4-91aeabc170ce None None] MFA Rules not processed for user `daac25fd5e194ef0a2f8f9a869e287a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:58.442647 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-fadc8ac5-24e9-4387-88a4-91aeabc170ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:58.449824 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033a9dc-4073-4d5b-a628-6e936235bd3c service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:58.459932 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:58.513796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ee855-0477-4b18-93db-b0823b9ec213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:58.514706 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ee855-0477-4b18-93db-b0823b9ec213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:58.526439 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ee855-0477-4b18-93db-b0823b9ec213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:58.526779 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ee855-0477-4b18-93db-b0823b9ec213 admin admin] PATH_INFO: `/v3/projects/b8d1e81c7f9e4f58b0eead19a3bae6b1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:58.528271 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ee855-0477-4b18-93db-b0823b9ec213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8d1e81c7f9e4f58b0eead19a3bae6b1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:58.530724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ee855-0477-4b18-93db-b0823b9ec213 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:58.569645 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1331/2682] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:58.575321 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc8ac5-24e9-4387-88a4-91aeabc170ce None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:58.588891 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc8ac5-24e9-4387-88a4-91aeabc170ce None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:58.604391 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-bf8ee855-0477-4b18-93db-b0823b9ec213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8d1e81c7f9e4f58b0eead19a3bae6b1', 'request_id': 'req-bf8ee855-0477-4b18-93db-b0823b9ec213'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:58.612718 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-bf8ee855-0477-4b18-93db-b0823b9ec213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8d1e81c7f9e4f58b0eead19a3bae6b1', 'request_id': 'req-bf8ee855-0477-4b18-93db-b0823b9ec213'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:58.620987 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-bf8ee855-0477-4b18-93db-b0823b9ec213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8d1e81c7f9e4f58b0eead19a3bae6b1', 'request_id': 'req-bf8ee855-0477-4b18-93db-b0823b9ec213'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:58.642565 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-bf8ee855-0477-4b18-93db-b0823b9ec213 admin admin] The token cache is being invalidate because project b8d1e81c7f9e4f58b0eead19a3bae6b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:01:58.642862 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-bf8ee855-0477-4b18-93db-b0823b9ec213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:58.643593 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-bf8ee855-0477-4b18-93db-b0823b9ec213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:58.646210 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1352/2683] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:01:58 2022] DELETE /identity/v3/projects/b8d1e81c7f9e4f58b0eead19a3bae6b1 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:58.650507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ee855-0477-4b18-93db-b0823b9ec213 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:58.652392 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-bf8ee855-0477-4b18-93db-b0823b9ec213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:58.666046 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580ef6d-5db3-471d-8b08-c7d78151d578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:58.666719 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580ef6d-5db3-471d-8b08-c7d78151d578 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:58.667008 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580ef6d-5db3-471d-8b08-c7d78151d578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:58.667291 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580ef6d-5db3-471d-8b08-c7d78151d578 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:58.667989 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5580ef6d-5db3-471d-8b08-c7d78151d578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:58.669906 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5580ef6d-5db3-471d-8b08-c7d78151d578 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:58.700444 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1332/2684] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:01:58 2022] POST /identity/v3/projects => generated 365 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:01:58.704356 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580ef6d-5db3-471d-8b08-c7d78151d578 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:58.706777 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5580ef6d-5db3-471d-8b08-c7d78151d578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:58.729033 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ee855-0477-4b18-93db-b0823b9ec213 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:58.749538 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:58.789252 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:58.792576 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580ef6d-5db3-471d-8b08-c7d78151d578 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:58.798086 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba9c27-e91f-4bd8-a727-e09595cbc944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:58.798862 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba9c27-e91f-4bd8-a727-e09595cbc944 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:58.799191 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba9c27-e91f-4bd8-a727-e09595cbc944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:58.799638 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba9c27-e91f-4bd8-a727-e09595cbc944 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:58.800267 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba9c27-e91f-4bd8-a727-e09595cbc944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:58.802294 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba9c27-e91f-4bd8-a727-e09595cbc944 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:58.802877 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6b652-639a-422f-9cc1-7557ea2bbf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:58.803882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6b652-639a-422f-9cc1-7557ea2bbf5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:58.804701 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6b652-639a-422f-9cc1-7557ea2bbf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:58.804988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6b652-639a-422f-9cc1-7557ea2bbf5c admin admin] PATH_INFO: `/v3/users/12afc1cb2e704a9ab80d37d99f3062a4` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:58.806296 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6b652-639a-422f-9cc1-7557ea2bbf5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=12afc1cb2e704a9ab80d37d99f3062a4)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:58.808208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6b652-639a-422f-9cc1-7557ea2bbf5c admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:58.826099 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1333/2685] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:01:58 2022] POST /identity/v3/users => generated 289 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 06:01:58.827699 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba9c27-e91f-4bd8-a727-e09595cbc944 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:58.830190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-28ba9c27-e91f-4bd8-a727-e09595cbc944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:58.846510 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba9c27-e91f-4bd8-a727-e09595cbc944 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:58.852039 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45651491-ea3d-484b-aa54-8b6d84b65c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:58.852953 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45651491-ea3d-484b-aa54-8b6d84b65c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:58.853276 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45651491-ea3d-484b-aa54-8b6d84b65c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:58.853558 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45651491-ea3d-484b-aa54-8b6d84b65c39 admin admin] PATH_INFO: `/v3/users/907ff8cdc93348408d089480cd24e9c9` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:58.854970 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45651491-ea3d-484b-aa54-8b6d84b65c39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=907ff8cdc93348408d089480cd24e9c9)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:58.857060 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45651491-ea3d-484b-aa54-8b6d84b65c39 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:58.872009 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8df6b652-639a-422f-9cc1-7557ea2bbf5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12afc1cb2e704a9ab80d37d99f3062a4'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:58.879581 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8df6b652-639a-422f-9cc1-7557ea2bbf5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12afc1cb2e704a9ab80d37d99f3062a4'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:58.880324 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8df6b652-639a-422f-9cc1-7557ea2bbf5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12afc1cb2e704a9ab80d37d99f3062a4'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:58.890948 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8df6b652-639a-422f-9cc1-7557ea2bbf5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12afc1cb2e704a9ab80d37d99f3062a4'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:58.908877 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8df6b652-639a-422f-9cc1-7557ea2bbf5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12afc1cb2e704a9ab80d37d99f3062a4'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:58.914876 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-45651491-ea3d-484b-aa54-8b6d84b65c39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '907ff8cdc93348408d089480cd24e9c9'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:58.916728 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1353/2686] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:01:58 2022] DELETE /identity/v3/users/12afc1cb2e704a9ab80d37d99f3062a4 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:58.917810 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6b652-639a-422f-9cc1-7557ea2bbf5c admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:58.919432 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-8df6b652-639a-422f-9cc1-7557ea2bbf5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:58.926629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-45651491-ea3d-484b-aa54-8b6d84b65c39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '907ff8cdc93348408d089480cd24e9c9'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:58.927388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-45651491-ea3d-484b-aa54-8b6d84b65c39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '907ff8cdc93348408d089480cd24e9c9'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:58.928021 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-45651491-ea3d-484b-aa54-8b6d84b65c39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '907ff8cdc93348408d089480cd24e9c9'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:58.946475 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-45651491-ea3d-484b-aa54-8b6d84b65c39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '907ff8cdc93348408d089480cd24e9c9'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:58.966139 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1334/2687] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:01:58 2022] DELETE /identity/v3/users/907ff8cdc93348408d089480cd24e9c9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:58.970686 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193d645-8c42-40eb-9c9f-b6da0f437460 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:58.971029 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193d645-8c42-40eb-9c9f-b6da0f437460 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:58.971332 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193d645-8c42-40eb-9c9f-b6da0f437460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:58.995097 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-8193d645-8c42-40eb-9c9f-b6da0f437460 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:58.996393 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8193d645-8c42-40eb-9c9f-b6da0f437460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:59.071785 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1335/2688] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:59.075353 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6b652-639a-422f-9cc1-7557ea2bbf5c admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:59.078531 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b886160-fa63-4d0f-99fe-dfa722d62712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:59.078954 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b886160-fa63-4d0f-99fe-dfa722d62712 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:59.079241 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b886160-fa63-4d0f-99fe-dfa722d62712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:59.079654 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b886160-fa63-4d0f-99fe-dfa722d62712 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:59.080406 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b886160-fa63-4d0f-99fe-dfa722d62712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:59.082874 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b886160-fa63-4d0f-99fe-dfa722d62712 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:59.083651 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193d645-8c42-40eb-9c9f-b6da0f437460 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:59.086026 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8193d645-8c42-40eb-9c9f-b6da0f437460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:59.124126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1354/2689] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:59.125300 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b886160-fa63-4d0f-99fe-dfa722d62712 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:59.128792 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1b886160-fa63-4d0f-99fe-dfa722d62712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:59.142732 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:59.144262 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b886160-fa63-4d0f-99fe-dfa722d62712 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:59.150418 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf10b6-08ff-4b90-a9a5-51d39ff6440d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:59.151443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf10b6-08ff-4b90-a9a5-51d39ff6440d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:59.151733 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf10b6-08ff-4b90-a9a5-51d39ff6440d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:59.152015 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf10b6-08ff-4b90-a9a5-51d39ff6440d admin admin] PATH_INFO: `/v3/users/9b758c1c3eaa4b4da6889d4d360bdd3c` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:59.153282 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf10b6-08ff-4b90-a9a5-51d39ff6440d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b758c1c3eaa4b4da6889d4d360bdd3c)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:59.155228 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf10b6-08ff-4b90-a9a5-51d39ff6440d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:59.169431 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193d645-8c42-40eb-9c9f-b6da0f437460 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:59.173867 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88be702-18df-49af-9586-fdac0ea9bc98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:59.174972 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88be702-18df-49af-9586-fdac0ea9bc98 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:59.175416 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88be702-18df-49af-9586-fdac0ea9bc98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:59.175852 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88be702-18df-49af-9586-fdac0ea9bc98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:59.187412 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88be702-18df-49af-9586-fdac0ea9bc98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:59.188802 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88be702-18df-49af-9586-fdac0ea9bc98 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:59.200436 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1336/2690] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 06:01:59.201239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88be702-18df-49af-9586-fdac0ea9bc98 service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:59.202570 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d88be702-18df-49af-9586-fdac0ea9bc98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:59.210459 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-77cf10b6-08ff-4b90-a9a5-51d39ff6440d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b758c1c3eaa4b4da6889d4d360bdd3c'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:59.216797 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88be702-18df-49af-9586-fdac0ea9bc98 service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:59.219913 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-77cf10b6-08ff-4b90-a9a5-51d39ff6440d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b758c1c3eaa4b4da6889d4d360bdd3c'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:59.221126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-77cf10b6-08ff-4b90-a9a5-51d39ff6440d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b758c1c3eaa4b4da6889d4d360bdd3c'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:59.222509 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6ef51-c86c-43fd-ab56-abb077831d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:59.223524 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6ef51-c86c-43fd-ab56-abb077831d8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:59.223813 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6ef51-c86c-43fd-ab56-abb077831d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:59.224140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6ef51-c86c-43fd-ab56-abb077831d8b admin admin] PATH_INFO: `/v3/projects/af879177542046779c5917b610acce34/users/9a249b4233624d1eab11b47d2e46d5ee/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:59.226244 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:59.232733 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-77cf10b6-08ff-4b90-a9a5-51d39ff6440d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b758c1c3eaa4b4da6889d4d360bdd3c'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:59.242818 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6ef51-c86c-43fd-ab56-abb077831d8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=af879177542046779c5917b610acce34, user_id=9a249b4233624d1eab11b47d2e46d5ee, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:59.245591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6ef51-c86c-43fd-ab56-abb077831d8b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:59.254402 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-77cf10b6-08ff-4b90-a9a5-51d39ff6440d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b758c1c3eaa4b4da6889d4d360bdd3c'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:59.261966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1337/2691] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:59 2022] PUT /identity/v3/projects/af879177542046779c5917b610acce34/users/9a249b4233624d1eab11b47d2e46d5ee/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:59.266977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6ef51-c86c-43fd-ab56-abb077831d8b admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:59.269075 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-4bf6ef51-c86c-43fd-ab56-abb077831d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:59.277711 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1355/2692] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:01:59 2022] DELETE /identity/v3/users/9b758c1c3eaa4b4da6889d4d360bdd3c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:59.278968 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf10b6-08ff-4b90-a9a5-51d39ff6440d admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:59.280844 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-77cf10b6-08ff-4b90-a9a5-51d39ff6440d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:59.379798 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf10b6-08ff-4b90-a9a5-51d39ff6440d admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:59.383759 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6ef51-c86c-43fd-ab56-abb077831d8b admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:59.385303 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae9a35-d5ba-4ce5-9802-44939941e2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:59.386282 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae9a35-d5ba-4ce5-9802-44939941e2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:59.386650 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae9a35-d5ba-4ce5-9802-44939941e2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:59.387022 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae9a35-d5ba-4ce5-9802-44939941e2b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:59.388001 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae9a35-d5ba-4ce5-9802-44939941e2b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:59.390021 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae9a35-d5ba-4ce5-9802-44939941e2b4 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:59.392359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254a770-348e-4da6-b2d7-750a16f38003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:59.393441 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254a770-348e-4da6-b2d7-750a16f38003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:59.393959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254a770-348e-4da6-b2d7-750a16f38003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:59.394257 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254a770-348e-4da6-b2d7-750a16f38003 admin admin] PATH_INFO: `/v3/projects/b78e0bee1ce54dba8f327efb78b54f09` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:59.395478 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254a770-348e-4da6-b2d7-750a16f38003 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b78e0bee1ce54dba8f327efb78b54f09)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:59.397397 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254a770-348e-4da6-b2d7-750a16f38003 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:59.403034 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1356/2693] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:01:59.404345 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc38e50-8b18-465b-a701-b4388cb0687e None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:59.404637 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc38e50-8b18-465b-a701-b4388cb0687e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:59.404912 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc38e50-8b18-465b-a701-b4388cb0687e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:59.423534 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-4cc38e50-8b18-465b-a701-b4388cb0687e None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:59.424975 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4cc38e50-8b18-465b-a701-b4388cb0687e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:59.433529 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1357/2694] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:59.434497 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc38e50-8b18-465b-a701-b4388cb0687e None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:59.445630 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc38e50-8b18-465b-a701-b4388cb0687e None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:59.453019 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c254a770-348e-4da6-b2d7-750a16f38003 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b78e0bee1ce54dba8f327efb78b54f09', 'request_id': 'req-c254a770-348e-4da6-b2d7-750a16f38003'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:59.463640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c254a770-348e-4da6-b2d7-750a16f38003 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b78e0bee1ce54dba8f327efb78b54f09', 'request_id': 'req-c254a770-348e-4da6-b2d7-750a16f38003'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:59.470641 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c254a770-348e-4da6-b2d7-750a16f38003 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b78e0bee1ce54dba8f327efb78b54f09', 'request_id': 'req-c254a770-348e-4da6-b2d7-750a16f38003'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:59.485497 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c254a770-348e-4da6-b2d7-750a16f38003 admin admin] The token cache is being invalidate because project b78e0bee1ce54dba8f327efb78b54f09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:01:59.486171 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c254a770-348e-4da6-b2d7-750a16f38003 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:59.487615 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-c254a770-348e-4da6-b2d7-750a16f38003 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:59.490072 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1338/2695] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:01:59 2022] DELETE /identity/v3/projects/b78e0bee1ce54dba8f327efb78b54f09 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:01:59.491168 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254a770-348e-4da6-b2d7-750a16f38003 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:59.492765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c254a770-348e-4da6-b2d7-750a16f38003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:59.521887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5447600-fa75-4159-a9d9-6271218ed535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:59.523592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5447600-fa75-4159-a9d9-6271218ed535 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:59.523922 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5447600-fa75-4159-a9d9-6271218ed535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:59.524270 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5447600-fa75-4159-a9d9-6271218ed535 admin admin] PATH_INFO: `/v3/projects/af879177542046779c5917b610acce34/users/9a249b4233624d1eab11b47d2e46d5ee/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:59.526519 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5447600-fa75-4159-a9d9-6271218ed535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af879177542046779c5917b610acce34, user_id=9a249b4233624d1eab11b47d2e46d5ee, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:59.532073 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5447600-fa75-4159-a9d9-6271218ed535 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:59.544580 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1358/2696] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:01:59 2022] PUT /identity/v3/projects/af879177542046779c5917b610acce34/users/9a249b4233624d1eab11b47d2e46d5ee/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:59.547105 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10733b5c-90d4-4ffa-a05e-3b020319bacf None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:59.547407 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10733b5c-90d4-4ffa-a05e-3b020319bacf None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:59.547691 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10733b5c-90d4-4ffa-a05e-3b020319bacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:59.565589 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:59.569152 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-10733b5c-90d4-4ffa-a05e-3b020319bacf None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:59.571017 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-10733b5c-90d4-4ffa-a05e-3b020319bacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:59.580058 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254a770-348e-4da6-b2d7-750a16f38003 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:59.631125 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1359/2697] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:59.633212 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537b24a-af2f-4df1-b9fa-601edf29185d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:59.634015 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537b24a-af2f-4df1-b9fa-601edf29185d service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:59.634847 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537b24a-af2f-4df1-b9fa-601edf29185d service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:59.634958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10733b5c-90d4-4ffa-a05e-3b020319bacf None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:59.635168 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537b24a-af2f-4df1-b9fa-601edf29185d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:59.636345 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-10733b5c-90d4-4ffa-a05e-3b020319bacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:59.636962 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-2537b24a-af2f-4df1-b9fa-601edf29185d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:59.643256 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:59.649756 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10733b5c-90d4-4ffa-a05e-3b020319bacf None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:59.650248 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537b24a-af2f-4df1-b9fa-601edf29185d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:59.651735 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537b24a-af2f-4df1-b9fa-601edf29185d service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:59.655731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c93699-bfca-466a-aadf-8d2c2ee8cc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:59.656594 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c93699-bfca-466a-aadf-8d2c2ee8cc2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:59.656882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c93699-bfca-466a-aadf-8d2c2ee8cc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:59.657162 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c93699-bfca-466a-aadf-8d2c2ee8cc2b admin admin] PATH_INFO: `/v3/projects/fbbc98a3e63f42e29cccc0e61380eaed` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:59.658373 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c93699-bfca-466a-aadf-8d2c2ee8cc2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbbc98a3e63f42e29cccc0e61380eaed)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:59.660309 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c93699-bfca-466a-aadf-8d2c2ee8cc2b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:59.662069 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1339/2698] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:01:59.663321 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928f363-c44c-4a0d-a1f6-ed8c5f0e3263 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:59.663636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928f363-c44c-4a0d-a1f6-ed8c5f0e3263 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:59.663912 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928f363-c44c-4a0d-a1f6-ed8c5f0e3263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:59.698490 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-1928f363-c44c-4a0d-a1f6-ed8c5f0e3263 None None] MFA Rules not processed for user `9a249b4233624d1eab11b47d2e46d5ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:59.699527 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1928f363-c44c-4a0d-a1f6-ed8c5f0e3263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:59.715612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f1c93699-bfca-466a-aadf-8d2c2ee8cc2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbbc98a3e63f42e29cccc0e61380eaed', 'request_id': 'req-f1c93699-bfca-466a-aadf-8d2c2ee8cc2b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:59.723509 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f1c93699-bfca-466a-aadf-8d2c2ee8cc2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbbc98a3e63f42e29cccc0e61380eaed', 'request_id': 'req-f1c93699-bfca-466a-aadf-8d2c2ee8cc2b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:59.731850 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f1c93699-bfca-466a-aadf-8d2c2ee8cc2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbbc98a3e63f42e29cccc0e61380eaed', 'request_id': 'req-f1c93699-bfca-466a-aadf-8d2c2ee8cc2b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:59.745423 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f1c93699-bfca-466a-aadf-8d2c2ee8cc2b admin admin] The token cache is being invalidate because project fbbc98a3e63f42e29cccc0e61380eaed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:01:59.745761 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f1c93699-bfca-466a-aadf-8d2c2ee8cc2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:59.746396 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f1c93699-bfca-466a-aadf-8d2c2ee8cc2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:01:59.757643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1360/2699] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:01:59 2022] DELETE /identity/v3/projects/fbbc98a3e63f42e29cccc0e61380eaed => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:01:59.757643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35a9c5-3ca2-4bca-9ef2-b75cdc6ec7f8 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:59.757643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35a9c5-3ca2-4bca-9ef2-b75cdc6ec7f8 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:59.757643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35a9c5-3ca2-4bca-9ef2-b75cdc6ec7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:59.793043 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1340/2700] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:59 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:59.803428 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928f363-c44c-4a0d-a1f6-ed8c5f0e3263 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:59.806091 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1928f363-c44c-4a0d-a1f6-ed8c5f0e3263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:59.808271 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-3f35a9c5-3ca2-4bca-9ef2-b75cdc6ec7f8 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:01:59.809885 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3f35a9c5-3ca2-4bca-9ef2-b75cdc6ec7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:01:59.906172 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928f363-c44c-4a0d-a1f6-ed8c5f0e3263 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:59.911201 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ff43d-36e7-4d5d-85f3-6cfbe25b2b7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:59.913329 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ff43d-36e7-4d5d-85f3-6cfbe25b2b7f service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:59.914281 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ff43d-36e7-4d5d-85f3-6cfbe25b2b7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:59.914605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ff43d-36e7-4d5d-85f3-6cfbe25b2b7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:59.920791 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1361/2701] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:01:59.926790 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35a9c5-3ca2-4bca-9ef2-b75cdc6ec7f8 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:59.932704 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ff43d-36e7-4d5d-85f3-6cfbe25b2b7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:59.934270 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ff43d-36e7-4d5d-85f3-6cfbe25b2b7f service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:59.938399 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35a9c5-3ca2-4bca-9ef2-b75cdc6ec7f8 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:01:59.943862 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39071ec8-006d-4b04-b8ea-cea0e48d1fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:01:59.945853 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39071ec8-006d-4b04-b8ea-cea0e48d1fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:01:59.946410 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39071ec8-006d-4b04-b8ea-cea0e48d1fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:01:59.947452 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1341/2702] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:01:59 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 06:01:59.950183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39071ec8-006d-4b04-b8ea-cea0e48d1fd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:01:59.950993 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39071ec8-006d-4b04-b8ea-cea0e48d1fd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 06:01:59.951313 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39071ec8-006d-4b04-b8ea-cea0e48d1fd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:01:59.953586 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39071ec8-006d-4b04-b8ea-cea0e48d1fd6 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:01:59.970404 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1362/2703] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 06:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 06:01:59.974585 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ff43d-36e7-4d5d-85f3-6cfbe25b2b7f service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:01:59.994261 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ff43d-36e7-4d5d-85f3-6cfbe25b2b7f service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:00.002817 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39071ec8-006d-4b04-b8ea-cea0e48d1fd6 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:00.005049 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-39071ec8-006d-4b04-b8ea-cea0e48d1fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:00.008049 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee53913-8744-406b-bc4f-064a934fd0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:00.008845 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee53913-8744-406b-bc4f-064a934fd0e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:00.009198 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee53913-8744-406b-bc4f-064a934fd0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:00.009602 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee53913-8744-406b-bc4f-064a934fd0e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:00.010413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee53913-8744-406b-bc4f-064a934fd0e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:00.012725 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee53913-8744-406b-bc4f-064a934fd0e7 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:00.028661 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39071ec8-006d-4b04-b8ea-cea0e48d1fd6 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:00.034502 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c92863-faf2-47eb-9fcd-3f3060695324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:00.035245 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c92863-faf2-47eb-9fcd-3f3060695324 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:00.035642 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c92863-faf2-47eb-9fcd-3f3060695324 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:00.036046 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c92863-faf2-47eb-9fcd-3f3060695324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:00.038382 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-43c92863-faf2-47eb-9fcd-3f3060695324 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:00.051435 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1342/2704] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:01:59 2022] POST /identity/v3/projects => generated 359 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 06:02:00.051435 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee53913-8744-406b-bc4f-064a934fd0e7 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:00.054224 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8ee53913-8744-406b-bc4f-064a934fd0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:00.065348 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:00.107318 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c92863-faf2-47eb-9fcd-3f3060695324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:00.108769 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c92863-faf2-47eb-9fcd-3f3060695324 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:00.119999 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1363/2705] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:02:00 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:02:00.120965 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c92863-faf2-47eb-9fcd-3f3060695324 service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:00.130688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee53913-8744-406b-bc4f-064a934fd0e7 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:00.135111 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c92863-faf2-47eb-9fcd-3f3060695324 service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:00.136570 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc9e47-a4a7-4cbd-898f-2bec26cfca9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:00.137437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc9e47-a4a7-4cbd-898f-2bec26cfca9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:00.137727 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc9e47-a4a7-4cbd-898f-2bec26cfca9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:00.138048 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc9e47-a4a7-4cbd-898f-2bec26cfca9e admin admin] PATH_INFO: `/v3/projects/ad5c7c9ba0864e2e994f3f56deb55964` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:00.139248 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc9e47-a4a7-4cbd-898f-2bec26cfca9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad5c7c9ba0864e2e994f3f56deb55964)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:00.140281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdefc0b-cc1d-4888-af18-16e4e9615584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:00.141173 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc9e47-a4a7-4cbd-898f-2bec26cfca9e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:00.141561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdefc0b-cc1d-4888-af18-16e4e9615584 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:00.141852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdefc0b-cc1d-4888-af18-16e4e9615584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:00.142180 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdefc0b-cc1d-4888-af18-16e4e9615584 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:00.142874 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdefc0b-cc1d-4888-af18-16e4e9615584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:00.144916 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdefc0b-cc1d-4888-af18-16e4e9615584 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:00.154831 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:00.172104 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1364/2706] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:02:00 2022] POST /identity/v3/users => generated 280 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:02:00.176170 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdefc0b-cc1d-4888-af18-16e4e9615584 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:00.187130 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdefc0b-cc1d-4888-af18-16e4e9615584 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:00.201320 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6cdc9e47-a4a7-4cbd-898f-2bec26cfca9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad5c7c9ba0864e2e994f3f56deb55964', 'request_id': 'req-6cdc9e47-a4a7-4cbd-898f-2bec26cfca9e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:00.209314 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6cdc9e47-a4a7-4cbd-898f-2bec26cfca9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad5c7c9ba0864e2e994f3f56deb55964', 'request_id': 'req-6cdc9e47-a4a7-4cbd-898f-2bec26cfca9e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:00.223005 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6cdc9e47-a4a7-4cbd-898f-2bec26cfca9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad5c7c9ba0864e2e994f3f56deb55964', 'request_id': 'req-6cdc9e47-a4a7-4cbd-898f-2bec26cfca9e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:00.235151 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6cdc9e47-a4a7-4cbd-898f-2bec26cfca9e admin admin] The token cache is being invalidate because project ad5c7c9ba0864e2e994f3f56deb55964 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:02:00.235444 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6cdc9e47-a4a7-4cbd-898f-2bec26cfca9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:00.236129 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-6cdc9e47-a4a7-4cbd-898f-2bec26cfca9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:00.237703 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1343/2707] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:02:00 2022] DELETE /identity/v3/projects/ad5c7c9ba0864e2e994f3f56deb55964 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:00.241563 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc9e47-a4a7-4cbd-898f-2bec26cfca9e admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:00.243028 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-6cdc9e47-a4a7-4cbd-898f-2bec26cfca9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:00.260118 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a01863-548b-4d89-a31b-d08f041b2e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:00.261402 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a01863-548b-4d89-a31b-d08f041b2e5e admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:00.261878 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a01863-548b-4d89-a31b-d08f041b2e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:00.262549 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a01863-548b-4d89-a31b-d08f041b2e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:00.263580 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a01863-548b-4d89-a31b-d08f041b2e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:00.266071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a01863-548b-4d89-a31b-d08f041b2e5e admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:00.280540 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1365/2708] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:02:00.284487 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a01863-548b-4d89-a31b-d08f041b2e5e admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:00.286271 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-81a01863-548b-4d89-a31b-d08f041b2e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:00.300185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a01863-548b-4d89-a31b-d08f041b2e5e admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:00.306921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbd826-74f7-4dde-b13a-2c5cad23009d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:00.307595 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbd826-74f7-4dde-b13a-2c5cad23009d admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:00.307954 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbd826-74f7-4dde-b13a-2c5cad23009d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:00.308155 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbd826-74f7-4dde-b13a-2c5cad23009d admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:00.308877 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbd826-74f7-4dde-b13a-2c5cad23009d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:00.310643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbd826-74f7-4dde-b13a-2c5cad23009d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:00.325049 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc9e47-a4a7-4cbd-898f-2bec26cfca9e admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:00.325249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1366/2709] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:02:00.326308 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbd826-74f7-4dde-b13a-2c5cad23009d admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:00.329344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a86af-cc89-4f84-807f-2afbe2c8b15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:00.330413 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a86af-cc89-4f84-807f-2afbe2c8b15e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:00.330676 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a86af-cc89-4f84-807f-2afbe2c8b15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:00.330968 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a86af-cc89-4f84-807f-2afbe2c8b15e admin admin] PATH_INFO: `/v3/users/13abc49178714815be2f6bf0bafaee24` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:00.332222 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a86af-cc89-4f84-807f-2afbe2c8b15e admin admin] RBAC: Authorizing `identity:delete_user(user_id=13abc49178714815be2f6bf0bafaee24)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:00.334344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a86af-cc89-4f84-807f-2afbe2c8b15e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:00.336713 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbd826-74f7-4dde-b13a-2c5cad23009d admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:00.342713 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df597390-04e2-4e1f-84a8-96d8da3d2455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:00.344304 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df597390-04e2-4e1f-84a8-96d8da3d2455 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:00.344592 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df597390-04e2-4e1f-84a8-96d8da3d2455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:00.344871 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df597390-04e2-4e1f-84a8-96d8da3d2455 admin admin] PATH_INFO: `/v3/projects/433c1c9756e34f0bb3ecf66463749911/users/32e2e409be1c4fada5a1d0c40f20d111/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:00.361657 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df597390-04e2-4e1f-84a8-96d8da3d2455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=433c1c9756e34f0bb3ecf66463749911, user_id=32e2e409be1c4fada5a1d0c40f20d111, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:00.365035 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df597390-04e2-4e1f-84a8-96d8da3d2455 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:00.381872 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1367/2710] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:02:00 2022] PUT /identity/v3/projects/433c1c9756e34f0bb3ecf66463749911/users/32e2e409be1c4fada5a1d0c40f20d111/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:00.388004 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:00.394001 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73538b-5f22-4e9e-9688-d3ab7e4c8807 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:00.394678 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73538b-5f22-4e9e-9688-d3ab7e4c8807 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:00.394678 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73538b-5f22-4e9e-9688-d3ab7e4c8807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:00.396777 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-a01a86af-cc89-4f84-807f-2afbe2c8b15e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13abc49178714815be2f6bf0bafaee24'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:00.407707 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-a01a86af-cc89-4f84-807f-2afbe2c8b15e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13abc49178714815be2f6bf0bafaee24'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:00.409332 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-a01a86af-cc89-4f84-807f-2afbe2c8b15e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13abc49178714815be2f6bf0bafaee24'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:00.409966 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-a01a86af-cc89-4f84-807f-2afbe2c8b15e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13abc49178714815be2f6bf0bafaee24'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:00.425891 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-de73538b-5f22-4e9e-9688-d3ab7e4c8807 None None] MFA Rules not processed for user `32e2e409be1c4fada5a1d0c40f20d111`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:00.427050 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-a01a86af-cc89-4f84-807f-2afbe2c8b15e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13abc49178714815be2f6bf0bafaee24'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:00.427399 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-de73538b-5f22-4e9e-9688-d3ab7e4c8807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:00.441516 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1344/2711] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:02:00 2022] DELETE /identity/v3/users/13abc49178714815be2f6bf0bafaee24 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:02:00.501071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1368/2712] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:00 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:02:00.538351 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a86af-cc89-4f84-807f-2afbe2c8b15e admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:00.539778 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a01a86af-cc89-4f84-807f-2afbe2c8b15e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:00.603324 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a86af-cc89-4f84-807f-2afbe2c8b15e admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:00.607368 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87121aff-eefa-48e5-b034-0800e51993c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:00.608091 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87121aff-eefa-48e5-b034-0800e51993c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:00.608459 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87121aff-eefa-48e5-b034-0800e51993c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:00.608746 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87121aff-eefa-48e5-b034-0800e51993c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:00.671296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87121aff-eefa-48e5-b034-0800e51993c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:00.672791 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87121aff-eefa-48e5-b034-0800e51993c3 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:00.683132 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1345/2713] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:02:00 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:02:00.697859 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73538b-5f22-4e9e-9688-d3ab7e4c8807 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:00.699337 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-de73538b-5f22-4e9e-9688-d3ab7e4c8807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:00.727687 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87121aff-eefa-48e5-b034-0800e51993c3 service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:00.729239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-87121aff-eefa-48e5-b034-0800e51993c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:00.750876 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:00.773797 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73538b-5f22-4e9e-9688-d3ab7e4c8807 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:00.810781 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87121aff-eefa-48e5-b034-0800e51993c3 service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:00.815920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de05df2-5366-41bd-8f71-588735dda624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:00.816781 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de05df2-5366-41bd-8f71-588735dda624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:00.817071 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de05df2-5366-41bd-8f71-588735dda624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:00.817349 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de05df2-5366-41bd-8f71-588735dda624 admin admin] PATH_INFO: `/v3/projects/63604e78a78e483f96a2922ac7f36adc` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:00.818567 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de05df2-5366-41bd-8f71-588735dda624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63604e78a78e483f96a2922ac7f36adc)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:00.820528 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de05df2-5366-41bd-8f71-588735dda624 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:00.832352 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e18a1-7025-484b-9478-28f78420f9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:00.833251 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e18a1-7025-484b-9478-28f78420f9bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:00.833528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e18a1-7025-484b-9478-28f78420f9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:00.833804 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e18a1-7025-484b-9478-28f78420f9bd admin admin] PATH_INFO: `/v3/users/32e2e409be1c4fada5a1d0c40f20d111` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:00.835062 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e18a1-7025-484b-9478-28f78420f9bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=32e2e409be1c4fada5a1d0c40f20d111)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:00.836333 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:00.837055 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e18a1-7025-484b-9478-28f78420f9bd admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:00.870283 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-0de05df2-5366-41bd-8f71-588735dda624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63604e78a78e483f96a2922ac7f36adc', 'request_id': 'req-0de05df2-5366-41bd-8f71-588735dda624'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:00.878453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-0de05df2-5366-41bd-8f71-588735dda624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63604e78a78e483f96a2922ac7f36adc', 'request_id': 'req-0de05df2-5366-41bd-8f71-588735dda624'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:00.886036 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-0de05df2-5366-41bd-8f71-588735dda624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63604e78a78e483f96a2922ac7f36adc', 'request_id': 'req-0de05df2-5366-41bd-8f71-588735dda624'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:00.889448 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-172e18a1-7025-484b-9478-28f78420f9bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32e2e409be1c4fada5a1d0c40f20d111'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:00.896346 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-172e18a1-7025-484b-9478-28f78420f9bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32e2e409be1c4fada5a1d0c40f20d111'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:00.896500 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-0de05df2-5366-41bd-8f71-588735dda624 admin admin] The token cache is being invalidate because project 63604e78a78e483f96a2922ac7f36adc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:02:00.896736 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-0de05df2-5366-41bd-8f71-588735dda624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:00.897073 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-172e18a1-7025-484b-9478-28f78420f9bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32e2e409be1c4fada5a1d0c40f20d111'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:00.897387 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-0de05df2-5366-41bd-8f71-588735dda624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:00.899137 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1346/2714] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:02:00 2022] DELETE /identity/v3/projects/63604e78a78e483f96a2922ac7f36adc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:02:00.903855 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71d2a9-24e9-4d53-911a-91b2d975216c None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:00.904130 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71d2a9-24e9-4d53-911a-91b2d975216c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:00.904483 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71d2a9-24e9-4d53-911a-91b2d975216c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:00.909307 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-172e18a1-7025-484b-9478-28f78420f9bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32e2e409be1c4fada5a1d0c40f20d111'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:00.923148 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-172e18a1-7025-484b-9478-28f78420f9bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32e2e409be1c4fada5a1d0c40f20d111'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:00.925453 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-ef71d2a9-24e9-4d53-911a-91b2d975216c None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:00.926828 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ef71d2a9-24e9-4d53-911a-91b2d975216c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:00.930312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1369/2715] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:02:00 2022] DELETE /identity/v3/users/32e2e409be1c4fada5a1d0c40f20d111 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:00.934977 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c064cd-5e42-4b8e-9339-5fa4880ee4b2 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:00.935126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c064cd-5e42-4b8e-9339-5fa4880ee4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:00.935406 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c064cd-5e42-4b8e-9339-5fa4880ee4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:00.952623 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-75c064cd-5e42-4b8e-9339-5fa4880ee4b2 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:00.953833 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-75c064cd-5e42-4b8e-9339-5fa4880ee4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:00.997290 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1347/2716] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:02:00.999197 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b584ee-558d-4ef1-9abb-7d548f71d9d5 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:00.999486 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b584ee-558d-4ef1-9abb-7d548f71d9d5 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:00.999765 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b584ee-558d-4ef1-9abb-7d548f71d9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:01.016698 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1370/2717] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:02:01.017422 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-e4b584ee-558d-4ef1-9abb-7d548f71d9d5 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:01.018609 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e4b584ee-558d-4ef1-9abb-7d548f71d9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:01.026539 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1348/2718] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:02:01.029502 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c064cd-5e42-4b8e-9339-5fa4880ee4b2 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:01.030313 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b584ee-558d-4ef1-9abb-7d548f71d9d5 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:01.031006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-75c064cd-5e42-4b8e-9339-5fa4880ee4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:01.040430 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b584ee-558d-4ef1-9abb-7d548f71d9d5 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:01.044599 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:01.045779 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d81979-9996-4a21-81aa-0f35fd978f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:01.046477 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d81979-9996-4a21-81aa-0f35fd978f55 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:01.046763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d81979-9996-4a21-81aa-0f35fd978f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:01.047039 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d81979-9996-4a21-81aa-0f35fd978f55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:01.047767 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d81979-9996-4a21-81aa-0f35fd978f55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 06:02:01.048073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d81979-9996-4a21-81aa-0f35fd978f55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:01.049711 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d81979-9996-4a21-81aa-0f35fd978f55 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:01.063423 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1349/2719] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 06:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 06:02:01.067467 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d81979-9996-4a21-81aa-0f35fd978f55 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:01.077468 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d81979-9996-4a21-81aa-0f35fd978f55 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:01.082165 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e4b8c-af63-49fa-adaf-b50fe554abff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:01.082808 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e4b8c-af63-49fa-adaf-b50fe554abff admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:01.083090 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e4b8c-af63-49fa-adaf-b50fe554abff admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:01.083364 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e4b8c-af63-49fa-adaf-b50fe554abff admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:01.084079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e4b8c-af63-49fa-adaf-b50fe554abff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:01.086539 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e4b8c-af63-49fa-adaf-b50fe554abff admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:01.092163 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c064cd-5e42-4b8e-9339-5fa4880ee4b2 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:01.095907 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c38c90-2ccd-49c4-aafe-963ceecf7a17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:01.096554 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c38c90-2ccd-49c4-aafe-963ceecf7a17 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:01.096843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c38c90-2ccd-49c4-aafe-963ceecf7a17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:01.097121 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c38c90-2ccd-49c4-aafe-963ceecf7a17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:01.109222 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c38c90-2ccd-49c4-aafe-963ceecf7a17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:01.110597 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c38c90-2ccd-49c4-aafe-963ceecf7a17 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:01.135847 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1371/2720] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:02:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 06:02:01.136056 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1350/2721] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:02:01 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 06:02:01.138904 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c38c90-2ccd-49c4-aafe-963ceecf7a17 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:01.149500 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c38c90-2ccd-49c4-aafe-963ceecf7a17 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:01.207914 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5146f8e-d281-414f-b3e1-ad9bd12c733e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:01.208590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5146f8e-d281-414f-b3e1-ad9bd12c733e admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:01.208877 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5146f8e-d281-414f-b3e1-ad9bd12c733e admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:01.209176 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5146f8e-d281-414f-b3e1-ad9bd12c733e admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:01.209881 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5146f8e-d281-414f-b3e1-ad9bd12c733e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:01.212426 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5146f8e-d281-414f-b3e1-ad9bd12c733e admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:01.234208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1372/2722] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:02:01 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:02:01.238171 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e4b8c-af63-49fa-adaf-b50fe554abff admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:01.248626 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e4b8c-af63-49fa-adaf-b50fe554abff admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:01.253152 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0382f3-f0cc-4695-b7b9-27d4e070c3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:01.253818 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0382f3-f0cc-4695-b7b9-27d4e070c3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:01.254155 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0382f3-f0cc-4695-b7b9-27d4e070c3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:01.254434 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0382f3-f0cc-4695-b7b9-27d4e070c3d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:01.255165 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0382f3-f0cc-4695-b7b9-27d4e070c3d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:01.256770 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0382f3-f0cc-4695-b7b9-27d4e070c3d1 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:01.268351 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1351/2723] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 06:02:01.272466 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5146f8e-d281-414f-b3e1-ad9bd12c733e admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:01.284113 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5146f8e-d281-414f-b3e1-ad9bd12c733e admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:01.289596 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c89cd-d5e6-4658-bfde-90b266dd6972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:01.290499 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c89cd-d5e6-4658-bfde-90b266dd6972 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:01.290730 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c89cd-d5e6-4658-bfde-90b266dd6972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:01.291018 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c89cd-d5e6-4658-bfde-90b266dd6972 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:01.291723 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c89cd-d5e6-4658-bfde-90b266dd6972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:01.293321 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c89cd-d5e6-4658-bfde-90b266dd6972 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:01.305891 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1373/2724] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:02:01.309917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0382f3-f0cc-4695-b7b9-27d4e070c3d1 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:01.320591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0382f3-f0cc-4695-b7b9-27d4e070c3d1 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:01.325181 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ee64b-48aa-49f9-b80e-b5541ca37a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:01.326117 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ee64b-48aa-49f9-b80e-b5541ca37a07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:01.326426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ee64b-48aa-49f9-b80e-b5541ca37a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:01.327082 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ee64b-48aa-49f9-b80e-b5541ca37a07 admin admin] PATH_INFO: `/v3/projects/8585a6b62d9643019a56d81dd229e345/users/cdeb6ce5c19d42bdb23087885c19e419/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:01.344331 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ee64b-48aa-49f9-b80e-b5541ca37a07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8585a6b62d9643019a56d81dd229e345, user_id=cdeb6ce5c19d42bdb23087885c19e419, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:01.347111 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ee64b-48aa-49f9-b80e-b5541ca37a07 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:01.363937 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1352/2725] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:02:01 2022] PUT /identity/v3/projects/8585a6b62d9643019a56d81dd229e345/users/cdeb6ce5c19d42bdb23087885c19e419/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:01.373958 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b72e78-9fa5-487f-8ad9-654d930ecd7e None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:01.374264 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b72e78-9fa5-487f-8ad9-654d930ecd7e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:01.374546 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b72e78-9fa5-487f-8ad9-654d930ecd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:01.404798 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-47b72e78-9fa5-487f-8ad9-654d930ecd7e None None] MFA Rules not processed for user `cdeb6ce5c19d42bdb23087885c19e419`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:01.406195 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-47b72e78-9fa5-487f-8ad9-654d930ecd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:01.418703 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ee64b-48aa-49f9-b80e-b5541ca37a07 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:01.420533 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-803ee64b-48aa-49f9-b80e-b5541ca37a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:01.466027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:01.491167 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1374/2726] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:02:01.506600 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ee64b-48aa-49f9-b80e-b5541ca37a07 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:01.507725 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b72e78-9fa5-487f-8ad9-654d930ecd7e None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:01.509142 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-47b72e78-9fa5-487f-8ad9-654d930ecd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:01.512157 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f8d86-fbc4-4a19-9559-86ad38ce6d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:01.513019 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f8d86-fbc4-4a19-9559-86ad38ce6d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:01.513300 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f8d86-fbc4-4a19-9559-86ad38ce6d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:01.513578 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f8d86-fbc4-4a19-9559-86ad38ce6d85 admin admin] PATH_INFO: `/v3/projects/433c1c9756e34f0bb3ecf66463749911` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:01.514799 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f8d86-fbc4-4a19-9559-86ad38ce6d85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=433c1c9756e34f0bb3ecf66463749911)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:01.516867 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f8d86-fbc4-4a19-9559-86ad38ce6d85 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:01.537759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:01.572742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5c4f8d86-fbc4-4a19-9559-86ad38ce6d85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '433c1c9756e34f0bb3ecf66463749911', 'request_id': 'req-5c4f8d86-fbc4-4a19-9559-86ad38ce6d85'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:01.580980 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b72e78-9fa5-487f-8ad9-654d930ecd7e None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:01.586240 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5c4f8d86-fbc4-4a19-9559-86ad38ce6d85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '433c1c9756e34f0bb3ecf66463749911', 'request_id': 'req-5c4f8d86-fbc4-4a19-9559-86ad38ce6d85'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:01.595628 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5c4f8d86-fbc4-4a19-9559-86ad38ce6d85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '433c1c9756e34f0bb3ecf66463749911', 'request_id': 'req-5c4f8d86-fbc4-4a19-9559-86ad38ce6d85'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:01.607459 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5c4f8d86-fbc4-4a19-9559-86ad38ce6d85 admin admin] The token cache is being invalidate because project 433c1c9756e34f0bb3ecf66463749911 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:02:01.607793 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5c4f8d86-fbc4-4a19-9559-86ad38ce6d85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:01.608448 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-5c4f8d86-fbc4-4a19-9559-86ad38ce6d85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:01.610160 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1353/2727] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:02:01 2022] DELETE /identity/v3/projects/433c1c9756e34f0bb3ecf66463749911 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:02:01.615269 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a55ce-29e4-48ca-8fc9-90e154da3751 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:01.615709 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a55ce-29e4-48ca-8fc9-90e154da3751 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:01.616000 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a55ce-29e4-48ca-8fc9-90e154da3751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:01.639692 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02918f6-5232-460a-ab84-4ffe21a44c9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:01.640444 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02918f6-5232-460a-ab84-4ffe21a44c9f service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:01.640794 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02918f6-5232-460a-ab84-4ffe21a44c9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:01.641049 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-b41a55ce-29e4-48ca-8fc9-90e154da3751 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:01.641248 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02918f6-5232-460a-ab84-4ffe21a44c9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:01.642102 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b41a55ce-29e4-48ca-8fc9-90e154da3751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:01.643449 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d02918f6-5232-460a-ab84-4ffe21a44c9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:01.710236 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1354/2728] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:02:01.718703 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a97fa5-d131-4316-b38f-5034887afe53 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:01.718991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a97fa5-d131-4316-b38f-5034887afe53 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:01.719268 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a97fa5-d131-4316-b38f-5034887afe53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:01.720111 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02918f6-5232-460a-ab84-4ffe21a44c9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:01.721688 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02918f6-5232-460a-ab84-4ffe21a44c9f service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:01.731922 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1375/2729] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:02:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 06:02:01.741185 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-b3a97fa5-d131-4316-b38f-5034887afe53 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:01.742480 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-b3a97fa5-d131-4316-b38f-5034887afe53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:01.751543 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02918f6-5232-460a-ab84-4ffe21a44c9f service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:01.753230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d02918f6-5232-460a-ab84-4ffe21a44c9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:01.753441 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1355/2730] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:02:01.758109 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a97fa5-d131-4316-b38f-5034887afe53 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:01.769769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a97fa5-d131-4316-b38f-5034887afe53 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:01.770353 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02918f6-5232-460a-ab84-4ffe21a44c9f service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:01.776302 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d8055-d399-4b05-b723-07bd432be161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:01.777109 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c4e04-6908-4571-ac59-77c3c203d66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:01.777263 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d8055-d399-4b05-b723-07bd432be161 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:01.777618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d8055-d399-4b05-b723-07bd432be161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:01.778006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c4e04-6908-4571-ac59-77c3c203d66f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:01.778125 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d8055-d399-4b05-b723-07bd432be161 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:01.778299 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c4e04-6908-4571-ac59-77c3c203d66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:01.778566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c4e04-6908-4571-ac59-77c3c203d66f admin admin] PATH_INFO: `/v3/users/cdeb6ce5c19d42bdb23087885c19e419` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:01.779173 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d8055-d399-4b05-b723-07bd432be161 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 06:02:01.779538 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d8055-d399-4b05-b723-07bd432be161 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:01.779832 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c4e04-6908-4571-ac59-77c3c203d66f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdeb6ce5c19d42bdb23087885c19e419)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:01.781183 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d8055-d399-4b05-b723-07bd432be161 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:01.782297 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c4e04-6908-4571-ac59-77c3c203d66f admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:01.794171 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1356/2731] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 06:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 06:02:01.799344 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d8055-d399-4b05-b723-07bd432be161 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:01.812525 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d8055-d399-4b05-b723-07bd432be161 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:01.823496 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef91ae-ec3b-4dc7-9eeb-bcaafc39f1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:01.824928 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef91ae-ec3b-4dc7-9eeb-bcaafc39f1eb admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:01.825644 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef91ae-ec3b-4dc7-9eeb-bcaafc39f1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:01.826327 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef91ae-ec3b-4dc7-9eeb-bcaafc39f1eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:01.827899 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef91ae-ec3b-4dc7-9eeb-bcaafc39f1eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:01.831472 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef91ae-ec3b-4dc7-9eeb-bcaafc39f1eb admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:01.844992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-7c2c4e04-6908-4571-ac59-77c3c203d66f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdeb6ce5c19d42bdb23087885c19e419'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:01.854593 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-7c2c4e04-6908-4571-ac59-77c3c203d66f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdeb6ce5c19d42bdb23087885c19e419'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:01.856122 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-7c2c4e04-6908-4571-ac59-77c3c203d66f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdeb6ce5c19d42bdb23087885c19e419'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:01.864233 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1357/2732] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:02:01 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 06:02:01.865323 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-7c2c4e04-6908-4571-ac59-77c3c203d66f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdeb6ce5c19d42bdb23087885c19e419'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:01.869259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef91ae-ec3b-4dc7-9eeb-bcaafc39f1eb admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:01.885157 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-7c2c4e04-6908-4571-ac59-77c3c203d66f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdeb6ce5c19d42bdb23087885c19e419'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:01.889899 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:01.896765 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1376/2733] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:02:01 2022] DELETE /identity/v3/users/cdeb6ce5c19d42bdb23087885c19e419 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:02:01.901659 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120ad0e-5d3e-4989-b935-c5fb916d63cd None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:01.902152 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120ad0e-5d3e-4989-b935-c5fb916d63cd None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:01.902894 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120ad0e-5d3e-4989-b935-c5fb916d63cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:01.912896 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:01.930126 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-4120ad0e-5d3e-4989-b935-c5fb916d63cd None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:01.932067 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4120ad0e-5d3e-4989-b935-c5fb916d63cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:01.979004 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef91ae-ec3b-4dc7-9eeb-bcaafc39f1eb admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:02.004740 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1377/2734] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:02:02.014314 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120ad0e-5d3e-4989-b935-c5fb916d63cd None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:02.015754 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4120ad0e-5d3e-4989-b935-c5fb916d63cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:02.054239 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91a710-a581-4237-9b4f-d26a9a7f8ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:02.054917 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91a710-a581-4237-9b4f-d26a9a7f8ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:02.055203 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91a710-a581-4237-9b4f-d26a9a7f8ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:02.055476 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91a710-a581-4237-9b4f-d26a9a7f8ae4 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:02.056188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91a710-a581-4237-9b4f-d26a9a7f8ae4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:02.058133 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91a710-a581-4237-9b4f-d26a9a7f8ae4 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:02.077760 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120ad0e-5d3e-4989-b935-c5fb916d63cd None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:02.078760 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1358/2735] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:02:01 2022] POST /identity/v3/users => generated 289 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 06:02:02.081687 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65132148-27d9-4e80-adea-b79b9546be17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:02.082402 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65132148-27d9-4e80-adea-b79b9546be17 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:02.082689 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65132148-27d9-4e80-adea-b79b9546be17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:02.082965 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65132148-27d9-4e80-adea-b79b9546be17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:02.083298 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91a710-a581-4237-9b4f-d26a9a7f8ae4 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:02.085739 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-8e91a710-a581-4237-9b4f-d26a9a7f8ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:02.094917 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65132148-27d9-4e80-adea-b79b9546be17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:02.101983 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65132148-27d9-4e80-adea-b79b9546be17 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:02.102157 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91a710-a581-4237-9b4f-d26a9a7f8ae4 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:02.103458 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b72147-64d1-4672-b9d2-18c08ebf3b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:02.104134 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b72147-64d1-4672-b9d2-18c08ebf3b48 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:02.104419 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b72147-64d1-4672-b9d2-18c08ebf3b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:02.104701 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b72147-64d1-4672-b9d2-18c08ebf3b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:02.105434 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b72147-64d1-4672-b9d2-18c08ebf3b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:02.107064 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b72147-64d1-4672-b9d2-18c08ebf3b48 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:02.109377 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1378/2736] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:02:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:02:02.125322 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1359/2737] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 06:02:02.127142 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65132148-27d9-4e80-adea-b79b9546be17 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:02.137585 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65132148-27d9-4e80-adea-b79b9546be17 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:02.143310 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f82c2f-ee86-4d0f-91bb-b54199efeda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:02.143986 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f82c2f-ee86-4d0f-91bb-b54199efeda9 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:02.144269 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f82c2f-ee86-4d0f-91bb-b54199efeda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:02.144566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f82c2f-ee86-4d0f-91bb-b54199efeda9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:02.145408 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f82c2f-ee86-4d0f-91bb-b54199efeda9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:02.149365 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f82c2f-ee86-4d0f-91bb-b54199efeda9 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:02.164899 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1379/2738] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:02:02.166578 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b72147-64d1-4672-b9d2-18c08ebf3b48 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:02.177403 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b72147-64d1-4672-b9d2-18c08ebf3b48 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:02.183619 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2c1c6-5a5f-42d8-8ff8-c0e12bda4471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:02.184749 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2c1c6-5a5f-42d8-8ff8-c0e12bda4471 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:02.185247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2c1c6-5a5f-42d8-8ff8-c0e12bda4471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:02.185543 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2c1c6-5a5f-42d8-8ff8-c0e12bda4471 admin admin] PATH_INFO: `/v3/projects/9405db81e23a4cbbb963f916fbeea605/users/f02739ec12fa4f238244cdcbe1e3d739/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:02.202417 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2c1c6-5a5f-42d8-8ff8-c0e12bda4471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9405db81e23a4cbbb963f916fbeea605, user_id=f02739ec12fa4f238244cdcbe1e3d739, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:02.205081 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2c1c6-5a5f-42d8-8ff8-c0e12bda4471 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:02.225314 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1360/2739] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:02:02 2022] PUT /identity/v3/projects/9405db81e23a4cbbb963f916fbeea605/users/f02739ec12fa4f238244cdcbe1e3d739/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:02.230348 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00220420-9b8c-40f7-bb9b-296d20d6b924 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:02.230643 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00220420-9b8c-40f7-bb9b-296d20d6b924 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:02.230978 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00220420-9b8c-40f7-bb9b-296d20d6b924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:02.248900 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-00220420-9b8c-40f7-bb9b-296d20d6b924 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:02.250138 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-00220420-9b8c-40f7-bb9b-296d20d6b924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:02.314671 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1380/2740] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:02:02.329763 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2c1c6-5a5f-42d8-8ff8-c0e12bda4471 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:02.331661 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-21f2c1c6-5a5f-42d8-8ff8-c0e12bda4471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:02.395238 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2c1c6-5a5f-42d8-8ff8-c0e12bda4471 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:02.400379 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fa114-832e-4acc-9067-f4617cc5a708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:02.401230 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fa114-832e-4acc-9067-f4617cc5a708 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:02.401598 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fa114-832e-4acc-9067-f4617cc5a708 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:02.401891 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fa114-832e-4acc-9067-f4617cc5a708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:02.410724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00220420-9b8c-40f7-bb9b-296d20d6b924 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:02.412255 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-00220420-9b8c-40f7-bb9b-296d20d6b924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:02.416742 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86fa114-832e-4acc-9067-f4617cc5a708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:02.418251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86fa114-832e-4acc-9067-f4617cc5a708 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:02.430215 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1361/2741] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:02:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:02:02.431575 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00220420-9b8c-40f7-bb9b-296d20d6b924 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:02.437094 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6bf02-3502-45e5-9b7b-3eb33b74214f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:02.438035 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6bf02-3502-45e5-9b7b-3eb33b74214f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:02.438438 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6bf02-3502-45e5-9b7b-3eb33b74214f admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:02.438868 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6bf02-3502-45e5-9b7b-3eb33b74214f admin admin] PATH_INFO: `/v3/projects/8585a6b62d9643019a56d81dd229e345` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:02.440386 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6bf02-3502-45e5-9b7b-3eb33b74214f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8585a6b62d9643019a56d81dd229e345)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:02.442459 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6bf02-3502-45e5-9b7b-3eb33b74214f admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:02.481033 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:02.494428 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-3db6bf02-3502-45e5-9b7b-3eb33b74214f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8585a6b62d9643019a56d81dd229e345', 'request_id': 'req-3db6bf02-3502-45e5-9b7b-3eb33b74214f'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:02.500304 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-3db6bf02-3502-45e5-9b7b-3eb33b74214f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8585a6b62d9643019a56d81dd229e345', 'request_id': 'req-3db6bf02-3502-45e5-9b7b-3eb33b74214f'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:02.506947 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-3db6bf02-3502-45e5-9b7b-3eb33b74214f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8585a6b62d9643019a56d81dd229e345', 'request_id': 'req-3db6bf02-3502-45e5-9b7b-3eb33b74214f'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:02.519035 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-3db6bf02-3502-45e5-9b7b-3eb33b74214f admin admin] The token cache is being invalidate because project 8585a6b62d9643019a56d81dd229e345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:02:02.519258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-3db6bf02-3502-45e5-9b7b-3eb33b74214f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:02.519942 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-3db6bf02-3502-45e5-9b7b-3eb33b74214f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:02.521566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1381/2742] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:02:02 2022] DELETE /identity/v3/projects/8585a6b62d9643019a56d81dd229e345 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:02:02.527188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1ea52-1d82-4940-98c5-be11c0f134b8 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:02.527474 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1ea52-1d82-4940-98c5-be11c0f134b8 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:02.527754 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1ea52-1d82-4940-98c5-be11c0f134b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:02.546726 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-56d1ea52-1d82-4940-98c5-be11c0f134b8 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:02.547978 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-56d1ea52-1d82-4940-98c5-be11c0f134b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:02.562544 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:02.612913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1362/2743] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:02:02.622707 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2912c7-d96e-4966-8d5a-954812b7a4df None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:02.623009 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2912c7-d96e-4966-8d5a-954812b7a4df None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:02.623299 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2912c7-d96e-4966-8d5a-954812b7a4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:02.642868 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-db2912c7-d96e-4966-8d5a-954812b7a4df None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:02.644075 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-db2912c7-d96e-4966-8d5a-954812b7a4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:02.652794 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1382/2744] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:02:02.657086 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1ea52-1d82-4940-98c5-be11c0f134b8 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:02.668002 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1ea52-1d82-4940-98c5-be11c0f134b8 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:02.673511 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90a651-3aa1-4f28-808f-4abf1fc80d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:02.674132 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90a651-3aa1-4f28-808f-4abf1fc80d9a admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:02.674345 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90a651-3aa1-4f28-808f-4abf1fc80d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:02.674649 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90a651-3aa1-4f28-808f-4abf1fc80d9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:02.675374 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90a651-3aa1-4f28-808f-4abf1fc80d9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 06:02:02.675760 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90a651-3aa1-4f28-808f-4abf1fc80d9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:02.677272 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90a651-3aa1-4f28-808f-4abf1fc80d9a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:02.691039 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1363/2745] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 06:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 06:02:02.699417 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2912c7-d96e-4966-8d5a-954812b7a4df None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:02.713782 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2912c7-d96e-4966-8d5a-954812b7a4df None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:02.715471 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3097b0-ef16-424a-85b6-30b3d6d207f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:02.716157 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3097b0-ef16-424a-85b6-30b3d6d207f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:02.716424 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3097b0-ef16-424a-85b6-30b3d6d207f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:02.716699 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3097b0-ef16-424a-85b6-30b3d6d207f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:02.717473 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3097b0-ef16-424a-85b6-30b3d6d207f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:02.719416 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3097b0-ef16-424a-85b6-30b3d6d207f4 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:02.747523 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1383/2746] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:02:02 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:02:02.752316 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90a651-3aa1-4f28-808f-4abf1fc80d9a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:02.763358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90a651-3aa1-4f28-808f-4abf1fc80d9a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:02.829867 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86142ea-8f81-4843-86fd-33df94469f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:02.831155 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86142ea-8f81-4843-86fd-33df94469f45 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:02.831155 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86142ea-8f81-4843-86fd-33df94469f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:02.831155 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86142ea-8f81-4843-86fd-33df94469f45 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:02.831815 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86142ea-8f81-4843-86fd-33df94469f45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:02.833784 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86142ea-8f81-4843-86fd-33df94469f45 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:02.860704 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1364/2747] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:02:02 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:02:02.864940 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3097b0-ef16-424a-85b6-30b3d6d207f4 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:02.876568 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3097b0-ef16-424a-85b6-30b3d6d207f4 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:02.881289 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd7afe-ecf0-49dc-9d03-d6f27fb2f806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:02.882127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd7afe-ecf0-49dc-9d03-d6f27fb2f806 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:02.882476 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd7afe-ecf0-49dc-9d03-d6f27fb2f806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:02.882821 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd7afe-ecf0-49dc-9d03-d6f27fb2f806 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:02.883612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd7afe-ecf0-49dc-9d03-d6f27fb2f806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:02.885256 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd7afe-ecf0-49dc-9d03-d6f27fb2f806 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:02.903428 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1384/2748] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:02:02.907818 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86142ea-8f81-4843-86fd-33df94469f45 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:02.918954 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86142ea-8f81-4843-86fd-33df94469f45 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:02.924014 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1bbca-1885-4140-b26b-c3ff631961ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:02.924720 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1bbca-1885-4140-b26b-c3ff631961ef admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:02.924972 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1bbca-1885-4140-b26b-c3ff631961ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:02.925257 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1bbca-1885-4140-b26b-c3ff631961ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:02.926024 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1bbca-1885-4140-b26b-c3ff631961ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:02.927641 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1bbca-1885-4140-b26b-c3ff631961ef admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:02.938688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1365/2749] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:02:02.942961 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd7afe-ecf0-49dc-9d03-d6f27fb2f806 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:02.954078 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd7afe-ecf0-49dc-9d03-d6f27fb2f806 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:02.958887 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea5c35-4616-43d9-aa1e-23e587624bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:02.959784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea5c35-4616-43d9-aa1e-23e587624bc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:02.960072 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea5c35-4616-43d9-aa1e-23e587624bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:02.961022 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea5c35-4616-43d9-aa1e-23e587624bc3 admin admin] PATH_INFO: `/v3/projects/391ee53fa68f41a4ac576996b9b52b9d/users/bab1bde41c394c519663217f6466033e/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:02.981860 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea5c35-4616-43d9-aa1e-23e587624bc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=391ee53fa68f41a4ac576996b9b52b9d, user_id=bab1bde41c394c519663217f6466033e, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:02.984615 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea5c35-4616-43d9-aa1e-23e587624bc3 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:03.003168 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1385/2750] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:02:02 2022] PUT /identity/v3/projects/391ee53fa68f41a4ac576996b9b52b9d/users/bab1bde41c394c519663217f6466033e/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:03.008654 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395096d-1434-43eb-84e1-e9925c223796 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:03.008997 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395096d-1434-43eb-84e1-e9925c223796 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:03.009283 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395096d-1434-43eb-84e1-e9925c223796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:03.030998 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-3395096d-1434-43eb-84e1-e9925c223796 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:03.032270 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3395096d-1434-43eb-84e1-e9925c223796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:03.115279 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1366/2751] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:02:03.126575 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea5c35-4616-43d9-aa1e-23e587624bc3 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:03.131193 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-92ea5c35-4616-43d9-aa1e-23e587624bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:03.222258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea5c35-4616-43d9-aa1e-23e587624bc3 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:03.229170 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e9662-b5ab-4170-b724-55aa86464217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:03.230535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e9662-b5ab-4170-b724-55aa86464217 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:03.230869 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e9662-b5ab-4170-b724-55aa86464217 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:03.231156 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e9662-b5ab-4170-b724-55aa86464217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:03.242127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e9662-b5ab-4170-b724-55aa86464217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:03.243649 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e9662-b5ab-4170-b724-55aa86464217 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:03.254165 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1386/2752] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:02:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:02:03.648805 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395096d-1434-43eb-84e1-e9925c223796 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:03.650366 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3395096d-1434-43eb-84e1-e9925c223796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:03.688845 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:03.750188 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395096d-1434-43eb-84e1-e9925c223796 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:03.758750 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27b101-3fa0-4e00-8536-c849df74c0bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17a40bea6ba41f19c88e16f9b15cf27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:03.759935 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27b101-3fa0-4e00-8536-c849df74c0bb service placement] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:03.763090 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27b101-3fa0-4e00-8536-c849df74c0bb service placement] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:03.763597 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27b101-3fa0-4e00-8536-c849df74c0bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:03.768385 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-4c27b101-3fa0-4e00-8536-c849df74c0bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:03.791539 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27b101-3fa0-4e00-8536-c849df74c0bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:03.793469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27b101-3fa0-4e00-8536-c849df74c0bb service placement] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:03.807959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1367/2753] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:02:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:02:04.045111 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e9662-b5ab-4170-b724-55aa86464217 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:04.047308 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a98e9662-b5ab-4170-b724-55aa86464217 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:04.066196 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e9662-b5ab-4170-b724-55aa86464217 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:04.071091 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e337a-1957-4a0e-b31d-239e3a043c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:04.071993 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e337a-1957-4a0e-b31d-239e3a043c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:04.072284 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e337a-1957-4a0e-b31d-239e3a043c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:04.072567 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e337a-1957-4a0e-b31d-239e3a043c99 admin admin] PATH_INFO: `/v3/users/daac25fd5e194ef0a2f8f9a869e287a7` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:04.073801 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e337a-1957-4a0e-b31d-239e3a043c99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daac25fd5e194ef0a2f8f9a869e287a7)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:04.075872 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e337a-1957-4a0e-b31d-239e3a043c99 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:04.151734 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f83e337a-1957-4a0e-b31d-239e3a043c99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daac25fd5e194ef0a2f8f9a869e287a7'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:04.160209 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:04.165817 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f83e337a-1957-4a0e-b31d-239e3a043c99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daac25fd5e194ef0a2f8f9a869e287a7'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:04.167001 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f83e337a-1957-4a0e-b31d-239e3a043c99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daac25fd5e194ef0a2f8f9a869e287a7'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:04.180615 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f83e337a-1957-4a0e-b31d-239e3a043c99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daac25fd5e194ef0a2f8f9a869e287a7'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:04.207826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f83e337a-1957-4a0e-b31d-239e3a043c99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daac25fd5e194ef0a2f8f9a869e287a7'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:04.217704 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1387/2754] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:02:04 2022] DELETE /identity/v3/users/daac25fd5e194ef0a2f8f9a869e287a7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:04.222439 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83af62-e486-401a-b78c-780237ed8bc2 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:04.222724 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83af62-e486-401a-b78c-780237ed8bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:04.223044 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83af62-e486-401a-b78c-780237ed8bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:04.246568 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-4a83af62-e486-401a-b78c-780237ed8bc2 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:04.247879 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-4a83af62-e486-401a-b78c-780237ed8bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:04.332441 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1368/2755] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:02:04.345651 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e337a-1957-4a0e-b31d-239e3a043c99 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:04.347214 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f83e337a-1957-4a0e-b31d-239e3a043c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:04.448778 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e337a-1957-4a0e-b31d-239e3a043c99 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:04.462310 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7e1d2-2fe5-4085-bb69-dadd1acb7fa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:04.463399 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7e1d2-2fe5-4085-bb69-dadd1acb7fa6 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:04.463787 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7e1d2-2fe5-4085-bb69-dadd1acb7fa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:04.464140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7e1d2-2fe5-4085-bb69-dadd1acb7fa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:04.476504 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7e1d2-2fe5-4085-bb69-dadd1acb7fa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:04.478075 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7e1d2-2fe5-4085-bb69-dadd1acb7fa6 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:04.493258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1388/2756] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:02:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:02:05.551094 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83af62-e486-401a-b78c-780237ed8bc2 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:05.554587 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-4a83af62-e486-401a-b78c-780237ed8bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:05.575321 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83af62-e486-401a-b78c-780237ed8bc2 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:05.591169 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088dd4a-b2c4-4d4b-b553-8b41fd6a49e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:05.592066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088dd4a-b2c4-4d4b-b553-8b41fd6a49e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:05.592355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088dd4a-b2c4-4d4b-b553-8b41fd6a49e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:05.592629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088dd4a-b2c4-4d4b-b553-8b41fd6a49e3 admin admin] PATH_INFO: `/v3/projects/cc2ba508fa8544e48751b020d2f6d1eb` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:05.597076 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088dd4a-b2c4-4d4b-b553-8b41fd6a49e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc2ba508fa8544e48751b020d2f6d1eb)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:05.599078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088dd4a-b2c4-4d4b-b553-8b41fd6a49e3 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:05.667417 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d088dd4a-b2c4-4d4b-b553-8b41fd6a49e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc2ba508fa8544e48751b020d2f6d1eb', 'request_id': 'req-d088dd4a-b2c4-4d4b-b553-8b41fd6a49e3'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:05.678263 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d088dd4a-b2c4-4d4b-b553-8b41fd6a49e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc2ba508fa8544e48751b020d2f6d1eb', 'request_id': 'req-d088dd4a-b2c4-4d4b-b553-8b41fd6a49e3'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:05.687679 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d088dd4a-b2c4-4d4b-b553-8b41fd6a49e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc2ba508fa8544e48751b020d2f6d1eb', 'request_id': 'req-d088dd4a-b2c4-4d4b-b553-8b41fd6a49e3'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:05.701044 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d088dd4a-b2c4-4d4b-b553-8b41fd6a49e3 admin admin] The token cache is being invalidate because project cc2ba508fa8544e48751b020d2f6d1eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:02:05.701488 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d088dd4a-b2c4-4d4b-b553-8b41fd6a49e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:05.702217 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-d088dd4a-b2c4-4d4b-b553-8b41fd6a49e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:05.704075 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1369/2757] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:02:05 2022] DELETE /identity/v3/projects/cc2ba508fa8544e48751b020d2f6d1eb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:05.707999 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7e1d2-2fe5-4085-bb69-dadd1acb7fa6 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:05.726561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7e1d2-2fe5-4085-bb69-dadd1acb7fa6 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:05.796362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1d77a-4d5c-4288-a25c-d3dba04aef3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:05.797316 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1d77a-4d5c-4288-a25c-d3dba04aef3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:05.797675 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1d77a-4d5c-4288-a25c-d3dba04aef3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:05.798068 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1d77a-4d5c-4288-a25c-d3dba04aef3c admin admin] PATH_INFO: `/v3/users/9a249b4233624d1eab11b47d2e46d5ee` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:05.799387 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1d77a-4d5c-4288-a25c-d3dba04aef3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a249b4233624d1eab11b47d2e46d5ee)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:05.801515 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1d77a-4d5c-4288-a25c-d3dba04aef3c admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:05.859786 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c1e1d77a-4d5c-4288-a25c-d3dba04aef3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a249b4233624d1eab11b47d2e46d5ee'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:05.867992 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c1e1d77a-4d5c-4288-a25c-d3dba04aef3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a249b4233624d1eab11b47d2e46d5ee'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:05.868690 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c1e1d77a-4d5c-4288-a25c-d3dba04aef3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a249b4233624d1eab11b47d2e46d5ee'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:05.877452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c1e1d77a-4d5c-4288-a25c-d3dba04aef3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a249b4233624d1eab11b47d2e46d5ee'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:05.895916 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:05.897003 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c1e1d77a-4d5c-4288-a25c-d3dba04aef3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a249b4233624d1eab11b47d2e46d5ee'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:05.908725 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1389/2758] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:02:05 2022] DELETE /identity/v3/users/9a249b4233624d1eab11b47d2e46d5ee => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:06.385102 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088dd4a-b2c4-4d4b-b553-8b41fd6a49e3 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:06.392615 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d088dd4a-b2c4-4d4b-b553-8b41fd6a49e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:06.430864 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088dd4a-b2c4-4d4b-b553-8b41fd6a49e3 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:06.538758 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:06.573504 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e9052-99de-4035-97c6-1489f3e57a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:06.574686 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e9052-99de-4035-97c6-1489f3e57a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:06.574945 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e9052-99de-4035-97c6-1489f3e57a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:06.575308 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e9052-99de-4035-97c6-1489f3e57a0d admin admin] PATH_INFO: `/v3/projects/af879177542046779c5917b610acce34` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:06.576658 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e9052-99de-4035-97c6-1489f3e57a0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=af879177542046779c5917b610acce34)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:06.579057 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e9052-99de-4035-97c6-1489f3e57a0d admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:06.643697 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4a5e9052-99de-4035-97c6-1489f3e57a0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af879177542046779c5917b610acce34', 'request_id': 'req-4a5e9052-99de-4035-97c6-1489f3e57a0d'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:06.665920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4a5e9052-99de-4035-97c6-1489f3e57a0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af879177542046779c5917b610acce34', 'request_id': 'req-4a5e9052-99de-4035-97c6-1489f3e57a0d'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:06.675003 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4a5e9052-99de-4035-97c6-1489f3e57a0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af879177542046779c5917b610acce34', 'request_id': 'req-4a5e9052-99de-4035-97c6-1489f3e57a0d'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:06.695178 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4a5e9052-99de-4035-97c6-1489f3e57a0d admin admin] The token cache is being invalidate because project af879177542046779c5917b610acce34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:02:06.695618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4a5e9052-99de-4035-97c6-1489f3e57a0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:06.696682 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-4a5e9052-99de-4035-97c6-1489f3e57a0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:06.698810 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1370/2759] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:02:06 2022] DELETE /identity/v3/projects/af879177542046779c5917b610acce34 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:06.703332 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca091d6-8568-441d-b2d6-74e26f9df8ec None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:06.703630 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca091d6-8568-441d-b2d6-74e26f9df8ec None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:06.703922 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca091d6-8568-441d-b2d6-74e26f9df8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:06.739740 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-aca091d6-8568-441d-b2d6-74e26f9df8ec None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:06.740942 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-aca091d6-8568-441d-b2d6-74e26f9df8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:06.861872 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1390/2760] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:02:06.870210 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9cffb-7f3f-4055-821f-06aaf3668f1c None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:06.870772 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9cffb-7f3f-4055-821f-06aaf3668f1c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:06.871152 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9cffb-7f3f-4055-821f-06aaf3668f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:06.910339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-52a9cffb-7f3f-4055-821f-06aaf3668f1c None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:06.913639 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-52a9cffb-7f3f-4055-821f-06aaf3668f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:06.927584 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1371/2761] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:02:06.934671 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca091d6-8568-441d-b2d6-74e26f9df8ec None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:06.950692 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca091d6-8568-441d-b2d6-74e26f9df8ec None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:06.966152 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afc41c-82e5-4b4d-a8aa-4cb837c72741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:06.967010 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afc41c-82e5-4b4d-a8aa-4cb837c72741 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:06.967394 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afc41c-82e5-4b4d-a8aa-4cb837c72741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:06.967915 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afc41c-82e5-4b4d-a8aa-4cb837c72741 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:06.968754 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afc41c-82e5-4b4d-a8aa-4cb837c72741 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 06:02:06.971288 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afc41c-82e5-4b4d-a8aa-4cb837c72741 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:06.973050 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afc41c-82e5-4b4d-a8aa-4cb837c72741 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:07.003938 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1391/2762] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 06:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 06:02:07.008573 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9cffb-7f3f-4055-821f-06aaf3668f1c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:07.023304 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9cffb-7f3f-4055-821f-06aaf3668f1c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:07.031307 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03ae04-8685-40ce-ac59-703b4752167f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:07.032164 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03ae04-8685-40ce-ac59-703b4752167f admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:07.032547 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03ae04-8685-40ce-ac59-703b4752167f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:07.032925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03ae04-8685-40ce-ac59-703b4752167f admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:07.033961 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03ae04-8685-40ce-ac59-703b4752167f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:07.036852 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03ae04-8685-40ce-ac59-703b4752167f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:07.105754 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1372/2763] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:02:07 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:02:07.109602 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afc41c-82e5-4b4d-a8aa-4cb837c72741 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:07.123524 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afc41c-82e5-4b4d-a8aa-4cb837c72741 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:07.283935 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ea0d2-8bde-4259-aaf5-b6c99d107de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:07.284636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ea0d2-8bde-4259-aaf5-b6c99d107de6 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:07.285047 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ea0d2-8bde-4259-aaf5-b6c99d107de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:07.285292 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ea0d2-8bde-4259-aaf5-b6c99d107de6 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:07.285924 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ea0d2-8bde-4259-aaf5-b6c99d107de6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:07.288133 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ea0d2-8bde-4259-aaf5-b6c99d107de6 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:07.347635 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1392/2764] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:02:07 2022] POST /identity/v3/users => generated 292 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:02:07.351209 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03ae04-8685-40ce-ac59-703b4752167f admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:07.363432 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03ae04-8685-40ce-ac59-703b4752167f admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:07.370195 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a2fa3-42d3-452e-8377-731bcbfdce4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:07.370889 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a2fa3-42d3-452e-8377-731bcbfdce4f admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:07.371400 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a2fa3-42d3-452e-8377-731bcbfdce4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:07.372236 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a2fa3-42d3-452e-8377-731bcbfdce4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:07.372494 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a2fa3-42d3-452e-8377-731bcbfdce4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:07.374372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a2fa3-42d3-452e-8377-731bcbfdce4f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:07.400443 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1373/2765] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:02:07.402253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ea0d2-8bde-4259-aaf5-b6c99d107de6 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:07.415767 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ea0d2-8bde-4259-aaf5-b6c99d107de6 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:07.428447 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a81462-b939-4c4a-af93-5eb2f04a000e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:07.429185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a81462-b939-4c4a-af93-5eb2f04a000e admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:07.430019 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a81462-b939-4c4a-af93-5eb2f04a000e admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:07.430019 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a81462-b939-4c4a-af93-5eb2f04a000e admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:07.430541 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a81462-b939-4c4a-af93-5eb2f04a000e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:07.432465 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a81462-b939-4c4a-af93-5eb2f04a000e admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:07.445213 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1393/2766] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:02:07.449360 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a2fa3-42d3-452e-8377-731bcbfdce4f admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:07.463670 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a2fa3-42d3-452e-8377-731bcbfdce4f admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:07.477027 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c424f-8bda-4453-8e4c-fec924903dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:07.478265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c424f-8bda-4453-8e4c-fec924903dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:07.479703 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c424f-8bda-4453-8e4c-fec924903dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:07.480247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c424f-8bda-4453-8e4c-fec924903dc7 admin admin] PATH_INFO: `/v3/projects/489849af94cc47069b6f093fa4f74986/users/72eda1dc27bf4422b64d319f2d63e44c/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:07.504591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c424f-8bda-4453-8e4c-fec924903dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=489849af94cc47069b6f093fa4f74986, user_id=72eda1dc27bf4422b64d319f2d63e44c, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:07.513079 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c424f-8bda-4453-8e4c-fec924903dc7 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:07.540508 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1374/2767] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:02:07 2022] PUT /identity/v3/projects/489849af94cc47069b6f093fa4f74986/users/72eda1dc27bf4422b64d319f2d63e44c/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:07.553360 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efbd3f-b741-4bcf-ae66-25855f10b1fb None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:07.553898 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efbd3f-b741-4bcf-ae66-25855f10b1fb None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:07.554480 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efbd3f-b741-4bcf-ae66-25855f10b1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:07.622881 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-e4efbd3f-b741-4bcf-ae66-25855f10b1fb None None] MFA Rules not processed for user `72eda1dc27bf4422b64d319f2d63e44c`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:07.624292 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e4efbd3f-b741-4bcf-ae66-25855f10b1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:07.706563 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:07.734113 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1394/2768] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:02:07.738302 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c424f-8bda-4453-8e4c-fec924903dc7 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:07.821575 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c424f-8bda-4453-8e4c-fec924903dc7 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:07.834206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfaf2b-ab65-40ba-94c0-f8ad7fcff9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:07.835139 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfaf2b-ab65-40ba-94c0-f8ad7fcff9dd admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:07.835467 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfaf2b-ab65-40ba-94c0-f8ad7fcff9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:07.835950 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfaf2b-ab65-40ba-94c0-f8ad7fcff9dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:07.836895 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfaf2b-ab65-40ba-94c0-f8ad7fcff9dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:07.839282 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfaf2b-ab65-40ba-94c0-f8ad7fcff9dd admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:07.860855 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:07.906883 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1375/2769] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:02:07 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:02:07.908247 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efbd3f-b741-4bcf-ae66-25855f10b1fb None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:07.931046 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efbd3f-b741-4bcf-ae66-25855f10b1fb None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:08.015884 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041179e-e5a0-44eb-9728-57cfa8038cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:08.016988 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041179e-e5a0-44eb-9728-57cfa8038cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:08.017470 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041179e-e5a0-44eb-9728-57cfa8038cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:08.017964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041179e-e5a0-44eb-9728-57cfa8038cb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:08.018854 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041179e-e5a0-44eb-9728-57cfa8038cb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:08.021230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041179e-e5a0-44eb-9728-57cfa8038cb1 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:08.060746 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfaf2b-ab65-40ba-94c0-f8ad7fcff9dd admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:08.061263 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1395/2770] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:02:07 2022] POST /identity/v3/users => generated 299 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:02:08.077734 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfaf2b-ab65-40ba-94c0-f8ad7fcff9dd admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:08.092820 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13d422-af7d-4297-9c47-b9690d805938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:08.093756 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13d422-af7d-4297-9c47-b9690d805938 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:08.094279 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13d422-af7d-4297-9c47-b9690d805938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:08.094841 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13d422-af7d-4297-9c47-b9690d805938 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:08.096061 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13d422-af7d-4297-9c47-b9690d805938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:08.098253 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13d422-af7d-4297-9c47-b9690d805938 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:08.124372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1376/2771] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:02:08.129021 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041179e-e5a0-44eb-9728-57cfa8038cb1 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:08.146458 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041179e-e5a0-44eb-9728-57cfa8038cb1 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:08.161224 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715e3c5-bc87-48cf-a28e-d10aebd516fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:08.162259 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715e3c5-bc87-48cf-a28e-d10aebd516fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:08.162550 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715e3c5-bc87-48cf-a28e-d10aebd516fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:08.162835 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715e3c5-bc87-48cf-a28e-d10aebd516fb admin admin] PATH_INFO: `/v3/projects/87b8d1a3c6db40cbb109b5b25dcb4cea/users/5793a91d797f480c9906a55a01b2ea6c/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:08.214400 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715e3c5-bc87-48cf-a28e-d10aebd516fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=87b8d1a3c6db40cbb109b5b25dcb4cea, user_id=5793a91d797f480c9906a55a01b2ea6c, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:08.224745 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715e3c5-bc87-48cf-a28e-d10aebd516fb admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:08.263910 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1396/2772] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:02:08 2022] PUT /identity/v3/projects/87b8d1a3c6db40cbb109b5b25dcb4cea/users/5793a91d797f480c9906a55a01b2ea6c/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:08.268202 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13d422-af7d-4297-9c47-b9690d805938 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:08.286129 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13d422-af7d-4297-9c47-b9690d805938 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:08.384320 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a978cd3-c0f2-4779-b3ee-6124ec138a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:08.385411 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a978cd3-c0f2-4779-b3ee-6124ec138a85 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:08.385803 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a978cd3-c0f2-4779-b3ee-6124ec138a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:08.386913 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a978cd3-c0f2-4779-b3ee-6124ec138a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:08.389721 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a978cd3-c0f2-4779-b3ee-6124ec138a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:08.391750 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a978cd3-c0f2-4779-b3ee-6124ec138a85 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:08.404025 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1377/2773] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:02:08.408436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715e3c5-bc87-48cf-a28e-d10aebd516fb admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:08.424441 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715e3c5-bc87-48cf-a28e-d10aebd516fb admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:08.437842 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91d931-32e4-4801-8bf2-d13a60df402c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:08.440503 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91d931-32e4-4801-8bf2-d13a60df402c admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:08.440951 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91d931-32e4-4801-8bf2-d13a60df402c admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:08.441964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91d931-32e4-4801-8bf2-d13a60df402c admin admin] PATH_INFO: `/v3/projects/87b8d1a3c6db40cbb109b5b25dcb4cea/users/5793a91d797f480c9906a55a01b2ea6c/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:08.444303 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91d931-32e4-4801-8bf2-d13a60df402c admin admin] RBAC: Authorizing `identity:create_grant(project_id=87b8d1a3c6db40cbb109b5b25dcb4cea, user_id=5793a91d797f480c9906a55a01b2ea6c, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:08.447787 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91d931-32e4-4801-8bf2-d13a60df402c admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:08.471771 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1397/2774] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:02:08 2022] PUT /identity/v3/projects/87b8d1a3c6db40cbb109b5b25dcb4cea/users/5793a91d797f480c9906a55a01b2ea6c/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:08.473925 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baece5be-4c7c-4962-813d-e36382ede25f None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:08.474358 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baece5be-4c7c-4962-813d-e36382ede25f None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:08.474954 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baece5be-4c7c-4962-813d-e36382ede25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:08.543262 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-baece5be-4c7c-4962-813d-e36382ede25f None None] MFA Rules not processed for user `5793a91d797f480c9906a55a01b2ea6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:08.546737 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-baece5be-4c7c-4962-813d-e36382ede25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:08.744510 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1378/2775] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:02:08.760701 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91d931-32e4-4801-8bf2-d13a60df402c admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:08.763609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0e91d931-32e4-4801-8bf2-d13a60df402c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:08.809302 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74783938-62e5-451c-a2fc-4e5414efbe11 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:08.809988 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74783938-62e5-451c-a2fc-4e5414efbe11 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:08.810433 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74783938-62e5-451c-a2fc-4e5414efbe11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:08.863337 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-74783938-62e5-451c-a2fc-4e5414efbe11 None None] MFA Rules not processed for user `f02739ec12fa4f238244cdcbe1e3d739`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:08.865372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-74783938-62e5-451c-a2fc-4e5414efbe11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:08.956419 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91d931-32e4-4801-8bf2-d13a60df402c admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:08.970472 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cab805-19c9-40d4-901b-2aabf1d5d152 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:08.971150 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cab805-19c9-40d4-901b-2aabf1d5d152 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:08.971441 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cab805-19c9-40d4-901b-2aabf1d5d152 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:08.971954 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cab805-19c9-40d4-901b-2aabf1d5d152 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:08.992392 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cab805-19c9-40d4-901b-2aabf1d5d152 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:08.993874 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cab805-19c9-40d4-901b-2aabf1d5d152 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:09.003766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:09.022880 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1398/2776] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:02:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:02:09.060363 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1379/2777] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:02:09.065360 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cab805-19c9-40d4-901b-2aabf1d5d152 service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:09.066024 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74783938-62e5-451c-a2fc-4e5414efbe11 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:09.068716 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b6cab805-19c9-40d4-901b-2aabf1d5d152 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:09.200666 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:09.203426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74783938-62e5-451c-a2fc-4e5414efbe11 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:09.217190 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1252d6-7504-4c07-8368-8588fec0f7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:09.221713 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1252d6-7504-4c07-8368-8588fec0f7fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:09.222296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1252d6-7504-4c07-8368-8588fec0f7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:09.223031 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1252d6-7504-4c07-8368-8588fec0f7fe admin admin] PATH_INFO: `/v3/users/72eda1dc27bf4422b64d319f2d63e44c` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:09.227679 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1252d6-7504-4c07-8368-8588fec0f7fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=72eda1dc27bf4422b64d319f2d63e44c)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:09.232074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1252d6-7504-4c07-8368-8588fec0f7fe admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:09.242170 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cab805-19c9-40d4-901b-2aabf1d5d152 service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:09.249065 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd16a4-a62f-40d5-b3d6-9474becdf051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:09.250391 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd16a4-a62f-40d5-b3d6-9474becdf051 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:09.250805 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd16a4-a62f-40d5-b3d6-9474becdf051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:09.251272 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd16a4-a62f-40d5-b3d6-9474becdf051 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:09.252183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd16a4-a62f-40d5-b3d6-9474becdf051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:09.255672 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd16a4-a62f-40d5-b3d6-9474becdf051 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:09.307449 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1399/2778] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:02:09 2022] POST /identity/v3/projects => generated 377 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:02:09.309722 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd16a4-a62f-40d5-b3d6-9474becdf051 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:09.360150 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-ee1252d6-7504-4c07-8368-8588fec0f7fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72eda1dc27bf4422b64d319f2d63e44c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:09.375443 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-ee1252d6-7504-4c07-8368-8588fec0f7fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72eda1dc27bf4422b64d319f2d63e44c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:09.376663 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-ee1252d6-7504-4c07-8368-8588fec0f7fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72eda1dc27bf4422b64d319f2d63e44c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:09.377626 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-ee1252d6-7504-4c07-8368-8588fec0f7fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72eda1dc27bf4422b64d319f2d63e44c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:09.421904 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-ee1252d6-7504-4c07-8368-8588fec0f7fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72eda1dc27bf4422b64d319f2d63e44c'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:09.467287 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1380/2779] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:02:09 2022] DELETE /identity/v3/users/72eda1dc27bf4422b64d319f2d63e44c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:09.472246 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cd825-562e-4a91-853d-9beab766441d None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:09.472535 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cd825-562e-4a91-853d-9beab766441d None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:09.472821 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cd825-562e-4a91-853d-9beab766441d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:09.492426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-a00cd825-562e-4a91-853d-9beab766441d None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:09.499286 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a00cd825-562e-4a91-853d-9beab766441d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:09.502802 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd16a4-a62f-40d5-b3d6-9474becdf051 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:09.595839 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99f723-0e81-4d26-8b88-62d600e6974e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:09.597482 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99f723-0e81-4d26-8b88-62d600e6974e admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:09.598047 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99f723-0e81-4d26-8b88-62d600e6974e admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:09.598285 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99f723-0e81-4d26-8b88-62d600e6974e admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:09.599517 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99f723-0e81-4d26-8b88-62d600e6974e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:09.601727 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1381/2780] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:02:09.612700 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cd825-562e-4a91-853d-9beab766441d None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:09.613035 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99f723-0e81-4d26-8b88-62d600e6974e admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:09.614471 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-a00cd825-562e-4a91-853d-9beab766441d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:09.635052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:09.654932 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1400/2781] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:02:09 2022] POST /identity/v3/users => generated 295 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:02:09.656165 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99f723-0e81-4d26-8b88-62d600e6974e admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:09.658002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4e99f723-0e81-4d26-8b88-62d600e6974e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:09.676577 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99f723-0e81-4d26-8b88-62d600e6974e admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:09.684654 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958fe09-3258-45ef-9b89-638fd274a6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:09.685409 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958fe09-3258-45ef-9b89-638fd274a6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:09.685926 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958fe09-3258-45ef-9b89-638fd274a6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:09.686243 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958fe09-3258-45ef-9b89-638fd274a6d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:09.686997 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958fe09-3258-45ef-9b89-638fd274a6d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:09.688637 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958fe09-3258-45ef-9b89-638fd274a6d9 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:09.701002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1401/2782] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:02:09.711878 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958fe09-3258-45ef-9b89-638fd274a6d9 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:09.714095 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cd825-562e-4a91-853d-9beab766441d None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:09.718855 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b7132-9ffb-477d-b63d-03b90070cc2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:09.720404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b7132-9ffb-477d-b63d-03b90070cc2f service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:09.720803 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b7132-9ffb-477d-b63d-03b90070cc2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:09.721482 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b7132-9ffb-477d-b63d-03b90070cc2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:09.723854 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958fe09-3258-45ef-9b89-638fd274a6d9 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:09.730329 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe93d86-a264-429e-98ce-9adc1f9333b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:09.731414 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe93d86-a264-429e-98ce-9adc1f9333b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:09.731700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe93d86-a264-429e-98ce-9adc1f9333b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:09.731983 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe93d86-a264-429e-98ce-9adc1f9333b7 admin admin] PATH_INFO: `/v3/projects/225ddb468dc64ffaa5a9bce5365ef606/users/e4665744fd984d8caa03840ec0e40b50/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:09.737652 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b7132-9ffb-477d-b63d-03b90070cc2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:09.739456 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b7132-9ffb-477d-b63d-03b90070cc2f service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:09.753950 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1382/2783] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:02:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:02:09.772359 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe93d86-a264-429e-98ce-9adc1f9333b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=225ddb468dc64ffaa5a9bce5365ef606, user_id=e4665744fd984d8caa03840ec0e40b50, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:09.775520 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe93d86-a264-429e-98ce-9adc1f9333b7 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:09.808145 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1402/2784] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:02:09 2022] PUT /identity/v3/projects/225ddb468dc64ffaa5a9bce5365ef606/users/e4665744fd984d8caa03840ec0e40b50/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:09.812349 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b7132-9ffb-477d-b63d-03b90070cc2f service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:09.830649 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b7132-9ffb-477d-b63d-03b90070cc2f service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:09.965426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0445904-a96e-402f-937f-a4711d1bbcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:09.966181 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0445904-a96e-402f-937f-a4711d1bbcf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:09.966441 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0445904-a96e-402f-937f-a4711d1bbcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:09.966769 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0445904-a96e-402f-937f-a4711d1bbcf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:09.967535 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0445904-a96e-402f-937f-a4711d1bbcf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:09.975877 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0445904-a96e-402f-937f-a4711d1bbcf4 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:09.993564 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1383/2785] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:02:09.997616 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe93d86-a264-429e-98ce-9adc1f9333b7 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:10.016098 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe93d86-a264-429e-98ce-9adc1f9333b7 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:10.030680 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe84ff7-7dde-4d83-b0c8-f63896e051c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:10.031612 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe84ff7-7dde-4d83-b0c8-f63896e051c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:10.031899 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe84ff7-7dde-4d83-b0c8-f63896e051c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:10.034178 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe84ff7-7dde-4d83-b0c8-f63896e051c9 admin admin] PATH_INFO: `/v3/projects/225ddb468dc64ffaa5a9bce5365ef606/users/e4665744fd984d8caa03840ec0e40b50/roles/24aa6040c86049f996560e477e83886f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:10.041622 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe84ff7-7dde-4d83-b0c8-f63896e051c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=225ddb468dc64ffaa5a9bce5365ef606, user_id=e4665744fd984d8caa03840ec0e40b50, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:10.044460 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe84ff7-7dde-4d83-b0c8-f63896e051c9 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:10.079200 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1403/2786] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:02:09 2022] PUT /identity/v3/projects/225ddb468dc64ffaa5a9bce5365ef606/users/e4665744fd984d8caa03840ec0e40b50/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:10.223844 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0445904-a96e-402f-937f-a4711d1bbcf4 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:10.226560 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d0445904-a96e-402f-937f-a4711d1bbcf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:10.252046 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0445904-a96e-402f-937f-a4711d1bbcf4 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:10.406614 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d471a5-32cc-448f-82e6-775a54b8538b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:10.407564 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d471a5-32cc-448f-82e6-775a54b8538b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:10.407849 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d471a5-32cc-448f-82e6-775a54b8538b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:10.408133 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d471a5-32cc-448f-82e6-775a54b8538b admin admin] PATH_INFO: `/v3/projects/489849af94cc47069b6f093fa4f74986` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:10.409649 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d471a5-32cc-448f-82e6-775a54b8538b admin admin] RBAC: Authorizing `identity:delete_project(project_id=489849af94cc47069b6f093fa4f74986)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:10.412639 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d471a5-32cc-448f-82e6-775a54b8538b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:10.514677 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-77d471a5-32cc-448f-82e6-775a54b8538b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '489849af94cc47069b6f093fa4f74986', 'request_id': 'req-77d471a5-32cc-448f-82e6-775a54b8538b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:10.518993 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:10.534412 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-77d471a5-32cc-448f-82e6-775a54b8538b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '489849af94cc47069b6f093fa4f74986', 'request_id': 'req-77d471a5-32cc-448f-82e6-775a54b8538b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:10.543744 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-77d471a5-32cc-448f-82e6-775a54b8538b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '489849af94cc47069b6f093fa4f74986', 'request_id': 'req-77d471a5-32cc-448f-82e6-775a54b8538b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:10.561764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-77d471a5-32cc-448f-82e6-775a54b8538b admin admin] The token cache is being invalidate because project 489849af94cc47069b6f093fa4f74986 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:02:10.562125 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-77d471a5-32cc-448f-82e6-775a54b8538b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:10.562841 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-77d471a5-32cc-448f-82e6-775a54b8538b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:10.565236 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1384/2787] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:02:10 2022] DELETE /identity/v3/projects/489849af94cc47069b6f093fa4f74986 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:10.570133 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe84ff7-7dde-4d83-b0c8-f63896e051c9 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:10.573477 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-bbe84ff7-7dde-4d83-b0c8-f63896e051c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:10.602124 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe84ff7-7dde-4d83-b0c8-f63896e051c9 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:10.628326 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd686f1-6409-4a24-bf4e-458894528270 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:10.629250 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd686f1-6409-4a24-bf4e-458894528270 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:10.629980 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd686f1-6409-4a24-bf4e-458894528270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:10.653227 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:10.688452 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-0fd686f1-6409-4a24-bf4e-458894528270 None None] MFA Rules not processed for user `bab1bde41c394c519663217f6466033e`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:10.689967 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-0fd686f1-6409-4a24-bf4e-458894528270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:10.740490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55323d45-7509-4c0d-9828-f0f1206a9de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:10.742287 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55323d45-7509-4c0d-9828-f0f1206a9de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:10.742907 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55323d45-7509-4c0d-9828-f0f1206a9de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:10.743360 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55323d45-7509-4c0d-9828-f0f1206a9de4 admin admin] PATH_INFO: `/v3/users/5793a91d797f480c9906a55a01b2ea6c` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:10.745090 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55323d45-7509-4c0d-9828-f0f1206a9de4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5793a91d797f480c9906a55a01b2ea6c)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:10.747746 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55323d45-7509-4c0d-9828-f0f1206a9de4 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:10.787768 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1385/2788] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:02:10.792603 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd686f1-6409-4a24-bf4e-458894528270 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:10.794944 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-0fd686f1-6409-4a24-bf4e-458894528270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:10.812598 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd686f1-6409-4a24-bf4e-458894528270 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:10.817462 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-55323d45-7509-4c0d-9828-f0f1206a9de4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5793a91d797f480c9906a55a01b2ea6c'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:10.820016 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a35805-6267-4884-ac28-7ab95fe646f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:10.820710 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a35805-6267-4884-ac28-7ab95fe646f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:10.820983 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a35805-6267-4884-ac28-7ab95fe646f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:10.821311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a35805-6267-4884-ac28-7ab95fe646f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:10.822062 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a35805-6267-4884-ac28-7ab95fe646f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:10.824277 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a35805-6267-4884-ac28-7ab95fe646f3 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:10.828168 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-55323d45-7509-4c0d-9828-f0f1206a9de4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5793a91d797f480c9906a55a01b2ea6c'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:10.829468 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-55323d45-7509-4c0d-9828-f0f1206a9de4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5793a91d797f480c9906a55a01b2ea6c'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:10.855287 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-55323d45-7509-4c0d-9828-f0f1206a9de4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5793a91d797f480c9906a55a01b2ea6c'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:10.868181 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1386/2789] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:02:10 2022] POST /identity/v3/projects => generated 383 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 06:02:10.872090 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a35805-6267-4884-ac28-7ab95fe646f3 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:10.887844 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-55323d45-7509-4c0d-9828-f0f1206a9de4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5793a91d797f480c9906a55a01b2ea6c'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:10.909787 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1404/2790] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:02:10 2022] DELETE /identity/v3/users/5793a91d797f480c9906a55a01b2ea6c => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:10.993586 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a35805-6267-4884-ac28-7ab95fe646f3 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:11.052230 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:11.060968 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa36359-68df-4cfc-95b5-fd5aa3244a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:11.061886 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa36359-68df-4cfc-95b5-fd5aa3244a25 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:11.062266 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa36359-68df-4cfc-95b5-fd5aa3244a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:11.062553 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa36359-68df-4cfc-95b5-fd5aa3244a25 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:11.063339 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa36359-68df-4cfc-95b5-fd5aa3244a25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:11.065398 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa36359-68df-4cfc-95b5-fd5aa3244a25 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:11.088545 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1387/2791] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:02:10 2022] POST /identity/v3/users => generated 298 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:02:11.092550 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55323d45-7509-4c0d-9828-f0f1206a9de4 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:11.094710 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-55323d45-7509-4c0d-9828-f0f1206a9de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:11.110868 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55323d45-7509-4c0d-9828-f0f1206a9de4 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:11.117159 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bfbe6-e9a3-45a3-97e7-09da63c7d4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:11.118185 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bfbe6-e9a3-45a3-97e7-09da63c7d4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:11.118639 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bfbe6-e9a3-45a3-97e7-09da63c7d4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:11.118933 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bfbe6-e9a3-45a3-97e7-09da63c7d4b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:11.119692 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bfbe6-e9a3-45a3-97e7-09da63c7d4b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:11.121485 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bfbe6-e9a3-45a3-97e7-09da63c7d4b0 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:11.133155 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1405/2792] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 06:02:11.138071 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa36359-68df-4cfc-95b5-fd5aa3244a25 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:11.148945 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa36359-68df-4cfc-95b5-fd5aa3244a25 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:11.153859 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c1917-bb62-40c6-810c-4d7050c561c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:11.154809 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c1917-bb62-40c6-810c-4d7050c561c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:11.155101 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c1917-bb62-40c6-810c-4d7050c561c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:11.155384 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c1917-bb62-40c6-810c-4d7050c561c2 admin admin] PATH_INFO: `/v3/projects/0e54a126afc548aaaaf577664847bbac/users/0e48a48623844f649e91de94866653d0/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:11.172108 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c1917-bb62-40c6-810c-4d7050c561c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e54a126afc548aaaaf577664847bbac, user_id=0e48a48623844f649e91de94866653d0, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:11.174846 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c1917-bb62-40c6-810c-4d7050c561c2 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:11.198058 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1388/2793] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:02:11 2022] PUT /identity/v3/projects/0e54a126afc548aaaaf577664847bbac/users/0e48a48623844f649e91de94866653d0/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:11.202154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bfbe6-e9a3-45a3-97e7-09da63c7d4b0 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:11.212876 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bfbe6-e9a3-45a3-97e7-09da63c7d4b0 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:11.319959 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0915974-0a4b-45b3-91a2-2522f0a3f6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:11.320947 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0915974-0a4b-45b3-91a2-2522f0a3f6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:11.321392 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0915974-0a4b-45b3-91a2-2522f0a3f6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:11.321828 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0915974-0a4b-45b3-91a2-2522f0a3f6d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:11.326422 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0915974-0a4b-45b3-91a2-2522f0a3f6d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:11.328181 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0915974-0a4b-45b3-91a2-2522f0a3f6d8 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:11.349276 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1406/2794] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:02:11.354946 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c1917-bb62-40c6-810c-4d7050c561c2 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:11.369432 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c1917-bb62-40c6-810c-4d7050c561c2 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:11.377918 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e2e43-5063-41e7-82f7-4ad1a33de6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:11.378860 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e2e43-5063-41e7-82f7-4ad1a33de6b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:11.379147 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e2e43-5063-41e7-82f7-4ad1a33de6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:11.379498 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e2e43-5063-41e7-82f7-4ad1a33de6b0 admin admin] PATH_INFO: `/v3/projects/0e54a126afc548aaaaf577664847bbac/users/0e48a48623844f649e91de94866653d0/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:11.381559 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e2e43-5063-41e7-82f7-4ad1a33de6b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e54a126afc548aaaaf577664847bbac, user_id=0e48a48623844f649e91de94866653d0, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:11.384681 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e2e43-5063-41e7-82f7-4ad1a33de6b0 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:11.425154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1389/2795] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:02:11 2022] PUT /identity/v3/projects/0e54a126afc548aaaaf577664847bbac/users/0e48a48623844f649e91de94866653d0/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:11.490636 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0915974-0a4b-45b3-91a2-2522f0a3f6d8 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:11.493978 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e0915974-0a4b-45b3-91a2-2522f0a3f6d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:11.512133 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0915974-0a4b-45b3-91a2-2522f0a3f6d8 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:11.558207 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:11.657403 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f94c0-b6ef-43da-bde1-0fb478b53c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:11.659697 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f94c0-b6ef-43da-bde1-0fb478b53c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:11.660127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f94c0-b6ef-43da-bde1-0fb478b53c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:11.660525 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f94c0-b6ef-43da-bde1-0fb478b53c5d admin admin] PATH_INFO: `/v3/projects/87b8d1a3c6db40cbb109b5b25dcb4cea` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:11.662434 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f94c0-b6ef-43da-bde1-0fb478b53c5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=87b8d1a3c6db40cbb109b5b25dcb4cea)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:11.666479 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f94c0-b6ef-43da-bde1-0fb478b53c5d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:11.746889 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-964f94c0-b6ef-43da-bde1-0fb478b53c5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87b8d1a3c6db40cbb109b5b25dcb4cea', 'request_id': 'req-964f94c0-b6ef-43da-bde1-0fb478b53c5d'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:11.754204 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-964f94c0-b6ef-43da-bde1-0fb478b53c5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87b8d1a3c6db40cbb109b5b25dcb4cea', 'request_id': 'req-964f94c0-b6ef-43da-bde1-0fb478b53c5d'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:11.763023 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-964f94c0-b6ef-43da-bde1-0fb478b53c5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87b8d1a3c6db40cbb109b5b25dcb4cea', 'request_id': 'req-964f94c0-b6ef-43da-bde1-0fb478b53c5d'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:11.784253 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-964f94c0-b6ef-43da-bde1-0fb478b53c5d admin admin] The token cache is being invalidate because project 87b8d1a3c6db40cbb109b5b25dcb4cea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:02:11.784511 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-964f94c0-b6ef-43da-bde1-0fb478b53c5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:11.786106 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-964f94c0-b6ef-43da-bde1-0fb478b53c5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:11.792439 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1407/2796] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:02:11 2022] DELETE /identity/v3/projects/87b8d1a3c6db40cbb109b5b25dcb4cea => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:11.797305 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abff02-45ac-4842-8c27-2b6931e40dae None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:11.797853 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abff02-45ac-4842-8c27-2b6931e40dae None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:11.798047 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abff02-45ac-4842-8c27-2b6931e40dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:11.822661 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-24abff02-45ac-4842-8c27-2b6931e40dae None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:11.823905 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-24abff02-45ac-4842-8c27-2b6931e40dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:11.910503 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1390/2797] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:02:11.923574 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73db357-f344-4cb5-bbae-16c62b8c565e None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:11.924047 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73db357-f344-4cb5-bbae-16c62b8c565e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:11.924359 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73db357-f344-4cb5-bbae-16c62b8c565e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:11.956766 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-b73db357-f344-4cb5-bbae-16c62b8c565e None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:11.958300 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b73db357-f344-4cb5-bbae-16c62b8c565e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:11.985564 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1408/2798] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:02:11.991640 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abff02-45ac-4842-8c27-2b6931e40dae None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:12.010408 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abff02-45ac-4842-8c27-2b6931e40dae None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:12.025220 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f5fa2-a150-4780-b209-f040aeb494b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:12.026098 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f5fa2-a150-4780-b209-f040aeb494b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:12.026388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f5fa2-a150-4780-b209-f040aeb494b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:12.030225 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f5fa2-a150-4780-b209-f040aeb494b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:12.035990 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f5fa2-a150-4780-b209-f040aeb494b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 06:02:12.036317 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f5fa2-a150-4780-b209-f040aeb494b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:12.046256 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f5fa2-a150-4780-b209-f040aeb494b9 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:12.084359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1391/2799] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 06:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 06:02:12.094882 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73db357-f344-4cb5-bbae-16c62b8c565e None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:12.118013 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73db357-f344-4cb5-bbae-16c62b8c565e None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:12.136524 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ac1f6-b54a-4ae6-bc98-e358e968f9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:12.137843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ac1f6-b54a-4ae6-bc98-e358e968f9a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:12.138969 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ac1f6-b54a-4ae6-bc98-e358e968f9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:12.139614 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ac1f6-b54a-4ae6-bc98-e358e968f9a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:12.140876 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ac1f6-b54a-4ae6-bc98-e358e968f9a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:12.153529 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ac1f6-b54a-4ae6-bc98-e358e968f9a2 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:12.212317 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1409/2800] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:02:12 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:02:12.216519 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f5fa2-a150-4780-b209-f040aeb494b9 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:12.235388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f5fa2-a150-4780-b209-f040aeb494b9 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:12.400920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996a320-2840-458c-99ec-673ba492bb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:12.401889 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996a320-2840-458c-99ec-673ba492bb2a admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:12.402829 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996a320-2840-458c-99ec-673ba492bb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:12.403282 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996a320-2840-458c-99ec-673ba492bb2a admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:12.404186 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996a320-2840-458c-99ec-673ba492bb2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:12.406908 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996a320-2840-458c-99ec-673ba492bb2a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:12.447174 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1392/2801] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:02:12 2022] POST /identity/v3/users => generated 291 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:02:12.452247 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ac1f6-b54a-4ae6-bc98-e358e968f9a2 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:12.471822 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ac1f6-b54a-4ae6-bc98-e358e968f9a2 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:12.478159 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c820b-72cc-46f7-9b19-dd22d679befd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:12.479274 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c820b-72cc-46f7-9b19-dd22d679befd admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:12.479558 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c820b-72cc-46f7-9b19-dd22d679befd admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:12.479837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c820b-72cc-46f7-9b19-dd22d679befd admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:12.488582 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c820b-72cc-46f7-9b19-dd22d679befd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:12.490487 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c820b-72cc-46f7-9b19-dd22d679befd admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:12.525196 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1410/2802] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:02:12.530157 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996a320-2840-458c-99ec-673ba492bb2a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:12.555709 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996a320-2840-458c-99ec-673ba492bb2a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:12.579061 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19271d5-12aa-4c1e-b8bb-857bdae4d153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:12.582248 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19271d5-12aa-4c1e-b8bb-857bdae4d153 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:12.582797 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19271d5-12aa-4c1e-b8bb-857bdae4d153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:12.583300 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19271d5-12aa-4c1e-b8bb-857bdae4d153 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:12.587042 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19271d5-12aa-4c1e-b8bb-857bdae4d153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:12.589969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19271d5-12aa-4c1e-b8bb-857bdae4d153 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:12.619308 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1393/2803] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:02:12.620484 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c820b-72cc-46f7-9b19-dd22d679befd admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:12.640665 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c820b-72cc-46f7-9b19-dd22d679befd admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:12.649568 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc4624-9951-47f6-80a9-33dd965eef0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:12.651479 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc4624-9951-47f6-80a9-33dd965eef0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:12.652360 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc4624-9951-47f6-80a9-33dd965eef0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:12.653107 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc4624-9951-47f6-80a9-33dd965eef0d admin admin] PATH_INFO: `/v3/projects/6e2046b44d094b64afff7efb8421c878/users/fdc42e9c89fb4912b6e89ce915d65d7e/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:12.692572 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc4624-9951-47f6-80a9-33dd965eef0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2046b44d094b64afff7efb8421c878, user_id=fdc42e9c89fb4912b6e89ce915d65d7e, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:12.703520 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc4624-9951-47f6-80a9-33dd965eef0d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:12.760364 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df52d3-2742-40f4-8046-ab768bac3e2c None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:12.760911 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df52d3-2742-40f4-8046-ab768bac3e2c None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:12.761420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df52d3-2742-40f4-8046-ab768bac3e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:12.764323 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1411/2804] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:02:12 2022] PUT /identity/v3/projects/6e2046b44d094b64afff7efb8421c878/users/fdc42e9c89fb4912b6e89ce915d65d7e/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:02:12.806912 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:12.818494 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-67df52d3-2742-40f4-8046-ab768bac3e2c None None] MFA Rules not processed for user `fdc42e9c89fb4912b6e89ce915d65d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:12.825670 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-67df52d3-2742-40f4-8046-ab768bac3e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:12.987176 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1394/2805] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:02:12.988667 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc4624-9951-47f6-80a9-33dd965eef0d admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:13.139691 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:13.189234 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc4624-9951-47f6-80a9-33dd965eef0d admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:13.204853 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b92186-e4b0-4c68-b46f-741fae620195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:13.207374 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b92186-e4b0-4c68-b46f-741fae620195 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:13.208587 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b92186-e4b0-4c68-b46f-741fae620195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:13.209348 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b92186-e4b0-4c68-b46f-741fae620195 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:13.211295 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b92186-e4b0-4c68-b46f-741fae620195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:13.216224 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b92186-e4b0-4c68-b46f-741fae620195 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:13.325180 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df52d3-2742-40f4-8046-ab768bac3e2c None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:13.335843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1412/2806] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:02:12 2022] POST /identity/v3/projects => generated 381 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:02:13.342296 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df52d3-2742-40f4-8046-ab768bac3e2c None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:13.516283 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177020b-d258-4da4-9acd-33e419878329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:13.517003 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177020b-d258-4da4-9acd-33e419878329 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:13.517284 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177020b-d258-4da4-9acd-33e419878329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:13.517559 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177020b-d258-4da4-9acd-33e419878329 admin admin] PATH_INFO: `/v3/users` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:13.518372 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177020b-d258-4da4-9acd-33e419878329 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:13.525729 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177020b-d258-4da4-9acd-33e419878329 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:13.605195 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b92186-e4b0-4c68-b46f-741fae620195 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:13.607168 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1395/2807] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:02:13 2022] POST /identity/v3/users => generated 297 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:02:13.637501 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b92186-e4b0-4c68-b46f-741fae620195 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:13.653516 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd4899-ee8f-4341-a0b7-2c0471e4a117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:13.654696 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd4899-ee8f-4341-a0b7-2c0471e4a117 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:13.655376 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd4899-ee8f-4341-a0b7-2c0471e4a117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:13.655977 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd4899-ee8f-4341-a0b7-2c0471e4a117 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:13.657707 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd4899-ee8f-4341-a0b7-2c0471e4a117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:13.666388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd4899-ee8f-4341-a0b7-2c0471e4a117 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:13.687096 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1413/2808] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 06:02:13.691345 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177020b-d258-4da4-9acd-33e419878329 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:13.705498 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177020b-d258-4da4-9acd-33e419878329 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:13.712194 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea76516-6130-4b0a-8cf9-723cefbd0a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:13.713509 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea76516-6130-4b0a-8cf9-723cefbd0a04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:13.713891 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea76516-6130-4b0a-8cf9-723cefbd0a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:13.715839 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea76516-6130-4b0a-8cf9-723cefbd0a04 admin admin] PATH_INFO: `/v3/projects/46c6277a60f9469e9be6399f85d270f8/users/78c6ee679e224b98995548abc3a69042/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:13.739268 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea76516-6130-4b0a-8cf9-723cefbd0a04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46c6277a60f9469e9be6399f85d270f8, user_id=78c6ee679e224b98995548abc3a69042, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:13.742944 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea76516-6130-4b0a-8cf9-723cefbd0a04 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:13.779448 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd4899-ee8f-4341-a0b7-2c0471e4a117 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:13.790069 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1396/2809] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:02:13 2022] PUT /identity/v3/projects/46c6277a60f9469e9be6399f85d270f8/users/78c6ee679e224b98995548abc3a69042/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:02:13.795479 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd4899-ee8f-4341-a0b7-2c0471e4a117 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:13.985521 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f73bc1-ecd4-4277-9c3b-fedee6433167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:13.993264 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f73bc1-ecd4-4277-9c3b-fedee6433167 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:13.994130 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f73bc1-ecd4-4277-9c3b-fedee6433167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:13.994658 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f73bc1-ecd4-4277-9c3b-fedee6433167 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:13.995684 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f73bc1-ecd4-4277-9c3b-fedee6433167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:13.997626 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f73bc1-ecd4-4277-9c3b-fedee6433167 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:14.017261 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1414/2810] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:02:14.021222 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea76516-6130-4b0a-8cf9-723cefbd0a04 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:14.040660 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea76516-6130-4b0a-8cf9-723cefbd0a04 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:14.055969 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec472eb1-4f91-4340-8217-f686eeaa6a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:14.057303 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec472eb1-4f91-4340-8217-f686eeaa6a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:14.057795 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec472eb1-4f91-4340-8217-f686eeaa6a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:14.058307 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec472eb1-4f91-4340-8217-f686eeaa6a92 admin admin] PATH_INFO: `/v3/projects/46c6277a60f9469e9be6399f85d270f8/users/78c6ee679e224b98995548abc3a69042/roles/24aa6040c86049f996560e477e83886f` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:14.063142 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec472eb1-4f91-4340-8217-f686eeaa6a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46c6277a60f9469e9be6399f85d270f8, user_id=78c6ee679e224b98995548abc3a69042, role_id=24aa6040c86049f996560e477e83886f)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:14.067485 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec472eb1-4f91-4340-8217-f686eeaa6a92 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:14.103170 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1397/2811] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:02:14 2022] PUT /identity/v3/projects/46c6277a60f9469e9be6399f85d270f8/users/78c6ee679e224b98995548abc3a69042/roles/24aa6040c86049f996560e477e83886f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:14.105072 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4e66c-aa50-4707-83e3-80d8cac73757 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:14.105563 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4e66c-aa50-4707-83e3-80d8cac73757 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:14.106043 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4e66c-aa50-4707-83e3-80d8cac73757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:14.183066 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-90e4e66c-aa50-4707-83e3-80d8cac73757 None None] MFA Rules not processed for user `78c6ee679e224b98995548abc3a69042`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:14.184489 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-90e4e66c-aa50-4707-83e3-80d8cac73757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:14.393181 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1415/2812] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:02:14.409189 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec472eb1-4f91-4340-8217-f686eeaa6a92 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:14.411858 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-ec472eb1-4f91-4340-8217-f686eeaa6a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:14.562857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec472eb1-4f91-4340-8217-f686eeaa6a92 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:14.573404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162e790-9da6-48bf-82ac-c546c4aa38d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:14.574129 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162e790-9da6-48bf-82ac-c546c4aa38d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:14.574412 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162e790-9da6-48bf-82ac-c546c4aa38d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:14.574687 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162e790-9da6-48bf-82ac-c546c4aa38d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:14.594822 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162e790-9da6-48bf-82ac-c546c4aa38d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:14.596455 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162e790-9da6-48bf-82ac-c546c4aa38d8 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:14.600911 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:14.638490 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1398/2813] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:02:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:02:14.743345 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4e66c-aa50-4707-83e3-80d8cac73757 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:14.765578 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4e66c-aa50-4707-83e3-80d8cac73757 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:14.796820 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac2fca-3bfa-4b80-b749-072287775761 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:14.797506 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac2fca-3bfa-4b80-b749-072287775761 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:14.797790 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac2fca-3bfa-4b80-b749-072287775761 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:14.798152 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac2fca-3bfa-4b80-b749-072287775761 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:14.926945 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:14.950148 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac2fca-3bfa-4b80-b749-072287775761 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:14.952316 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac2fca-3bfa-4b80-b749-072287775761 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:14.988436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1416/2814] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:02:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:02:15.487489 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162e790-9da6-48bf-82ac-c546c4aa38d8 service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:15.596938 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162e790-9da6-48bf-82ac-c546c4aa38d8 service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:15.606882 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a686c5-0af8-4552-a1fe-5db2934e245a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:15.608888 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a686c5-0af8-4552-a1fe-5db2934e245a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:15.609393 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a686c5-0af8-4552-a1fe-5db2934e245a admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:15.609747 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a686c5-0af8-4552-a1fe-5db2934e245a admin admin] PATH_INFO: `/v3/users/fdc42e9c89fb4912b6e89ce915d65d7e` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:15.611266 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a686c5-0af8-4552-a1fe-5db2934e245a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdc42e9c89fb4912b6e89ce915d65d7e)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:15.613303 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a686c5-0af8-4552-a1fe-5db2934e245a admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:15.699527 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-42a686c5-0af8-4552-a1fe-5db2934e245a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdc42e9c89fb4912b6e89ce915d65d7e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:15.719147 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-42a686c5-0af8-4552-a1fe-5db2934e245a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdc42e9c89fb4912b6e89ce915d65d7e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:15.720798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-42a686c5-0af8-4552-a1fe-5db2934e245a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdc42e9c89fb4912b6e89ce915d65d7e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:15.723478 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-42a686c5-0af8-4552-a1fe-5db2934e245a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdc42e9c89fb4912b6e89ce915d65d7e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:15.760329 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-42a686c5-0af8-4552-a1fe-5db2934e245a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdc42e9c89fb4912b6e89ce915d65d7e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:15.798758 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33eef8-ce09-4a1b-a349-12ca33ee80ac None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:15.799956 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33eef8-ce09-4a1b-a349-12ca33ee80ac None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:15.800461 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33eef8-ce09-4a1b-a349-12ca33ee80ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:15.803132 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1399/2815] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:02:15 2022] DELETE /identity/v3/users/fdc42e9c89fb4912b6e89ce915d65d7e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:15.837642 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-cf33eef8-ce09-4a1b-a349-12ca33ee80ac None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:15.839295 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-cf33eef8-ce09-4a1b-a349-12ca33ee80ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:15.952362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1417/2816] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:02:15.978255 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a686c5-0af8-4552-a1fe-5db2934e245a admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:15.979946 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-42a686c5-0af8-4552-a1fe-5db2934e245a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:16.096322 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a686c5-0af8-4552-a1fe-5db2934e245a admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:16.100729 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483cfc7a-efd6-4ed0-85fb-c28317ab75d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:16.101558 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cfc7a-efd6-4ed0-85fb-c28317ab75d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:16.102000 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cfc7a-efd6-4ed0-85fb-c28317ab75d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:16.102377 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cfc7a-efd6-4ed0-85fb-c28317ab75d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:16.128655 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483cfc7a-efd6-4ed0-85fb-c28317ab75d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:16.134146 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483cfc7a-efd6-4ed0-85fb-c28317ab75d7 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:16.153315 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1400/2817] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:02:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:02:16.749097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33eef8-ce09-4a1b-a349-12ca33ee80ac None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:16.750678 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-cf33eef8-ce09-4a1b-a349-12ca33ee80ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:16.770183 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33eef8-ce09-4a1b-a349-12ca33ee80ac None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:16.789037 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6e4dd-1c1a-4936-99fd-3c6aa8ba5ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:16.790826 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6e4dd-1c1a-4936-99fd-3c6aa8ba5ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:16.791121 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6e4dd-1c1a-4936-99fd-3c6aa8ba5ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:16.791410 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6e4dd-1c1a-4936-99fd-3c6aa8ba5ac0 admin admin] PATH_INFO: `/v3/projects/6e2046b44d094b64afff7efb8421c878` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:16.792847 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6e4dd-1c1a-4936-99fd-3c6aa8ba5ac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e2046b44d094b64afff7efb8421c878)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:16.794726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6e4dd-1c1a-4936-99fd-3c6aa8ba5ac0 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:16.874788 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0ff6e4dd-1c1a-4936-99fd-3c6aa8ba5ac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e2046b44d094b64afff7efb8421c878', 'request_id': 'req-0ff6e4dd-1c1a-4936-99fd-3c6aa8ba5ac0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:16.885266 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0ff6e4dd-1c1a-4936-99fd-3c6aa8ba5ac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e2046b44d094b64afff7efb8421c878', 'request_id': 'req-0ff6e4dd-1c1a-4936-99fd-3c6aa8ba5ac0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:16.893899 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0ff6e4dd-1c1a-4936-99fd-3c6aa8ba5ac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e2046b44d094b64afff7efb8421c878', 'request_id': 'req-0ff6e4dd-1c1a-4936-99fd-3c6aa8ba5ac0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:16.916315 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0ff6e4dd-1c1a-4936-99fd-3c6aa8ba5ac0 admin admin] The token cache is being invalidate because project 6e2046b44d094b64afff7efb8421c878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:02:16.916883 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0ff6e4dd-1c1a-4936-99fd-3c6aa8ba5ac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:16.917866 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0ff6e4dd-1c1a-4936-99fd-3c6aa8ba5ac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:16.923645 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1418/2818] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:02:16 2022] DELETE /identity/v3/projects/6e2046b44d094b64afff7efb8421c878 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:16.924685 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483cfc7a-efd6-4ed0-85fb-c28317ab75d7 service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:16.939434 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483cfc7a-efd6-4ed0-85fb-c28317ab75d7 service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:16.973420 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:17.025898 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c949b-c33b-43b3-aa7d-aca28827a1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:17.026923 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c949b-c33b-43b3-aa7d-aca28827a1ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:17.027438 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c949b-c33b-43b3-aa7d-aca28827a1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:17.027981 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c949b-c33b-43b3-aa7d-aca28827a1ed admin admin] PATH_INFO: `/v3/users/78c6ee679e224b98995548abc3a69042` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:17.029476 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c949b-c33b-43b3-aa7d-aca28827a1ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=78c6ee679e224b98995548abc3a69042)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:17.031883 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c949b-c33b-43b3-aa7d-aca28827a1ed admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:17.103647 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-851c949b-c33b-43b3-aa7d-aca28827a1ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78c6ee679e224b98995548abc3a69042'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:17.124495 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-851c949b-c33b-43b3-aa7d-aca28827a1ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78c6ee679e224b98995548abc3a69042'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:17.125198 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-851c949b-c33b-43b3-aa7d-aca28827a1ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78c6ee679e224b98995548abc3a69042'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:17.125882 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-851c949b-c33b-43b3-aa7d-aca28827a1ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78c6ee679e224b98995548abc3a69042'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:17.143659 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-851c949b-c33b-43b3-aa7d-aca28827a1ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78c6ee679e224b98995548abc3a69042'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:17.165565 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1401/2819] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:02:16 2022] DELETE /identity/v3/users/78c6ee679e224b98995548abc3a69042 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:17.806849 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6e4dd-1c1a-4936-99fd-3c6aa8ba5ac0 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:17.808325 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0ff6e4dd-1c1a-4936-99fd-3c6aa8ba5ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:17.844797 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6e4dd-1c1a-4936-99fd-3c6aa8ba5ac0 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:17.995686 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6415c-b620-414a-a1c3-c01a17043c52 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:17.996257 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6415c-b620-414a-a1c3-c01a17043c52 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:17.996894 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6415c-b620-414a-a1c3-c01a17043c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:18.057806 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00801355-e217-40f1-ad5b-d7c2e5459b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:18.059516 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00801355-e217-40f1-ad5b-d7c2e5459b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:18.060835 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00801355-e217-40f1-ad5b-d7c2e5459b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:18.061249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00801355-e217-40f1-ad5b-d7c2e5459b50 admin admin] PATH_INFO: `/v3/projects/46c6277a60f9469e9be6399f85d270f8` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:18.063369 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00801355-e217-40f1-ad5b-d7c2e5459b50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46c6277a60f9469e9be6399f85d270f8)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:18.066419 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00801355-e217-40f1-ad5b-d7c2e5459b50 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:18.075748 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-14c6415c-b620-414a-a1c3-c01a17043c52 None None] MFA Rules not processed for user `e4665744fd984d8caa03840ec0e40b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:18.077430 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-14c6415c-b620-414a-a1c3-c01a17043c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:18.082949 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:18.148215 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-00801355-e217-40f1-ad5b-d7c2e5459b50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46c6277a60f9469e9be6399f85d270f8', 'request_id': 'req-00801355-e217-40f1-ad5b-d7c2e5459b50'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:18.155123 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-00801355-e217-40f1-ad5b-d7c2e5459b50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46c6277a60f9469e9be6399f85d270f8', 'request_id': 'req-00801355-e217-40f1-ad5b-d7c2e5459b50'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:18.174552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-00801355-e217-40f1-ad5b-d7c2e5459b50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46c6277a60f9469e9be6399f85d270f8', 'request_id': 'req-00801355-e217-40f1-ad5b-d7c2e5459b50'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:18.201796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-00801355-e217-40f1-ad5b-d7c2e5459b50 admin admin] The token cache is being invalidate because project 46c6277a60f9469e9be6399f85d270f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:02:18.201796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-00801355-e217-40f1-ad5b-d7c2e5459b50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:18.202616 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-00801355-e217-40f1-ad5b-d7c2e5459b50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:18.207731 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1419/2820] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:02:17 2022] DELETE /identity/v3/projects/46c6277a60f9469e9be6399f85d270f8 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:18.209289 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f15d33-a2b0-472b-b128-66c400c1237a None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:18.210149 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f15d33-a2b0-472b-b128-66c400c1237a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:18.210459 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f15d33-a2b0-472b-b128-66c400c1237a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:18.234507 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-68f15d33-a2b0-472b-b128-66c400c1237a None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:18.236026 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-68f15d33-a2b0-472b-b128-66c400c1237a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:18.260496 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1402/2821] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:17 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:02:18.277206 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6415c-b620-414a-a1c3-c01a17043c52 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:18.279554 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-14c6415c-b620-414a-a1c3-c01a17043c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:18.338751 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1420/2822] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:02:18.345142 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:18.347660 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bcf07-635c-4394-bb8e-6d2f557575ab None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:18.347964 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bcf07-635c-4394-bb8e-6d2f557575ab None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:18.349681 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bcf07-635c-4394-bb8e-6d2f557575ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:18.373784 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-4e6bcf07-635c-4394-bb8e-6d2f557575ab None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:18.375509 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4e6bcf07-635c-4394-bb8e-6d2f557575ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:18.386528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1421/2823] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:02:18.390952 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bcf07-635c-4394-bb8e-6d2f557575ab None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:18.405693 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bcf07-635c-4394-bb8e-6d2f557575ab None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:18.411259 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473384a-0992-4aa3-81c9-7f574873666d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:18.412211 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473384a-0992-4aa3-81c9-7f574873666d admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:18.412634 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473384a-0992-4aa3-81c9-7f574873666d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:18.416959 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473384a-0992-4aa3-81c9-7f574873666d admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:18.418281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473384a-0992-4aa3-81c9-7f574873666d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 06:02:18.418662 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473384a-0992-4aa3-81c9-7f574873666d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:18.420400 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473384a-0992-4aa3-81c9-7f574873666d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:18.437968 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1422/2824] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 06:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 06:02:18.438150 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6415c-b620-414a-a1c3-c01a17043c52 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:18.442978 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473384a-0992-4aa3-81c9-7f574873666d admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:18.457444 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473384a-0992-4aa3-81c9-7f574873666d admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:18.464880 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464e985-07c8-469d-9fef-e494189bb850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:18.465766 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464e985-07c8-469d-9fef-e494189bb850 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:18.466267 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464e985-07c8-469d-9fef-e494189bb850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:18.466923 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464e985-07c8-469d-9fef-e494189bb850 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:18.468417 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464e985-07c8-469d-9fef-e494189bb850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:18.471986 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464e985-07c8-469d-9fef-e494189bb850 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:18.528129 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1423/2825] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:02:18 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:02:18.532072 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464e985-07c8-469d-9fef-e494189bb850 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:18.546878 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e9a3f-9764-4ef5-9924-416239ab0dd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:18.547856 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e9a3f-9764-4ef5-9924-416239ab0dd3 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:18.548359 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e9a3f-9764-4ef5-9924-416239ab0dd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:18.548651 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e9a3f-9764-4ef5-9924-416239ab0dd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:18.551432 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-2c3e9a3f-9764-4ef5-9924-416239ab0dd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:18.657089 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e9a3f-9764-4ef5-9924-416239ab0dd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:18.661117 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e9a3f-9764-4ef5-9924-416239ab0dd3 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:18.667521 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:18.680748 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464e985-07c8-469d-9fef-e494189bb850 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:18.687422 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1403/2826] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:02:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 06:02:18.690094 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89162a1-929a-44da-a398-d314360a09bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:18.690864 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89162a1-929a-44da-a398-d314360a09bc admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:18.691231 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89162a1-929a-44da-a398-d314360a09bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:18.691590 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89162a1-929a-44da-a398-d314360a09bc admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:18.692369 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89162a1-929a-44da-a398-d314360a09bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:18.694613 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89162a1-929a-44da-a398-d314360a09bc admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:18.730167 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1424/2827] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:02:18 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:02:18.732064 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e9a3f-9764-4ef5-9924-416239ab0dd3 service nova] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:18.748128 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e9a3f-9764-4ef5-9924-416239ab0dd3 service nova] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:18.758468 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d677d1a-fcd1-4021-8f35-d68a94127bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:18.759569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d677d1a-fcd1-4021-8f35-d68a94127bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:18.760023 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d677d1a-fcd1-4021-8f35-d68a94127bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:18.762956 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d677d1a-fcd1-4021-8f35-d68a94127bf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:18.764417 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d677d1a-fcd1-4021-8f35-d68a94127bf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:18.768964 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d677d1a-fcd1-4021-8f35-d68a94127bf2 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:18.795751 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89162a1-929a-44da-a398-d314360a09bc admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:18.803556 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1404/2828] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:02:18.812025 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89162a1-929a-44da-a398-d314360a09bc admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:18.822796 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91853b-b109-4883-81cb-184ee291feda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:18.823595 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91853b-b109-4883-81cb-184ee291feda admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:18.823949 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91853b-b109-4883-81cb-184ee291feda admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:18.824238 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91853b-b109-4883-81cb-184ee291feda admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:18.825068 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91853b-b109-4883-81cb-184ee291feda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:18.826843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91853b-b109-4883-81cb-184ee291feda admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:18.864082 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1425/2829] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:02:18.866073 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d677d1a-fcd1-4021-8f35-d68a94127bf2 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:18.889871 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d677d1a-fcd1-4021-8f35-d68a94127bf2 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:18.905921 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05917e57-e6a7-4e98-9afd-a7dff21b08de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:18.919248 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05917e57-e6a7-4e98-9afd-a7dff21b08de admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:18.922621 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05917e57-e6a7-4e98-9afd-a7dff21b08de admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:18.922621 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05917e57-e6a7-4e98-9afd-a7dff21b08de admin admin] PATH_INFO: `/v3/projects/c24ca4c5592f4fd9827d50639c0ad99c/users/0e40b5a330d246f089483c7b8d947bd9/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:18.951953 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05917e57-e6a7-4e98-9afd-a7dff21b08de admin admin] RBAC: Authorizing `identity:create_grant(project_id=c24ca4c5592f4fd9827d50639c0ad99c, user_id=0e40b5a330d246f089483c7b8d947bd9, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:18.963751 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05917e57-e6a7-4e98-9afd-a7dff21b08de admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:19.005388 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1405/2830] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:02:18 2022] PUT /identity/v3/projects/c24ca4c5592f4fd9827d50639c0ad99c/users/0e40b5a330d246f089483c7b8d947bd9/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:19.008184 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f5b31-60e1-470c-b1be-49818f006135 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:19.010035 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f5b31-60e1-470c-b1be-49818f006135 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:19.010434 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f5b31-60e1-470c-b1be-49818f006135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:19.103107 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-df1f5b31-60e1-470c-b1be-49818f006135 None None] MFA Rules not processed for user `0e40b5a330d246f089483c7b8d947bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:19.104470 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-df1f5b31-60e1-470c-b1be-49818f006135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:19.283480 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1426/2831] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:02:19.296625 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05917e57-e6a7-4e98-9afd-a7dff21b08de admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:19.299507 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-05917e57-e6a7-4e98-9afd-a7dff21b08de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:19.381177 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:19.422504 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05917e57-e6a7-4e98-9afd-a7dff21b08de admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:19.427186 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfaa644-f50f-4980-8171-004a24f961d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:19.427858 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfaa644-f50f-4980-8171-004a24f961d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:19.428144 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfaa644-f50f-4980-8171-004a24f961d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:19.428513 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfaa644-f50f-4980-8171-004a24f961d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:19.439225 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfaa644-f50f-4980-8171-004a24f961d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:19.440319 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfaa644-f50f-4980-8171-004a24f961d3 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:19.453082 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1406/2832] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:02:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:02:20.417106 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8da45-d017-401e-a14f-c41d4ed59165 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:20.417620 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8da45-d017-401e-a14f-c41d4ed59165 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:20.417620 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8da45-d017-401e-a14f-c41d4ed59165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:20.457362 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-5ff8da45-d017-401e-a14f-c41d4ed59165 None None] MFA Rules not processed for user `0e48a48623844f649e91de94866653d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:20.458911 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-5ff8da45-d017-401e-a14f-c41d4ed59165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:20.589306 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1427/2833] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:02:20.605300 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfaa644-f50f-4980-8171-004a24f961d3 service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:20.607450 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-1dfaa644-f50f-4980-8171-004a24f961d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:20.721193 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfaa644-f50f-4980-8171-004a24f961d3 service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:20.732750 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2734b0c-3057-4f88-ad25-e896816392f4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44776834b134ae98fa28d4741cc4ec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:20.733433 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2734b0c-3057-4f88-ad25-e896816392f4 service glance] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:20.733721 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2734b0c-3057-4f88-ad25-e896816392f4 service glance] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:20.734052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2734b0c-3057-4f88-ad25-e896816392f4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:20.735972 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f2734b0c-3057-4f88-ad25-e896816392f4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:20.821724 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2734b0c-3057-4f88-ad25-e896816392f4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:20.829738 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2734b0c-3057-4f88-ad25-e896816392f4 service glance] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:20.842273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1407/2834] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:02:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:02:20.989157 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5e167-ab8a-430d-bfbb-6209534bdb2f None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:20.989451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5e167-ab8a-430d-bfbb-6209534bdb2f None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:20.989745 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5e167-ab8a-430d-bfbb-6209534bdb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:21.028464 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-0be5e167-ab8a-430d-bfbb-6209534bdb2f None None] MFA Rules not processed for user `af8e0eb5ff8c40ae848929780d99e72d`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:21.029059 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0be5e167-ab8a-430d-bfbb-6209534bdb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:21.126761 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:21.147325 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1428/2835] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jun 21 06:02:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:02:21.218441 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2734b0c-3057-4f88-ad25-e896816392f4 service glance] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:21.220306 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f2734b0c-3057-4f88-ad25-e896816392f4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:21.336882 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2734b0c-3057-4f88-ad25-e896816392f4 service glance] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:21.343327 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade446f9-35b7-48f3-9b9f-932ccdc2c80e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac485a336d8b4360bce4f495bd02dbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:21.344141 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade446f9-35b7-48f3-9b9f-932ccdc2c80e service swift] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:21.345173 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade446f9-35b7-48f3-9b9f-932ccdc2c80e service swift] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:21.345173 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade446f9-35b7-48f3-9b9f-932ccdc2c80e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:21.357714 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade446f9-35b7-48f3-9b9f-932ccdc2c80e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:21.363400 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade446f9-35b7-48f3-9b9f-932ccdc2c80e service swift] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:21.386986 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1408/2836] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 21 06:02:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 06:02:22.529532 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5e167-ab8a-430d-bfbb-6209534bdb2f None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:22.687818 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5e167-ab8a-430d-bfbb-6209534bdb2f None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:22.694366 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620c4e6-e003-453d-b642-0a70e8d24992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:22.697454 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620c4e6-e003-453d-b642-0a70e8d24992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:22.697978 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620c4e6-e003-453d-b642-0a70e8d24992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:22.698567 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620c4e6-e003-453d-b642-0a70e8d24992 admin admin] PATH_INFO: `/v3/users/0e40b5a330d246f089483c7b8d947bd9` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:22.705691 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620c4e6-e003-453d-b642-0a70e8d24992 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e40b5a330d246f089483c7b8d947bd9)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:22.707847 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620c4e6-e003-453d-b642-0a70e8d24992 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:22.822114 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e620c4e6-e003-453d-b642-0a70e8d24992 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e40b5a330d246f089483c7b8d947bd9'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:22.833103 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e620c4e6-e003-453d-b642-0a70e8d24992 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e40b5a330d246f089483c7b8d947bd9'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:22.834302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e620c4e6-e003-453d-b642-0a70e8d24992 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e40b5a330d246f089483c7b8d947bd9'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:22.853007 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e620c4e6-e003-453d-b642-0a70e8d24992 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e40b5a330d246f089483c7b8d947bd9'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:22.879357 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e620c4e6-e003-453d-b642-0a70e8d24992 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e40b5a330d246f089483c7b8d947bd9'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:22.901043 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1429/2837] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:02:22 2022] DELETE /identity/v3/users/0e40b5a330d246f089483c7b8d947bd9 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:22.905897 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b9c9b-00ca-40dd-8195-de0badd189cf None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:22.909435 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b9c9b-00ca-40dd-8195-de0badd189cf None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:22.910156 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b9c9b-00ca-40dd-8195-de0badd189cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:22.949030 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-f66b9c9b-00ca-40dd-8195-de0badd189cf None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:22.951189 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f66b9c9b-00ca-40dd-8195-de0badd189cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:22.967174 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=100 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:23.179038 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1409/2838] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:02:23.189213 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620c4e6-e003-453d-b642-0a70e8d24992 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:23.191021 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e620c4e6-e003-453d-b642-0a70e8d24992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:23.325235 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620c4e6-e003-453d-b642-0a70e8d24992 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:23.350625 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77516f0d-c1a6-4a28-a896-c9e457668381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:23.351438 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77516f0d-c1a6-4a28-a896-c9e457668381 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:23.351913 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77516f0d-c1a6-4a28-a896-c9e457668381 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:23.352218 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77516f0d-c1a6-4a28-a896-c9e457668381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:23.377836 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77516f0d-c1a6-4a28-a896-c9e457668381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:23.380224 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77516f0d-c1a6-4a28-a896-c9e457668381 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:23.407931 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1430/2839] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:02:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 06:02:24.020405 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b9c9b-00ca-40dd-8195-de0badd189cf None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:24.022999 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f66b9c9b-00ca-40dd-8195-de0badd189cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:24.061625 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b9c9b-00ca-40dd-8195-de0badd189cf None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:24.072419 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20a05e-7bba-4703-ad33-3bb1a2b4ae75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:24.073732 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20a05e-7bba-4703-ad33-3bb1a2b4ae75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:24.074136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20a05e-7bba-4703-ad33-3bb1a2b4ae75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:24.074426 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20a05e-7bba-4703-ad33-3bb1a2b4ae75 admin admin] PATH_INFO: `/v3/projects/c24ca4c5592f4fd9827d50639c0ad99c` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:24.076367 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20a05e-7bba-4703-ad33-3bb1a2b4ae75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c24ca4c5592f4fd9827d50639c0ad99c)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:24.079710 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20a05e-7bba-4703-ad33-3bb1a2b4ae75 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:24.190761 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7b20a05e-7bba-4703-ad33-3bb1a2b4ae75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c24ca4c5592f4fd9827d50639c0ad99c', 'request_id': 'req-7b20a05e-7bba-4703-ad33-3bb1a2b4ae75'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:24.208020 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7b20a05e-7bba-4703-ad33-3bb1a2b4ae75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c24ca4c5592f4fd9827d50639c0ad99c', 'request_id': 'req-7b20a05e-7bba-4703-ad33-3bb1a2b4ae75'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:24.222574 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7b20a05e-7bba-4703-ad33-3bb1a2b4ae75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c24ca4c5592f4fd9827d50639c0ad99c', 'request_id': 'req-7b20a05e-7bba-4703-ad33-3bb1a2b4ae75'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:24.241905 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7b20a05e-7bba-4703-ad33-3bb1a2b4ae75 admin admin] The token cache is being invalidate because project c24ca4c5592f4fd9827d50639c0ad99c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:02:24.242251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7b20a05e-7bba-4703-ad33-3bb1a2b4ae75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:24.242951 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-7b20a05e-7bba-4703-ad33-3bb1a2b4ae75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:24.245029 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1410/2840] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:02:24 2022] DELETE /identity/v3/projects/c24ca4c5592f4fd9827d50639c0ad99c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:24.249399 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80df4d8-e40f-4ab9-be20-60ba6e4a0d7b None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:24.249785 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80df4d8-e40f-4ab9-be20-60ba6e4a0d7b None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:24.250025 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80df4d8-e40f-4ab9-be20-60ba6e4a0d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:24.272770 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-a80df4d8-e40f-4ab9-be20-60ba6e4a0d7b None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:24.276298 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a80df4d8-e40f-4ab9-be20-60ba6e4a0d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:24.297468 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:24.371525 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1431/2841] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:02:24.379167 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4f315-0797-41e9-9d1e-80224dd87081 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:24.379796 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4f315-0797-41e9-9d1e-80224dd87081 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:24.380279 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4f315-0797-41e9-9d1e-80224dd87081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:24.403712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-bfe4f315-0797-41e9-9d1e-80224dd87081 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:24.405355 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-bfe4f315-0797-41e9-9d1e-80224dd87081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:24.414521 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1411/2842] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:02:24.418863 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80df4d8-e40f-4ab9-be20-60ba6e4a0d7b None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:24.430524 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80df4d8-e40f-4ab9-be20-60ba6e4a0d7b None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:24.435395 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f362f0-f633-40a7-9d80-58e6f13837d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:24.436093 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f362f0-f633-40a7-9d80-58e6f13837d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:24.436383 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f362f0-f633-40a7-9d80-58e6f13837d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:24.436811 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f362f0-f633-40a7-9d80-58e6f13837d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:24.437567 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f362f0-f633-40a7-9d80-58e6f13837d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 06:02:24.437881 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f362f0-f633-40a7-9d80-58e6f13837d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:24.439578 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f362f0-f633-40a7-9d80-58e6f13837d7 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:24.461741 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1432/2843] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 06:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 06:02:24.466709 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4f315-0797-41e9-9d1e-80224dd87081 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:24.477496 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4f315-0797-41e9-9d1e-80224dd87081 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:24.489649 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e82ec-a3f3-4a33-927f-2e8e24b90ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:24.491145 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e82ec-a3f3-4a33-927f-2e8e24b90ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:24.491546 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e82ec-a3f3-4a33-927f-2e8e24b90ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:24.491887 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e82ec-a3f3-4a33-927f-2e8e24b90ff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:24.492801 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e82ec-a3f3-4a33-927f-2e8e24b90ff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:24.496934 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e82ec-a3f3-4a33-927f-2e8e24b90ff1 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:24.542491 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1412/2844] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:02:24 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:02:24.544534 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f362f0-f633-40a7-9d80-58e6f13837d7 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:24.556969 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f362f0-f633-40a7-9d80-58e6f13837d7 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:24.714449 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ae124-ef7d-4898-b7eb-ccdc3293d292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:24.715239 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ae124-ef7d-4898-b7eb-ccdc3293d292 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:24.715417 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ae124-ef7d-4898-b7eb-ccdc3293d292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:24.718017 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ae124-ef7d-4898-b7eb-ccdc3293d292 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:24.720881 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ae124-ef7d-4898-b7eb-ccdc3293d292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:24.727898 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ae124-ef7d-4898-b7eb-ccdc3293d292 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:24.766376 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1433/2845] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:02:24 2022] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:02:24.770442 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e82ec-a3f3-4a33-927f-2e8e24b90ff1 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:24.788693 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e82ec-a3f3-4a33-927f-2e8e24b90ff1 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:24.794811 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38ba97-0211-4f3e-a1fa-87940b8e603f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:24.795873 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38ba97-0211-4f3e-a1fa-87940b8e603f admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:24.796352 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38ba97-0211-4f3e-a1fa-87940b8e603f admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:24.796919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38ba97-0211-4f3e-a1fa-87940b8e603f admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:24.798005 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38ba97-0211-4f3e-a1fa-87940b8e603f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:24.800037 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38ba97-0211-4f3e-a1fa-87940b8e603f admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:24.819005 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1413/2846] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:02:24.822808 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ae124-ef7d-4898-b7eb-ccdc3293d292 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:24.845500 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ae124-ef7d-4898-b7eb-ccdc3293d292 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:24.854308 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3db0bb-fdd1-401a-8874-476b44731293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:24.855115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3db0bb-fdd1-401a-8874-476b44731293 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:24.855474 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3db0bb-fdd1-401a-8874-476b44731293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:24.855974 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3db0bb-fdd1-401a-8874-476b44731293 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:24.856697 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3db0bb-fdd1-401a-8874-476b44731293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:24.860747 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3db0bb-fdd1-401a-8874-476b44731293 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:24.878205 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1434/2847] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:02:24.879776 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38ba97-0211-4f3e-a1fa-87940b8e603f admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:24.897251 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38ba97-0211-4f3e-a1fa-87940b8e603f admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:24.902289 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654aec6-e957-4b4e-9688-87aaa83c6815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:24.903287 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654aec6-e957-4b4e-9688-87aaa83c6815 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:24.903643 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654aec6-e957-4b4e-9688-87aaa83c6815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:24.904118 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654aec6-e957-4b4e-9688-87aaa83c6815 admin admin] PATH_INFO: `/v3/projects/8379be5e2ff74a979856e4e16666be50/users/65b2192f5d864a29808c53f2345eed38/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:24.942977 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654aec6-e957-4b4e-9688-87aaa83c6815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8379be5e2ff74a979856e4e16666be50, user_id=65b2192f5d864a29808c53f2345eed38, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:24.946576 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654aec6-e957-4b4e-9688-87aaa83c6815 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:24.966440 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1414/2848] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:02:24 2022] PUT /identity/v3/projects/8379be5e2ff74a979856e4e16666be50/users/65b2192f5d864a29808c53f2345eed38/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:24.985999 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d342e14-1420-4ed9-a544-5494eaf59262 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:24.985999 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d342e14-1420-4ed9-a544-5494eaf59262 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:24.985999 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d342e14-1420-4ed9-a544-5494eaf59262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:25.031078 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-8d342e14-1420-4ed9-a544-5494eaf59262 None None] MFA Rules not processed for user `65b2192f5d864a29808c53f2345eed38`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:25.032598 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-8d342e14-1420-4ed9-a544-5494eaf59262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:25.154220 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1435/2849] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:02:30.390946 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654aec6-e957-4b4e-9688-87aaa83c6815 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:30.392721 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-4654aec6-e957-4b4e-9688-87aaa83c6815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:30.441052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:30.474128 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654aec6-e957-4b4e-9688-87aaa83c6815 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:30.478194 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737eeca-5bcb-4738-92f3-83605cefc3b8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44776834b134ae98fa28d4741cc4ec3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:30.478855 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737eeca-5bcb-4738-92f3-83605cefc3b8 service glance] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:30.479144 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737eeca-5bcb-4738-92f3-83605cefc3b8 service glance] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:30.479423 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737eeca-5bcb-4738-92f3-83605cefc3b8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:30.493915 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737eeca-5bcb-4738-92f3-83605cefc3b8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:30.495410 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737eeca-5bcb-4738-92f3-83605cefc3b8 service glance] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:30.506920 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1415/2850] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:02:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:02:32.473338 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c725c97-d631-459d-8714-19d4d50df568 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:32.473837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c725c97-d631-459d-8714-19d4d50df568 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:32.474497 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c725c97-d631-459d-8714-19d4d50df568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:32.492346 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-4c725c97-d631-459d-8714-19d4d50df568 None None] MFA Rules not processed for user `bab1bde41c394c519663217f6466033e`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:32.493553 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4c725c97-d631-459d-8714-19d4d50df568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:32.498605 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:32.555739 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1436/2851] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:02:34.424605 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c010db-bef5-44e0-8459-e8320e7d16b2 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:34.425140 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c010db-bef5-44e0-8459-e8320e7d16b2 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:34.425247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c010db-bef5-44e0-8459-e8320e7d16b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:34.443991 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-09c010db-bef5-44e0-8459-e8320e7d16b2 None None] MFA Rules not processed for user `af8e0eb5ff8c40ae848929780d99e72d`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:34.445353 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-09c010db-bef5-44e0-8459-e8320e7d16b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:34.514886 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1416/2852] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jun 21 06:02:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:02:34.528522 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c725c97-d631-459d-8714-19d4d50df568 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:34.530151 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4c725c97-d631-459d-8714-19d4d50df568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:34.610156 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c725c97-d631-459d-8714-19d4d50df568 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:34.615335 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d7322-d352-4ded-82ca-e9bb8970c864 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac485a336d8b4360bce4f495bd02dbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:34.615981 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d7322-d352-4ded-82ca-e9bb8970c864 service swift] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:34.616265 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d7322-d352-4ded-82ca-e9bb8970c864 service swift] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:34.616538 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d7322-d352-4ded-82ca-e9bb8970c864 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:34.624726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d7322-d352-4ded-82ca-e9bb8970c864 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:34.626388 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d7322-d352-4ded-82ca-e9bb8970c864 service swift] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:34.635063 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1437/2853] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 21 06:02:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 06:02:36.632959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a3c29-aebd-4ef8-97c2-cea0a1a72978 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:36.634025 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a3c29-aebd-4ef8-97c2-cea0a1a72978 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:36.634745 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a3c29-aebd-4ef8-97c2-cea0a1a72978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:36.662694 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-144a3c29-aebd-4ef8-97c2-cea0a1a72978 None None] MFA Rules not processed for user `f02739ec12fa4f238244cdcbe1e3d739`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:36.663946 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-144a3c29-aebd-4ef8-97c2-cea0a1a72978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:36.765889 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1417/2854] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:02:43.480901 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d7322-d352-4ded-82ca-e9bb8970c864 service swift] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:43.482759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-7e5d7322-d352-4ded-82ca-e9bb8970c864 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:43.566830 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d7322-d352-4ded-82ca-e9bb8970c864 service swift] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:43.579396 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5974e5d-86f3-447a-bc5f-27d9916053e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:43.580314 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5974e5d-86f3-447a-bc5f-27d9916053e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:43.581079 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5974e5d-86f3-447a-bc5f-27d9916053e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:43.581724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5974e5d-86f3-447a-bc5f-27d9916053e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:43.599208 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f5974e5d-86f3-447a-bc5f-27d9916053e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:43.696918 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5974e5d-86f3-447a-bc5f-27d9916053e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:43.704816 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5974e5d-86f3-447a-bc5f-27d9916053e4 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:43.714211 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:43.722263 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1438/2855] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:02:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:02:46.757305 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=62 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:58.285904 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a3c29-aebd-4ef8-97c2-cea0a1a72978 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:58.296078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a3c29-aebd-4ef8-97c2-cea0a1a72978 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:58.299738 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a2259-8b0e-4f6a-bcee-05b448255808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:58.300368 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a2259-8b0e-4f6a-bcee-05b448255808 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:58.300667 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a2259-8b0e-4f6a-bcee-05b448255808 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:58.300945 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a2259-8b0e-4f6a-bcee-05b448255808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:58.302897 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-e46a2259-8b0e-4f6a-bcee-05b448255808 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:02:58.372712 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a2259-8b0e-4f6a-bcee-05b448255808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:58.374203 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a2259-8b0e-4f6a-bcee-05b448255808 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:58.384444 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1418/2856] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:02:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 06:02:59.839903 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5974e5d-86f3-447a-bc5f-27d9916053e4 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:02:59.852328 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5974e5d-86f3-447a-bc5f-27d9916053e4 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:02:59.857288 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bff1d4-6fe3-4a14-8cab-400fa3b30c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:02:59.858297 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bff1d4-6fe3-4a14-8cab-400fa3b30c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:59.858782 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bff1d4-6fe3-4a14-8cab-400fa3b30c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:59.859131 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bff1d4-6fe3-4a14-8cab-400fa3b30c5c admin admin] PATH_INFO: `/v3/users/65b2192f5d864a29808c53f2345eed38` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:59.860449 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bff1d4-6fe3-4a14-8cab-400fa3b30c5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=65b2192f5d864a29808c53f2345eed38)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:02:59.862498 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bff1d4-6fe3-4a14-8cab-400fa3b30c5c admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:02:59.916163 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-96bff1d4-6fe3-4a14-8cab-400fa3b30c5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65b2192f5d864a29808c53f2345eed38'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:59.925211 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-96bff1d4-6fe3-4a14-8cab-400fa3b30c5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65b2192f5d864a29808c53f2345eed38'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:59.926228 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-96bff1d4-6fe3-4a14-8cab-400fa3b30c5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65b2192f5d864a29808c53f2345eed38'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:59.935301 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-96bff1d4-6fe3-4a14-8cab-400fa3b30c5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65b2192f5d864a29808c53f2345eed38'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:59.950379 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-96bff1d4-6fe3-4a14-8cab-400fa3b30c5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65b2192f5d864a29808c53f2345eed38'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:02:59.959725 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1439/2857] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:02:59 2022] DELETE /identity/v3/users/65b2192f5d864a29808c53f2345eed38 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:02:59.964249 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756b14a-b654-40a5-b59c-efb0e9e2d582 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:02:59.964782 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756b14a-b654-40a5-b59c-efb0e9e2d582 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:02:59.964894 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756b14a-b654-40a5-b59c-efb0e9e2d582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:02:59.982557 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-3756b14a-b654-40a5-b59c-efb0e9e2d582 None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:02:59.983804 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3756b14a-b654-40a5-b59c-efb0e9e2d582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:03:00.051540 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1419/2858] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:02:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:03:00.065876 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bff1d4-6fe3-4a14-8cab-400fa3b30c5c admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:03:00.068068 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-96bff1d4-6fe3-4a14-8cab-400fa3b30c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:03:00.139127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bff1d4-6fe3-4a14-8cab-400fa3b30c5c admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:03:00.143114 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6bd72-61a2-4570-a012-227b06f13b52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:03:00.143851 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6bd72-61a2-4570-a012-227b06f13b52 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:03:00.144946 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6bd72-61a2-4570-a012-227b06f13b52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:03:00.145296 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6bd72-61a2-4570-a012-227b06f13b52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:03:00.155386 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6bd72-61a2-4570-a012-227b06f13b52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:03:00.156948 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6bd72-61a2-4570-a012-227b06f13b52 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:03:00.169061 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1440/2859] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:03:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:03:00.608621 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756b14a-b654-40a5-b59c-efb0e9e2d582 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:03:00.611781 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-3756b14a-b654-40a5-b59c-efb0e9e2d582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:03:00.636438 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756b14a-b654-40a5-b59c-efb0e9e2d582 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:03:00.643243 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e684d-d552-48eb-9b2d-92c290fdce9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:03:00.644168 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e684d-d552-48eb-9b2d-92c290fdce9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:03:00.644454 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e684d-d552-48eb-9b2d-92c290fdce9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:03:00.644764 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e684d-d552-48eb-9b2d-92c290fdce9b admin admin] PATH_INFO: `/v3/projects/8379be5e2ff74a979856e4e16666be50` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:03:00.646015 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e684d-d552-48eb-9b2d-92c290fdce9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8379be5e2ff74a979856e4e16666be50)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:03:00.649076 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e684d-d552-48eb-9b2d-92c290fdce9b admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:03:00.707451 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-223e684d-d552-48eb-9b2d-92c290fdce9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8379be5e2ff74a979856e4e16666be50', 'request_id': 'req-223e684d-d552-48eb-9b2d-92c290fdce9b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:00.715784 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-223e684d-d552-48eb-9b2d-92c290fdce9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8379be5e2ff74a979856e4e16666be50', 'request_id': 'req-223e684d-d552-48eb-9b2d-92c290fdce9b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:00.723517 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-223e684d-d552-48eb-9b2d-92c290fdce9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8379be5e2ff74a979856e4e16666be50', 'request_id': 'req-223e684d-d552-48eb-9b2d-92c290fdce9b'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:00.734462 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-223e684d-d552-48eb-9b2d-92c290fdce9b admin admin] The token cache is being invalidate because project 8379be5e2ff74a979856e4e16666be50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:03:00.734754 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-223e684d-d552-48eb-9b2d-92c290fdce9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:00.735404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-223e684d-d552-48eb-9b2d-92c290fdce9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:00.737267 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1420/2860] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:03:00 2022] DELETE /identity/v3/projects/8379be5e2ff74a979856e4e16666be50 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:03:00.742703 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7039df-1e4d-4763-b19b-95b617f5a82a None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:03:00.743198 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7039df-1e4d-4763-b19b-95b617f5a82a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:03:00.743548 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7039df-1e4d-4763-b19b-95b617f5a82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:03:00.761843 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-4f7039df-1e4d-4763-b19b-95b617f5a82a None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:03:00.763100 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4f7039df-1e4d-4763-b19b-95b617f5a82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:03:00.830115 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1441/2861] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:03:00.832691 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f39989-9a92-415a-839f-d97eed933b8b None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:03:00.833011 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f39989-9a92-415a-839f-d97eed933b8b None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:03:00.833459 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f39989-9a92-415a-839f-d97eed933b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:03:00.867323 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-d9f39989-9a92-415a-839f-d97eed933b8b None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:03:00.868566 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d9f39989-9a92-415a-839f-d97eed933b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:03:00.880581 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1421/2862] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:03:00.883175 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7039df-1e4d-4763-b19b-95b617f5a82a None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:03:00.896543 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7039df-1e4d-4763-b19b-95b617f5a82a None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:03:00.903617 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea57275-185d-487d-b346-abf41bf1f8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:03:00.906002 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea57275-185d-487d-b346-abf41bf1f8aa admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:03:00.906623 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea57275-185d-487d-b346-abf41bf1f8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:03:00.915905 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea57275-185d-487d-b346-abf41bf1f8aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:03:00.917385 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea57275-185d-487d-b346-abf41bf1f8aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 06:03:00.917999 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea57275-185d-487d-b346-abf41bf1f8aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:03:00.921921 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea57275-185d-487d-b346-abf41bf1f8aa admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:03:00.951535 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1442/2863] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Jun 21 06:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 06:03:00.956077 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f39989-9a92-415a-839f-d97eed933b8b None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:03:00.966415 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f39989-9a92-415a-839f-d97eed933b8b None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:03:00.976582 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43784caf-c797-4ea8-893b-31ae94def953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:03:00.977259 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43784caf-c797-4ea8-893b-31ae94def953 admin admin] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:03:00.977880 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43784caf-c797-4ea8-893b-31ae94def953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:03:00.978247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43784caf-c797-4ea8-893b-31ae94def953 admin admin] PATH_INFO: `/v3/projects` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:03:00.978919 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43784caf-c797-4ea8-893b-31ae94def953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:03:00.988766 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43784caf-c797-4ea8-893b-31ae94def953 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:03:00.997661 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:03:01.018380 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1422/2864] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Jun 21 06:03:00 2022] POST /identity/v3/projects => generated 397 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:03:01.022691 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea57275-185d-487d-b346-abf41bf1f8aa admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:03:01.028269 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:03:01.035211 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea57275-185d-487d-b346-abf41bf1f8aa admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:03:01.094597 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069a739-fe18-452d-b425-d41e85fe5a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:03:01.095275 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069a739-fe18-452d-b425-d41e85fe5a1c admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:03:01.095562 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069a739-fe18-452d-b425-d41e85fe5a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:03:01.095844 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069a739-fe18-452d-b425-d41e85fe5a1c admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:03:01.100861 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069a739-fe18-452d-b425-d41e85fe5a1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:03:01.100861 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069a739-fe18-452d-b425-d41e85fe5a1c admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:03:01.128543 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1443/2865] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Jun 21 06:03:01 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 06:03:01.129832 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43784caf-c797-4ea8-893b-31ae94def953 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:03:01.140139 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43784caf-c797-4ea8-893b-31ae94def953 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:03:01.145433 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e6b5b-a1f5-44d7-94f3-157d04aa9277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:03:01.146137 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e6b5b-a1f5-44d7-94f3-157d04aa9277 admin admin] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:03:01.146424 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e6b5b-a1f5-44d7-94f3-157d04aa9277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:03:01.146761 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e6b5b-a1f5-44d7-94f3-157d04aa9277 admin admin] PATH_INFO: `/v3/roles` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:03:01.147492 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e6b5b-a1f5-44d7-94f3-157d04aa9277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:03:01.149120 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e6b5b-a1f5-44d7-94f3-157d04aa9277 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:03:01.161222 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1423/2866] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 06:03:01.165628 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069a739-fe18-452d-b425-d41e85fe5a1c admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:03:01.178241 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069a739-fe18-452d-b425-d41e85fe5a1c admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:03:01.183159 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5c89e-2f48-4223-9f0c-dffef95c9e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:03:01.183817 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5c89e-2f48-4223-9f0c-dffef95c9e92 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:03:01.184097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5c89e-2f48-4223-9f0c-dffef95c9e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:03:01.184374 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5c89e-2f48-4223-9f0c-dffef95c9e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:03:01.185097 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5c89e-2f48-4223-9f0c-dffef95c9e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:03:01.186856 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5c89e-2f48-4223-9f0c-dffef95c9e92 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:03:01.201312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1444/2867] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Jun 21 06:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 06:03:01.208382 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e6b5b-a1f5-44d7-94f3-157d04aa9277 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:03:01.221075 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e6b5b-a1f5-44d7-94f3-157d04aa9277 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:03:01.231104 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541f801-7de0-4b13-ac20-bd64b0d28d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:03:01.232907 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541f801-7de0-4b13-ac20-bd64b0d28d13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:03:01.233399 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541f801-7de0-4b13-ac20-bd64b0d28d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:03:01.233831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541f801-7de0-4b13-ac20-bd64b0d28d13 admin admin] PATH_INFO: `/v3/projects/4914c3d3423a4bbeb8f075f36b3ee721/users/a0040769e0b442ed99da802002369744/roles/a9602a7e01694084a0f9713d9d6394b1` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:03:01.254446 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541f801-7de0-4b13-ac20-bd64b0d28d13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4914c3d3423a4bbeb8f075f36b3ee721, user_id=a0040769e0b442ed99da802002369744, role_id=a9602a7e01694084a0f9713d9d6394b1)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:03:01.257378 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541f801-7de0-4b13-ac20-bd64b0d28d13 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:03:01.284011 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1424/2868] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Jun 21 06:03:01 2022] PUT /identity/v3/projects/4914c3d3423a4bbeb8f075f36b3ee721/users/a0040769e0b442ed99da802002369744/roles/a9602a7e01694084a0f9713d9d6394b1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:03:01.287447 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ba484-3c6b-4cca-a999-33d8900fe77e None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:03:01.287936 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ba484-3c6b-4cca-a999-33d8900fe77e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:03:01.288296 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ba484-3c6b-4cca-a999-33d8900fe77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:03:01.328623 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-992ba484-3c6b-4cca-a999-33d8900fe77e None None] MFA Rules not processed for user `a0040769e0b442ed99da802002369744`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:03:01.330044 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-992ba484-3c6b-4cca-a999-33d8900fe77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:03:01.419104 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1445/2869] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:03:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:03:01.434433 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541f801-7de0-4b13-ac20-bd64b0d28d13 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:03:01.436169 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5541f801-7de0-4b13-ac20-bd64b0d28d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:03:01.535690 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541f801-7de0-4b13-ac20-bd64b0d28d13 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:03:01.544614 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db681f8-6182-4a02-8b37-4ba9e4e735c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c13a614e6b04b3a93247e3790f96240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:03:01.545283 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db681f8-6182-4a02-8b37-4ba9e4e735c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:03:01.545565 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db681f8-6182-4a02-8b37-4ba9e4e735c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:03:01.545840 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db681f8-6182-4a02-8b37-4ba9e4e735c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:03:01.558341 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db681f8-6182-4a02-8b37-4ba9e4e735c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:03:01.559868 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db681f8-6182-4a02-8b37-4ba9e4e735c8 service cinder] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:03:01.594021 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1425/2870] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:03:01 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:03:05.264552 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ba484-3c6b-4cca-a999-33d8900fe77e None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:03:05.266295 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-992ba484-3c6b-4cca-a999-33d8900fe77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:03:05.340158 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ba484-3c6b-4cca-a999-33d8900fe77e None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:03:05.345160 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d07e45-14a2-441e-a451-206d601169d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:03:05.346113 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d07e45-14a2-441e-a451-206d601169d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:03:05.346436 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d07e45-14a2-441e-a451-206d601169d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:03:05.346724 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d07e45-14a2-441e-a451-206d601169d0 admin admin] PATH_INFO: `/v3/users/353add140e784d90a16c124e52f5d36d` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:03:05.348071 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d07e45-14a2-441e-a451-206d601169d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=353add140e784d90a16c124e52f5d36d)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:03:05.350058 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d07e45-14a2-441e-a451-206d601169d0 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:03:05.363700 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:03:05.401387 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-69d07e45-14a2-441e-a451-206d601169d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '353add140e784d90a16c124e52f5d36d'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:05.408444 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-69d07e45-14a2-441e-a451-206d601169d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '353add140e784d90a16c124e52f5d36d'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:05.409065 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-69d07e45-14a2-441e-a451-206d601169d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '353add140e784d90a16c124e52f5d36d'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:05.416510 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-69d07e45-14a2-441e-a451-206d601169d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '353add140e784d90a16c124e52f5d36d'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:05.428893 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-69d07e45-14a2-441e-a451-206d601169d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '353add140e784d90a16c124e52f5d36d'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:05.435445 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1446/2871] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:03:05 2022] DELETE /identity/v3/users/353add140e784d90a16c124e52f5d36d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:03:05.610998 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db681f8-6182-4a02-8b37-4ba9e4e735c8 service cinder] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:03:05.623691 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db681f8-6182-4a02-8b37-4ba9e4e735c8 service cinder] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:03:05.680687 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f014aa-a3cc-403b-a3d6-814fd458af13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:03:05.681469 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f014aa-a3cc-403b-a3d6-814fd458af13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:03:05.681752 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f014aa-a3cc-403b-a3d6-814fd458af13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:03:05.682090 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f014aa-a3cc-403b-a3d6-814fd458af13 admin admin] PATH_INFO: `/v3/projects/4e17d31f99954cca8b4eb24b3b798f1e` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:03:05.683311 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f014aa-a3cc-403b-a3d6-814fd458af13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e17d31f99954cca8b4eb24b3b798f1e)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:03:05.685203 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f014aa-a3cc-403b-a3d6-814fd458af13 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:03:05.732985 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f5f014aa-a3cc-403b-a3d6-814fd458af13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e17d31f99954cca8b4eb24b3b798f1e', 'request_id': 'req-f5f014aa-a3cc-403b-a3d6-814fd458af13'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:05.740542 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f5f014aa-a3cc-403b-a3d6-814fd458af13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e17d31f99954cca8b4eb24b3b798f1e', 'request_id': 'req-f5f014aa-a3cc-403b-a3d6-814fd458af13'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:05.742440 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:03:05.747636 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f5f014aa-a3cc-403b-a3d6-814fd458af13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e17d31f99954cca8b4eb24b3b798f1e', 'request_id': 'req-f5f014aa-a3cc-403b-a3d6-814fd458af13'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:05.759090 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f5f014aa-a3cc-403b-a3d6-814fd458af13 admin admin] The token cache is being invalidate because project 4e17d31f99954cca8b4eb24b3b798f1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:03:05.759377 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f5f014aa-a3cc-403b-a3d6-814fd458af13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:05.760012 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-f5f014aa-a3cc-403b-a3d6-814fd458af13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:05.761557 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1426/2872] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:03:05 2022] DELETE /identity/v3/projects/4e17d31f99954cca8b4eb24b3b798f1e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:03:05.765490 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d07e45-14a2-441e-a451-206d601169d0 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:03:05.766909 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-69d07e45-14a2-441e-a451-206d601169d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:03:05.780427 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d07e45-14a2-441e-a451-206d601169d0 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:03:05.840006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab1994-b81b-4992-86a5-1c5a38a2278d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:03:05.840870 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab1994-b81b-4992-86a5-1c5a38a2278d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:03:05.841159 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab1994-b81b-4992-86a5-1c5a38a2278d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:03:05.841443 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab1994-b81b-4992-86a5-1c5a38a2278d admin admin] PATH_INFO: `/v3/users/1afb0338b660436aa8022be14595a434` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:03:05.842645 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab1994-b81b-4992-86a5-1c5a38a2278d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1afb0338b660436aa8022be14595a434)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:03:05.844566 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab1994-b81b-4992-86a5-1c5a38a2278d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:03:05.889249 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-bcab1994-b81b-4992-86a5-1c5a38a2278d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1afb0338b660436aa8022be14595a434'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:05.896606 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-bcab1994-b81b-4992-86a5-1c5a38a2278d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1afb0338b660436aa8022be14595a434'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:05.897289 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-bcab1994-b81b-4992-86a5-1c5a38a2278d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1afb0338b660436aa8022be14595a434'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:05.904474 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-bcab1994-b81b-4992-86a5-1c5a38a2278d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1afb0338b660436aa8022be14595a434'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:05.917511 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-bcab1994-b81b-4992-86a5-1c5a38a2278d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1afb0338b660436aa8022be14595a434'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:05.923335 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1447/2873] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:03:05 2022] DELETE /identity/v3/users/1afb0338b660436aa8022be14595a434 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:03:06.092822 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f014aa-a3cc-403b-a3d6-814fd458af13 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:03:06.094539 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-f5f014aa-a3cc-403b-a3d6-814fd458af13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:03:06.132356 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f014aa-a3cc-403b-a3d6-814fd458af13 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:03:06.198109 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32552d4b-866d-4f69-91e7-c180450c0593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:03:06.199000 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32552d4b-866d-4f69-91e7-c180450c0593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:03:06.199291 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32552d4b-866d-4f69-91e7-c180450c0593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:03:06.199576 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32552d4b-866d-4f69-91e7-c180450c0593 admin admin] PATH_INFO: `/v3/projects/4e4c039b12fa4ca0a1be60baa4a83686` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:03:06.200808 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32552d4b-866d-4f69-91e7-c180450c0593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e4c039b12fa4ca0a1be60baa4a83686)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:03:06.202768 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32552d4b-866d-4f69-91e7-c180450c0593 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:03:06.253910 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-32552d4b-866d-4f69-91e7-c180450c0593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e4c039b12fa4ca0a1be60baa4a83686', 'request_id': 'req-32552d4b-866d-4f69-91e7-c180450c0593'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:06.262278 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-32552d4b-866d-4f69-91e7-c180450c0593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e4c039b12fa4ca0a1be60baa4a83686', 'request_id': 'req-32552d4b-866d-4f69-91e7-c180450c0593'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:06.270705 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-32552d4b-866d-4f69-91e7-c180450c0593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e4c039b12fa4ca0a1be60baa4a83686', 'request_id': 'req-32552d4b-866d-4f69-91e7-c180450c0593'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:06.282683 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-32552d4b-866d-4f69-91e7-c180450c0593 admin admin] The token cache is being invalidate because project 4e4c039b12fa4ca0a1be60baa4a83686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:03:06.283021 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-32552d4b-866d-4f69-91e7-c180450c0593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:06.283648 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-32552d4b-866d-4f69-91e7-c180450c0593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:06.285506 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1427/2874] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:03:06 2022] DELETE /identity/v3/projects/4e4c039b12fa4ca0a1be60baa4a83686 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:03:08.442410 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab1994-b81b-4992-86a5-1c5a38a2278d admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:03:08.443978 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-bcab1994-b81b-4992-86a5-1c5a38a2278d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:03:08.454940 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:03:08.504969 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab1994-b81b-4992-86a5-1c5a38a2278d admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:03:08.557320 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac120f8-8e12-4d8f-b190-b8f8278c8270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:03:08.558121 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac120f8-8e12-4d8f-b190-b8f8278c8270 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:03:08.558568 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac120f8-8e12-4d8f-b190-b8f8278c8270 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:03:08.558840 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac120f8-8e12-4d8f-b190-b8f8278c8270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:03:08.560728 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3ac120f8-8e12-4d8f-b190-b8f8278c8270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:03:08.624963 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac120f8-8e12-4d8f-b190-b8f8278c8270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:03:08.626447 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac120f8-8e12-4d8f-b190-b8f8278c8270 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:03:08.636681 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1448/2875] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:03:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:03:08.737509 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32552d4b-866d-4f69-91e7-c180450c0593 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:03:08.738995 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-32552d4b-866d-4f69-91e7-c180450c0593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:03:08.809036 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32552d4b-866d-4f69-91e7-c180450c0593 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:03:08.814277 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed3209-f4c5-44e9-bf60-f84d57485058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:03:08.815265 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed3209-f4c5-44e9-bf60-f84d57485058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:03:08.815641 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed3209-f4c5-44e9-bf60-f84d57485058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:03:08.815988 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed3209-f4c5-44e9-bf60-f84d57485058 admin admin] PATH_INFO: `/v3/users/a0040769e0b442ed99da802002369744` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:03:08.817442 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed3209-f4c5-44e9-bf60-f84d57485058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0040769e0b442ed99da802002369744)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:03:08.819585 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed3209-f4c5-44e9-bf60-f84d57485058 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:03:08.847931 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:03:08.880214 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-70ed3209-f4c5-44e9-bf60-f84d57485058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0040769e0b442ed99da802002369744'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:08.891297 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-70ed3209-f4c5-44e9-bf60-f84d57485058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0040769e0b442ed99da802002369744'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:08.892050 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-70ed3209-f4c5-44e9-bf60-f84d57485058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0040769e0b442ed99da802002369744'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:08.892749 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-70ed3209-f4c5-44e9-bf60-f84d57485058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0040769e0b442ed99da802002369744'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:08.907856 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-70ed3209-f4c5-44e9-bf60-f84d57485058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0040769e0b442ed99da802002369744'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:08.924461 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1428/2876] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:03:08 2022] DELETE /identity/v3/users/a0040769e0b442ed99da802002369744 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:03:08.928902 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca4953-5303-4f2e-b8e5-390bc14c24ce None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:03:08.929364 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca4953-5303-4f2e-b8e5-390bc14c24ce None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:03:08.929498 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca4953-5303-4f2e-b8e5-390bc14c24ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:03:08.948355 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-1bca4953-5303-4f2e-b8e5-390bc14c24ce None None] MFA Rules not processed for user `79f991743edf4c82841603b9b9845e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:03:08.949605 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1bca4953-5303-4f2e-b8e5-390bc14c24ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:03:09.012549 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1449/2877] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:03:09.022932 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed3209-f4c5-44e9-bf60-f84d57485058 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:03:09.024357 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-70ed3209-f4c5-44e9-bf60-f84d57485058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:03:09.085341 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed3209-f4c5-44e9-bf60-f84d57485058 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:03:09.089446 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ce286-be50-48ec-befe-1a34bb66956c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:03:09.090125 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ce286-be50-48ec-befe-1a34bb66956c service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:03:09.090406 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ce286-be50-48ec-befe-1a34bb66956c service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:03:09.090681 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ce286-be50-48ec-befe-1a34bb66956c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:03:09.102154 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ce286-be50-48ec-befe-1a34bb66956c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:03:09.104085 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ce286-be50-48ec-befe-1a34bb66956c service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:03:09.116691 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1429/2878] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:03:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 06:03:09.387278 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca4953-5303-4f2e-b8e5-390bc14c24ce None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:03:09.389492 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1bca4953-5303-4f2e-b8e5-390bc14c24ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:03:09.403588 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca4953-5303-4f2e-b8e5-390bc14c24ce None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:03:09.416085 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609dfec3-b400-4a0e-acb3-f6fe518e2f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:03:09.416979 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dfec3-b400-4a0e-acb3-f6fe518e2f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:03:09.417263 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dfec3-b400-4a0e-acb3-f6fe518e2f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:03:09.417540 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dfec3-b400-4a0e-acb3-f6fe518e2f51 admin admin] PATH_INFO: `/v3/projects/4914c3d3423a4bbeb8f075f36b3ee721` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:03:09.418837 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609dfec3-b400-4a0e-acb3-f6fe518e2f51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4914c3d3423a4bbeb8f075f36b3ee721)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:03:09.420755 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609dfec3-b400-4a0e-acb3-f6fe518e2f51 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:03:09.435148 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:03:09.476546 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-609dfec3-b400-4a0e-acb3-f6fe518e2f51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4914c3d3423a4bbeb8f075f36b3ee721', 'request_id': 'req-609dfec3-b400-4a0e-acb3-f6fe518e2f51'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:09.482635 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-609dfec3-b400-4a0e-acb3-f6fe518e2f51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4914c3d3423a4bbeb8f075f36b3ee721', 'request_id': 'req-609dfec3-b400-4a0e-acb3-f6fe518e2f51'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:09.490013 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-609dfec3-b400-4a0e-acb3-f6fe518e2f51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4914c3d3423a4bbeb8f075f36b3ee721', 'request_id': 'req-609dfec3-b400-4a0e-acb3-f6fe518e2f51'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:09.504096 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-609dfec3-b400-4a0e-acb3-f6fe518e2f51 admin admin] The token cache is being invalidate because project 4914c3d3423a4bbeb8f075f36b3ee721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:03:09.504393 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-609dfec3-b400-4a0e-acb3-f6fe518e2f51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:09.505069 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-609dfec3-b400-4a0e-acb3-f6fe518e2f51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:03:09.506687 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1450/2879] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:03:09 2022] DELETE /identity/v3/projects/4914c3d3423a4bbeb8f075f36b3ee721 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:03:10.298084 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ce286-be50-48ec-befe-1a34bb66956c service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:03:10.307294 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ce286-be50-48ec-befe-1a34bb66956c service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:03:10.356592 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bec3b-e961-401c-9d30-ea1d5d42d448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:03:10.357238 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bec3b-e961-401c-9d30-ea1d5d42d448 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:03:10.357524 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bec3b-e961-401c-9d30-ea1d5d42d448 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:03:10.357798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bec3b-e961-401c-9d30-ea1d5d42d448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:03:10.359771 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-922bec3b-e961-401c-9d30-ea1d5d42d448 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:03:10.411489 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:03:10.425679 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bec3b-e961-401c-9d30-ea1d5d42d448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:03:10.427162 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bec3b-e961-401c-9d30-ea1d5d42d448 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:03:10.437204 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1430/2880] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:03:10 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:03:19.500154 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=20,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:03:20.432535 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=5 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:03:50.295088 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609dfec3-b400-4a0e-acb3-f6fe518e2f51 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:03:50.296711 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-609dfec3-b400-4a0e-acb3-f6fe518e2f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:03:50.310610 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609dfec3-b400-4a0e-acb3-f6fe518e2f51 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:03:50.314387 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc2134-c990-4890-aa1f-f5e5f9549a72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:03:50.315060 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc2134-c990-4890-aa1f-f5e5f9549a72 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:03:50.315346 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc2134-c990-4890-aa1f-f5e5f9549a72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:03:50.315625 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc2134-c990-4890-aa1f-f5e5f9549a72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:03:50.318230 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0cfc2134-c990-4890-aa1f-f5e5f9549a72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:03:50.391806 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc2134-c990-4890-aa1f-f5e5f9549a72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:03:50.393228 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc2134-c990-4890-aa1f-f5e5f9549a72 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:03:50.404189 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1451/2881] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:03:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:03:53.972299 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bec3b-e961-401c-9d30-ea1d5d42d448 service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:03:53.981412 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bec3b-e961-401c-9d30-ea1d5d42d448 service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:03:53.985202 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64a6b1-dcd0-4f73-b6d3-75a10b411303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:03:53.985873 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64a6b1-dcd0-4f73-b6d3-75a10b411303 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:03:53.986356 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64a6b1-dcd0-4f73-b6d3-75a10b411303 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:03:53.986722 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64a6b1-dcd0-4f73-b6d3-75a10b411303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:03:53.990276 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-cc64a6b1-dcd0-4f73-b6d3-75a10b411303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:03:54.005888 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64a6b1-dcd0-4f73-b6d3-75a10b411303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:03:54.007368 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64a6b1-dcd0-4f73-b6d3-75a10b411303 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:03:54.019494 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1431/2882] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:03:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:04:00.399401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=34 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:04:04.013865 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=6 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:04:34.304726 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d4b69-dd3c-4ea8-bb93-1bb0f2d779c2 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:04:34.305281 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d4b69-dd3c-4ea8-bb93-1bb0f2d779c2 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:04:34.305402 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d4b69-dd3c-4ea8-bb93-1bb0f2d779c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:04:34.324487 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-ff6d4b69-dd3c-4ea8-bb93-1bb0f2d779c2 None None] MFA Rules not processed for user `af8e0eb5ff8c40ae848929780d99e72d`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:04:34.325877 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ff6d4b69-dd3c-4ea8-bb93-1bb0f2d779c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:04:34.386289 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1452/2883] 10.222.0.18 () {58 vars in 967 bytes} [Tue Jun 21 06:04:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 06:04:34.435652 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64a6b1-dcd0-4f73-b6d3-75a10b411303 service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:04:34.437099 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-cc64a6b1-dcd0-4f73-b6d3-75a10b411303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:04:34.518182 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64a6b1-dcd0-4f73-b6d3-75a10b411303 service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:04:34.523508 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558497a0-9ae0-49d3-b652-a311d5713cd4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac485a336d8b4360bce4f495bd02dbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:04:34.524468 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558497a0-9ae0-49d3-b652-a311d5713cd4 service swift] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:04:34.524758 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558497a0-9ae0-49d3-b652-a311d5713cd4 service swift] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:04:34.525036 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558497a0-9ae0-49d3-b652-a311d5713cd4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:04:34.534608 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558497a0-9ae0-49d3-b652-a311d5713cd4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:04:34.536468 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558497a0-9ae0-49d3-b652-a311d5713cd4 service swift] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:04:34.546701 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1432/2884] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jun 21 06:04:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 06:04:42.695923 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d4b69-dd3c-4ea8-bb93-1bb0f2d779c2 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:04:42.698048 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ff6d4b69-dd3c-4ea8-bb93-1bb0f2d779c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:04:42.795980 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d4b69-dd3c-4ea8-bb93-1bb0f2d779c2 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:04:42.802214 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dbdce-41ad-48b9-b5a0-106f0464b226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:04:42.803813 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dbdce-41ad-48b9-b5a0-106f0464b226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:04:42.804322 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dbdce-41ad-48b9-b5a0-106f0464b226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:04:42.804819 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dbdce-41ad-48b9-b5a0-106f0464b226 admin admin] PATH_INFO: `/v3/users/bab1bde41c394c519663217f6466033e` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:04:42.808288 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02dbdce-41ad-48b9-b5a0-106f0464b226 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bab1bde41c394c519663217f6466033e)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:04:42.812435 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02dbdce-41ad-48b9-b5a0-106f0464b226 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:04:42.889140 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b02dbdce-41ad-48b9-b5a0-106f0464b226 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bab1bde41c394c519663217f6466033e'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:04:42.905394 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b02dbdce-41ad-48b9-b5a0-106f0464b226 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bab1bde41c394c519663217f6466033e'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:04:42.906258 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b02dbdce-41ad-48b9-b5a0-106f0464b226 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bab1bde41c394c519663217f6466033e'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:04:42.916033 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b02dbdce-41ad-48b9-b5a0-106f0464b226 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bab1bde41c394c519663217f6466033e'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:04:42.932934 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b02dbdce-41ad-48b9-b5a0-106f0464b226 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bab1bde41c394c519663217f6466033e'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:04:42.940925 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1453/2885] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:04:42 2022] DELETE /identity/v3/users/bab1bde41c394c519663217f6466033e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:04:43.169841 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558497a0-9ae0-49d3-b652-a311d5713cd4 service swift] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:04:43.189855 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558497a0-9ae0-49d3-b652-a311d5713cd4 service swift] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:04:43.270849 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de7c64-06f9-4eac-921d-c8f83ec31b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:04:43.271809 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de7c64-06f9-4eac-921d-c8f83ec31b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:04:43.272136 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de7c64-06f9-4eac-921d-c8f83ec31b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:04:43.272452 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de7c64-06f9-4eac-921d-c8f83ec31b3e admin admin] PATH_INFO: `/v3/projects/391ee53fa68f41a4ac576996b9b52b9d` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:04:43.273821 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de7c64-06f9-4eac-921d-c8f83ec31b3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=391ee53fa68f41a4ac576996b9b52b9d)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:04:43.275944 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de7c64-06f9-4eac-921d-c8f83ec31b3e admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:04:43.333874 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-12de7c64-06f9-4eac-921d-c8f83ec31b3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '391ee53fa68f41a4ac576996b9b52b9d', 'request_id': 'req-12de7c64-06f9-4eac-921d-c8f83ec31b3e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:04:43.343215 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-12de7c64-06f9-4eac-921d-c8f83ec31b3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '391ee53fa68f41a4ac576996b9b52b9d', 'request_id': 'req-12de7c64-06f9-4eac-921d-c8f83ec31b3e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:04:43.351566 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-12de7c64-06f9-4eac-921d-c8f83ec31b3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '391ee53fa68f41a4ac576996b9b52b9d', 'request_id': 'req-12de7c64-06f9-4eac-921d-c8f83ec31b3e'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:04:43.363683 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-12de7c64-06f9-4eac-921d-c8f83ec31b3e admin admin] The token cache is being invalidate because project 391ee53fa68f41a4ac576996b9b52b9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:04:43.364029 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-12de7c64-06f9-4eac-921d-c8f83ec31b3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:04:43.364780 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-12de7c64-06f9-4eac-921d-c8f83ec31b3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:04:43.366697 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1433/2886] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:04:43 2022] DELETE /identity/v3/projects/391ee53fa68f41a4ac576996b9b52b9d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:04:43.371090 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dbdce-41ad-48b9-b5a0-106f0464b226 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:04:43.372712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b02dbdce-41ad-48b9-b5a0-106f0464b226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:04:43.387825 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dbdce-41ad-48b9-b5a0-106f0464b226 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:04:43.413089 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:04:43.465425 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5ef2d-b6a2-4545-8180-e260b1e7fb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:04:43.466340 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5ef2d-b6a2-4545-8180-e260b1e7fb90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:04:43.466683 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5ef2d-b6a2-4545-8180-e260b1e7fb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:04:43.467393 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5ef2d-b6a2-4545-8180-e260b1e7fb90 admin admin] PATH_INFO: `/v3/users/0e48a48623844f649e91de94866653d0` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:04:43.469008 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5ef2d-b6a2-4545-8180-e260b1e7fb90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e48a48623844f649e91de94866653d0)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:04:43.471329 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5ef2d-b6a2-4545-8180-e260b1e7fb90 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:04:43.539730 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1da5ef2d-b6a2-4545-8180-e260b1e7fb90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e48a48623844f649e91de94866653d0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:04:43.553131 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1da5ef2d-b6a2-4545-8180-e260b1e7fb90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e48a48623844f649e91de94866653d0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:04:43.554369 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1da5ef2d-b6a2-4545-8180-e260b1e7fb90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e48a48623844f649e91de94866653d0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:04:43.566478 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1da5ef2d-b6a2-4545-8180-e260b1e7fb90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e48a48623844f649e91de94866653d0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:04:43.583639 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1da5ef2d-b6a2-4545-8180-e260b1e7fb90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e48a48623844f649e91de94866653d0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:04:43.590712 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1454/2887] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:04:43 2022] DELETE /identity/v3/users/0e48a48623844f649e91de94866653d0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:04:43.805687 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de7c64-06f9-4eac-921d-c8f83ec31b3e admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:04:43.808156 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-12de7c64-06f9-4eac-921d-c8f83ec31b3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:04:43.827078 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de7c64-06f9-4eac-921d-c8f83ec31b3e admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:04:43.855018 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:04:43.908953 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79217d9f-2a38-4f30-8110-ee147a300c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:04:43.910038 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79217d9f-2a38-4f30-8110-ee147a300c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:04:43.910422 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79217d9f-2a38-4f30-8110-ee147a300c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:04:43.910794 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79217d9f-2a38-4f30-8110-ee147a300c47 admin admin] PATH_INFO: `/v3/projects/0e54a126afc548aaaaf577664847bbac` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:04:43.912267 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79217d9f-2a38-4f30-8110-ee147a300c47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e54a126afc548aaaaf577664847bbac)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:04:43.914418 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79217d9f-2a38-4f30-8110-ee147a300c47 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:04:43.975467 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-79217d9f-2a38-4f30-8110-ee147a300c47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e54a126afc548aaaaf577664847bbac', 'request_id': 'req-79217d9f-2a38-4f30-8110-ee147a300c47'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:04:43.984959 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-79217d9f-2a38-4f30-8110-ee147a300c47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e54a126afc548aaaaf577664847bbac', 'request_id': 'req-79217d9f-2a38-4f30-8110-ee147a300c47'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:04:43.993128 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-79217d9f-2a38-4f30-8110-ee147a300c47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e54a126afc548aaaaf577664847bbac', 'request_id': 'req-79217d9f-2a38-4f30-8110-ee147a300c47'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:04:44.006379 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-79217d9f-2a38-4f30-8110-ee147a300c47 admin admin] The token cache is being invalidate because project 0e54a126afc548aaaaf577664847bbac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:04:44.006817 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-79217d9f-2a38-4f30-8110-ee147a300c47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:04:44.007622 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-79217d9f-2a38-4f30-8110-ee147a300c47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:04:44.009421 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1434/2888] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:04:43 2022] DELETE /identity/v3/projects/0e54a126afc548aaaaf577664847bbac => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 06:04:53.586903 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:04:54.002230 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:05:00.368383 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5ef2d-b6a2-4545-8180-e260b1e7fb90 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:05:00.370286 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1da5ef2d-b6a2-4545-8180-e260b1e7fb90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:05:00.442302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5ef2d-b6a2-4545-8180-e260b1e7fb90 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:05:00.505855 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23754798-0417-46f3-8668-43b7488cce30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:05:00.506689 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23754798-0417-46f3-8668-43b7488cce30 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:05:00.507047 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23754798-0417-46f3-8668-43b7488cce30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:05:00.507445 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23754798-0417-46f3-8668-43b7488cce30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:05:00.510089 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-23754798-0417-46f3-8668-43b7488cce30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:05:00.520849 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23754798-0417-46f3-8668-43b7488cce30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:05:00.522353 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23754798-0417-46f3-8668-43b7488cce30 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:05:00.531919 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1455/2889] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:05:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 06:05:10.527740 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=46 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:05:13.370831 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79217d9f-2a38-4f30-8110-ee147a300c47 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:05:13.374643 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-79217d9f-2a38-4f30-8110-ee147a300c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:05:13.542236 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79217d9f-2a38-4f30-8110-ee147a300c47 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:05:13.548247 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b9b5b-6b0c-487e-8a2f-8cc3c4e22018 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:05:13.548942 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b9b5b-6b0c-487e-8a2f-8cc3c4e22018 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:05:13.549281 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b9b5b-6b0c-487e-8a2f-8cc3c4e22018 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:05:13.549569 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b9b5b-6b0c-487e-8a2f-8cc3c4e22018 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:05:13.551755 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c19b9b5b-6b0c-487e-8a2f-8cc3c4e22018 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:05:13.571304 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b9b5b-6b0c-487e-8a2f-8cc3c4e22018 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:05:13.574187 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b9b5b-6b0c-487e-8a2f-8cc3c4e22018 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:05:13.597803 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1435/2890] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:05:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:05:14.239923 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1df19-7c4d-4fc8-a2fb-d906613b159d None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:05:14.240528 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1df19-7c4d-4fc8-a2fb-d906613b159d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:05:14.240908 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1df19-7c4d-4fc8-a2fb-d906613b159d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:05:14.262302 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-9fb1df19-7c4d-4fc8-a2fb-d906613b159d None None] MFA Rules not processed for user `f02739ec12fa4f238244cdcbe1e3d739`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:05:14.263940 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9fb1df19-7c4d-4fc8-a2fb-d906613b159d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:05:14.348295 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1456/2891] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:05:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:05:14.830815 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b9b5b-6b0c-487e-8a2f-8cc3c4e22018 service nova] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:05:14.832771 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-c19b9b5b-6b0c-487e-8a2f-8cc3c4e22018 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:05:14.847618 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b9b5b-6b0c-487e-8a2f-8cc3c4e22018 service nova] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:05:14.852106 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ef03c-e808-4ce5-a6bb-3b90e2c8ad75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:05:14.852960 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ef03c-e808-4ce5-a6bb-3b90e2c8ad75 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:05:14.853404 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ef03c-e808-4ce5-a6bb-3b90e2c8ad75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:05:14.853834 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ef03c-e808-4ce5-a6bb-3b90e2c8ad75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:05:14.856472 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-d82ef03c-e808-4ce5-a6bb-3b90e2c8ad75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:05:14.871630 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ef03c-e808-4ce5-a6bb-3b90e2c8ad75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:05:14.873472 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ef03c-e808-4ce5-a6bb-3b90e2c8ad75 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:05:14.886377 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1436/2892] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:05:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:05:15.562463 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1df19-7c4d-4fc8-a2fb-d906613b159d None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:05:15.564037 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9fb1df19-7c4d-4fc8-a2fb-d906613b159d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:05:15.679759 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1df19-7c4d-4fc8-a2fb-d906613b159d None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:05:15.685779 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56febc-ad68-4e64-9982-5c13ddb5f75d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17a40bea6ba41f19c88e16f9b15cf27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:05:15.686626 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56febc-ad68-4e64-9982-5c13ddb5f75d service placement] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:05:15.687022 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56febc-ad68-4e64-9982-5c13ddb5f75d service placement] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:05:15.687401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56febc-ad68-4e64-9982-5c13ddb5f75d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:05:15.689511 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-cb56febc-ad68-4e64-9982-5c13ddb5f75d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:05:15.702713 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56febc-ad68-4e64-9982-5c13ddb5f75d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:05:15.704371 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56febc-ad68-4e64-9982-5c13ddb5f75d service placement] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:05:15.716129 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1457/2893] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:05:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:05:24.882053 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=40 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:05:25.710977 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=57 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:05:28.972448 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ef03c-e808-4ce5-a6bb-3b90e2c8ad75 service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:05:28.997031 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ef03c-e808-4ce5-a6bb-3b90e2c8ad75 service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:05:29.003187 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172d7eb-87c1-4a71-b533-a67ac89ffe87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:05:29.003854 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172d7eb-87c1-4a71-b533-a67ac89ffe87 service nova] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:05:29.004144 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172d7eb-87c1-4a71-b533-a67ac89ffe87 service nova] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:05:29.004447 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172d7eb-87c1-4a71-b533-a67ac89ffe87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:05:29.006396 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-7172d7eb-87c1-4a71-b533-a67ac89ffe87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:05:29.021172 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172d7eb-87c1-4a71-b533-a67ac89ffe87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:05:29.022861 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172d7eb-87c1-4a71-b533-a67ac89ffe87 service nova] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:05:29.036214 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1437/2894] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:05:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:05:33.225217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56febc-ad68-4e64-9982-5c13ddb5f75d service placement] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:05:33.240201 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56febc-ad68-4e64-9982-5c13ddb5f75d service placement] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:05:33.246313 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367dabf-8df2-4310-9c53-d1e6e2726226 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:05:33.246996 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367dabf-8df2-4310-9c53-d1e6e2726226 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:05:33.247279 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367dabf-8df2-4310-9c53-d1e6e2726226 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:05:33.247561 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367dabf-8df2-4310-9c53-d1e6e2726226 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:05:33.249628 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3367dabf-8df2-4310-9c53-d1e6e2726226 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:05:33.264247 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367dabf-8df2-4310-9c53-d1e6e2726226 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:05:33.265901 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367dabf-8df2-4310-9c53-d1e6e2726226 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:05:33.279932 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1458/2895] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:05:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:05:39.031165 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=6 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:05:43.273682 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=6 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:07:07.917719 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b4fcc-dc9e-4033-8736-7242408bb056 None None] REQUEST_METHOD: `POST` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:07:07.918330 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b4fcc-dc9e-4033-8736-7242408bb056 None None] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:07:07.918330 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b4fcc-dc9e-4033-8736-7242408bb056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:07:07.947217 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.auth.core [None req-9d5b4fcc-dc9e-4033-8736-7242408bb056 None None] MFA Rules not processed for user `f02739ec12fa4f238244cdcbe1e3d739`. Rule list: `[]` (Enabled: `True`). {{(pid=80109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 06:07:07.948448 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-9d5b4fcc-dc9e-4033-8736-7242408bb056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:07:07.973019 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1438/2896] 10.222.0.18 () {58 vars in 957 bytes} [Tue Jun 21 06:07:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 06:07:08.328017 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367dabf-8df2-4310-9c53-d1e6e2726226 service nova] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:07:08.370966 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367dabf-8df2-4310-9c53-d1e6e2726226 service nova] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:07:08.374690 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f61c75-b477-4a72-81a1-974d9cab80f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:07:08.375599 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f61c75-b477-4a72-81a1-974d9cab80f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:07:08.375880 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f61c75-b477-4a72-81a1-974d9cab80f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:07:08.376217 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f61c75-b477-4a72-81a1-974d9cab80f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:07:08.378822 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-02f61c75-b477-4a72-81a1-974d9cab80f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:07:08.404697 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f61c75-b477-4a72-81a1-974d9cab80f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:07:08.406453 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f61c75-b477-4a72-81a1-974d9cab80f2 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:07:08.417193 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1459/2897] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:07:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:07:08.613125 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b4fcc-dc9e-4033-8736-7242408bb056 None None] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:07:08.614695 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-9d5b4fcc-dc9e-4033-8736-7242408bb056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:07:08.676854 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b4fcc-dc9e-4033-8736-7242408bb056 None None] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:07:08.682253 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6f751-065f-46f9-9736-86b94e5646ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17a40bea6ba41f19c88e16f9b15cf27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:07:08.682918 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6f751-065f-46f9-9736-86b94e5646ec service placement] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:07:08.683202 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6f751-065f-46f9-9736-86b94e5646ec service placement] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:07:08.683480 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6f751-065f-46f9-9736-86b94e5646ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:07:08.685629 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5af6f751-065f-46f9-9736-86b94e5646ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:07:08.698656 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6f751-065f-46f9-9736-86b94e5646ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:07:08.700323 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6f751-065f-46f9-9736-86b94e5646ec service placement] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:07:08.711441 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1439/2898] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:07:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:07:18.411975 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=23 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:07:18.706798 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=33 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:07:19.674368 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f61c75-b477-4a72-81a1-974d9cab80f2 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:07:19.722451 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f61c75-b477-4a72-81a1-974d9cab80f2 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:07:19.731879 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf355e9-6f8d-4b74-9d08-e1612cea18b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f702830987ba4548a4c2ee3d0e302d02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:07:19.733019 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf355e9-6f8d-4b74-9d08-e1612cea18b3 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:07:19.733529 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf355e9-6f8d-4b74-9d08-e1612cea18b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:07:19.734080 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf355e9-6f8d-4b74-9d08-e1612cea18b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:07:19.738120 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1bf355e9-6f8d-4b74-9d08-e1612cea18b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:07:19.758928 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf355e9-6f8d-4b74-9d08-e1612cea18b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:07:19.762010 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf355e9-6f8d-4b74-9d08-e1612cea18b3 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:07:19.780323 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1460/2899] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:07:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:07:29.772006 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=13 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:08:56.760087 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6f751-065f-46f9-9736-86b94e5646ec service placement] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:08:56.771066 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6f751-065f-46f9-9736-86b94e5646ec service placement] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:08:56.775592 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef6d4a-00e0-4c3b-9158-6c4d2b066303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:08:56.776341 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef6d4a-00e0-4c3b-9158-6c4d2b066303 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:08:56.776688 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef6d4a-00e0-4c3b-9158-6c4d2b066303 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:08:56.777029 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef6d4a-00e0-4c3b-9158-6c4d2b066303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:08:56.779006 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-7fef6d4a-00e0-4c3b-9158-6c4d2b066303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:08:56.809116 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef6d4a-00e0-4c3b-9158-6c4d2b066303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:08:56.810637 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef6d4a-00e0-4c3b-9158-6c4d2b066303 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:08:56.823537 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1440/2900] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:08:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:08:58.060625 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf355e9-6f8d-4b74-9d08-e1612cea18b3 service nova] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:08:58.070815 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf355e9-6f8d-4b74-9d08-e1612cea18b3 service nova] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:08:58.074810 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c08aa4-781e-4510-a801-a0ca8c78246b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:08:58.075487 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c08aa4-781e-4510-a801-a0ca8c78246b service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:08:58.075815 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c08aa4-781e-4510-a801-a0ca8c78246b service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:08:58.076047 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c08aa4-781e-4510-a801-a0ca8c78246b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:08:58.078244 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-28c08aa4-781e-4510-a801-a0ca8c78246b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:08:58.096383 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c08aa4-781e-4510-a801-a0ca8c78246b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:08:58.097855 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c08aa4-781e-4510-a801-a0ca8c78246b service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:08:58.111092 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1461/2901] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:08:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 06:09:06.817637 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=11 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:09:08.105505 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=6 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:09:09.384791 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef6d4a-00e0-4c3b-9158-6c4d2b066303 service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:09:09.386422 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-7fef6d4a-00e0-4c3b-9158-6c4d2b066303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:09:09.398588 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef6d4a-00e0-4c3b-9158-6c4d2b066303 service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:09:09.402352 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0a59a-e174-4fe4-8f6a-c7e9e1891340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e845d0dc2c4a1fa612556c1aa73ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:09:09.403004 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0a59a-e174-4fe4-8f6a-c7e9e1891340 service neutron] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:09:09.403284 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0a59a-e174-4fe4-8f6a-c7e9e1891340 service neutron] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:09:09.403560 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0a59a-e174-4fe4-8f6a-c7e9e1891340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:09:09.405507 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-9ec0a59a-e174-4fe4-8f6a-c7e9e1891340 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:09:09.502163 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0a59a-e174-4fe4-8f6a-c7e9e1891340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:09:09.503642 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0a59a-e174-4fe4-8f6a-c7e9e1891340 service neutron] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:09:09.527419 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1441/2902] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:09:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:09:12.763155 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c08aa4-781e-4510-a801-a0ca8c78246b service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:09:12.777412 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c08aa4-781e-4510-a801-a0ca8c78246b service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:09:12.784225 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d31ad-d487-47ad-a2e0-2756610cd05f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17a40bea6ba41f19c88e16f9b15cf27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:09:12.785862 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d31ad-d487-47ad-a2e0-2756610cd05f service placement] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:09:12.786177 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d31ad-d487-47ad-a2e0-2756610cd05f service placement] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:09:12.787127 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d31ad-d487-47ad-a2e0-2756610cd05f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:09:12.789852 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-751d31ad-d487-47ad-a2e0-2756610cd05f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:09:12.806734 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d31ad-d487-47ad-a2e0-2756610cd05f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:09:12.808459 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d31ad-d487-47ad-a2e0-2756610cd05f service placement] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:09:12.829355 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1462/2903] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:09:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:09:16.202633 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0a59a-e174-4fe4-8f6a-c7e9e1891340 service neutron] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:09:16.215083 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0a59a-e174-4fe4-8f6a-c7e9e1891340 service neutron] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:09:16.220133 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48abdb-9d23-478d-845e-bd396b1d2333 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17a40bea6ba41f19c88e16f9b15cf27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:09:16.220786 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48abdb-9d23-478d-845e-bd396b1d2333 service placement] REQUEST_METHOD: `GET` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:09:16.221063 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48abdb-9d23-478d-845e-bd396b1d2333 service placement] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:09:16.221328 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48abdb-9d23-478d-845e-bd396b1d2333 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:09:16.223162 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-5d48abdb-9d23-478d-845e-bd396b1d2333 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:09:16.237662 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48abdb-9d23-478d-845e-bd396b1d2333 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:09:16.239437 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48abdb-9d23-478d-845e-bd396b1d2333 service placement] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:09:16.254035 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1442/2904] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:09:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 06:09:16.257178 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d31ad-d487-47ad-a2e0-2756610cd05f service placement] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:09:16.258637 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-751d31ad-d487-47ad-a2e0-2756610cd05f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:09:16.278312 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d31ad-d487-47ad-a2e0-2756610cd05f service placement] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:09:16.283100 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04bce91-3004-47c5-b6da-5dc8a8846301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:09:16.284102 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bce91-3004-47c5-b6da-5dc8a8846301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:09:16.284452 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bce91-3004-47c5-b6da-5dc8a8846301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:09:16.284735 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bce91-3004-47c5-b6da-5dc8a8846301 admin admin] PATH_INFO: `/v3/users/f02739ec12fa4f238244cdcbe1e3d739` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:09:16.285949 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04bce91-3004-47c5-b6da-5dc8a8846301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f02739ec12fa4f238244cdcbe1e3d739)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:09:16.288524 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04bce91-3004-47c5-b6da-5dc8a8846301 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:09:16.336508 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f04bce91-3004-47c5-b6da-5dc8a8846301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f02739ec12fa4f238244cdcbe1e3d739'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:09:16.345009 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f04bce91-3004-47c5-b6da-5dc8a8846301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f02739ec12fa4f238244cdcbe1e3d739'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:09:16.345830 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f04bce91-3004-47c5-b6da-5dc8a8846301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f02739ec12fa4f238244cdcbe1e3d739'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:09:16.354966 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f04bce91-3004-47c5-b6da-5dc8a8846301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f02739ec12fa4f238244cdcbe1e3d739'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:09:16.368054 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f04bce91-3004-47c5-b6da-5dc8a8846301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f02739ec12fa4f238244cdcbe1e3d739'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:09:16.374271 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1463/2905] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:09:16 2022] DELETE /identity/v3/users/f02739ec12fa4f238244cdcbe1e3d739 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:09:16.558623 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48abdb-9d23-478d-845e-bd396b1d2333 service placement] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:09:16.570323 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48abdb-9d23-478d-845e-bd396b1d2333 service placement] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:09:16.633103 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e5764-1474-4e7f-a1d5-cbfe45d95865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:09:16.634074 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e5764-1474-4e7f-a1d5-cbfe45d95865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:09:16.634350 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e5764-1474-4e7f-a1d5-cbfe45d95865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:09:16.634622 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e5764-1474-4e7f-a1d5-cbfe45d95865 admin admin] PATH_INFO: `/v3/projects/9405db81e23a4cbbb963f916fbeea605` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:09:16.635885 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e5764-1474-4e7f-a1d5-cbfe45d95865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9405db81e23a4cbbb963f916fbeea605)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:09:16.637824 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e5764-1474-4e7f-a1d5-cbfe45d95865 admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:09:16.687052 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-076e5764-1474-4e7f-a1d5-cbfe45d95865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9405db81e23a4cbbb963f916fbeea605', 'request_id': 'req-076e5764-1474-4e7f-a1d5-cbfe45d95865'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:09:16.690737 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:09:16.697139 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-076e5764-1474-4e7f-a1d5-cbfe45d95865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9405db81e23a4cbbb963f916fbeea605', 'request_id': 'req-076e5764-1474-4e7f-a1d5-cbfe45d95865'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:09:16.705031 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-076e5764-1474-4e7f-a1d5-cbfe45d95865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9405db81e23a4cbbb963f916fbeea605', 'request_id': 'req-076e5764-1474-4e7f-a1d5-cbfe45d95865'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:09:16.716596 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-076e5764-1474-4e7f-a1d5-cbfe45d95865 admin admin] The token cache is being invalidate because project 9405db81e23a4cbbb963f916fbeea605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:09:16.716893 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-076e5764-1474-4e7f-a1d5-cbfe45d95865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:09:16.717553 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-076e5764-1474-4e7f-a1d5-cbfe45d95865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:09:16.719196 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1443/2906] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:09:16 2022] DELETE /identity/v3/projects/9405db81e23a4cbbb963f916fbeea605 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:09:16.723641 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04bce91-3004-47c5-b6da-5dc8a8846301 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:09:16.724750 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f04bce91-3004-47c5-b6da-5dc8a8846301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:09:16.738080 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04bce91-3004-47c5-b6da-5dc8a8846301 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:09:16.798734 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6d985-86a5-4d4a-96a1-3a99bf1f2962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:09:16.799609 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6d985-86a5-4d4a-96a1-3a99bf1f2962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:09:16.799895 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6d985-86a5-4d4a-96a1-3a99bf1f2962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:09:16.800173 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6d985-86a5-4d4a-96a1-3a99bf1f2962 admin admin] PATH_INFO: `/v3/users/e4665744fd984d8caa03840ec0e40b50` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:09:16.801387 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a6d985-86a5-4d4a-96a1-3a99bf1f2962 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4665744fd984d8caa03840ec0e40b50)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:09:16.803359 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a6d985-86a5-4d4a-96a1-3a99bf1f2962 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:09:16.854023 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e8a6d985-86a5-4d4a-96a1-3a99bf1f2962 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4665744fd984d8caa03840ec0e40b50'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:09:16.860981 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e8a6d985-86a5-4d4a-96a1-3a99bf1f2962 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4665744fd984d8caa03840ec0e40b50'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:09:16.861698 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e8a6d985-86a5-4d4a-96a1-3a99bf1f2962 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4665744fd984d8caa03840ec0e40b50'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:09:16.865428 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:09:16.869919 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e8a6d985-86a5-4d4a-96a1-3a99bf1f2962 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4665744fd984d8caa03840ec0e40b50'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:09:16.886415 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e8a6d985-86a5-4d4a-96a1-3a99bf1f2962 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4665744fd984d8caa03840ec0e40b50'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:09:16.892401 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1464/2907] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Jun 21 06:09:16 2022] DELETE /identity/v3/users/e4665744fd984d8caa03840ec0e40b50 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:09:17.079273 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e5764-1474-4e7f-a1d5-cbfe45d95865 admin admin] Authenticating user token {{(pid=80109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:09:17.080899 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.fernet_utils [None req-076e5764-1474-4e7f-a1d5-cbfe45d95865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:09:17.095428 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e5764-1474-4e7f-a1d5-cbfe45d95865 admin admin] Validating token access rules against request {{(pid=80109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:09:17.159113 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ec8d7-5686-4f30-b878-6f053385b9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f991743edf4c82841603b9b9845e95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcf1eaa475624717b45bb4aefba5ae51', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:09:17.159807 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ec8d7-5686-4f30-b878-6f053385b9aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:09:17.160091 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ec8d7-5686-4f30-b878-6f053385b9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:09:17.160364 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ec8d7-5686-4f30-b878-6f053385b9aa admin admin] PATH_INFO: `/v3/projects/225ddb468dc64ffaa5a9bce5365ef606` {{(pid=80109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:09:17.161604 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ec8d7-5686-4f30-b878-6f053385b9aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=225ddb468dc64ffaa5a9bce5365ef606)` {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:09:17.164348 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ec8d7-5686-4f30-b878-6f053385b9aa admin admin] RBAC: Authorization granted {{(pid=80109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:09:17.213178 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1f4ec8d7-5686-4f30-b878-6f053385b9aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '225ddb468dc64ffaa5a9bce5365ef606', 'request_id': 'req-1f4ec8d7-5686-4f30-b878-6f053385b9aa'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:09:17.220857 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1f4ec8d7-5686-4f30-b878-6f053385b9aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '225ddb468dc64ffaa5a9bce5365ef606', 'request_id': 'req-1f4ec8d7-5686-4f30-b878-6f053385b9aa'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:09:17.227869 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1f4ec8d7-5686-4f30-b878-6f053385b9aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '225ddb468dc64ffaa5a9bce5365ef606', 'request_id': 'req-1f4ec8d7-5686-4f30-b878-6f053385b9aa'} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:09:17.238305 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1f4ec8d7-5686-4f30-b878-6f053385b9aa admin admin] The token cache is being invalidate because project 225ddb468dc64ffaa5a9bce5365ef606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 06:09:17.238591 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1f4ec8d7-5686-4f30-b878-6f053385b9aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:09:17.239217 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG keystone.notifications [None req-1f4ec8d7-5686-4f30-b878-6f053385b9aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 06:09:17.241041 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: [pid: 80109|app: 0|req: 1444/2908] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Jun 21 06:09:17 2022] DELETE /identity/v3/projects/225ddb468dc64ffaa5a9bce5365ef606 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 06:09:26.888806 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=8,keystone:DELETE=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:09:27.235429 dv-cinder-846901-1-iscsi devstack@keystone.service[80109]: DEBUG dbcounter [-] [80109] Writing DB stats keystone:SELECT=57,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:12:14.583051 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6d985-86a5-4d4a-96a1-3a99bf1f2962 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 06:12:14.584485 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e8a6d985-86a5-4d4a-96a1-3a99bf1f2962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:12:14.653856 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6d985-86a5-4d4a-96a1-3a99bf1f2962 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 06:12:14.713179 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ab249-701c-4a4e-8937-7dc0eaad84aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd17a40bea6ba41f19c88e16f9b15cf27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64b932ef6bf481cb93a04885a93b4b2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 06:12:14.713831 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ab249-701c-4a4e-8937-7dc0eaad84aa service placement] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 06:12:14.714406 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ab249-701c-4a4e-8937-7dc0eaad84aa service placement] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 06:12:14.714684 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ab249-701c-4a4e-8937-7dc0eaad84aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 06:12:14.716441 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-272ab249-701c-4a4e-8937-7dc0eaad84aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 06:12:14.727776 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ab249-701c-4a4e-8937-7dc0eaad84aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 06:12:14.729350 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ab249-701c-4a4e-8937-7dc0eaad84aa service placement] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 06:12:14.739416 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1465/2909] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jun 21 06:12:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 06:12:24.735058 dv-cinder-846901-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=58 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}